Import non authenticatable users

Laravel Version: 5.8.24
Adldap2-Laravel Version: 6.0.6
PHP Version: 7.2
LDAP Type: ActiveDirectory

Description:
I would like to have two AD groups. One for users that can login and do things and the other one for users i want to import into my application.
Right now i can't import users with a special filter (memberof group App_Users) because they are not in my memberOf Scope.
MemberOf Scope - Group "App_Admin"
Filter - Group "App_Users"
Is there any possibility to import users, that shouldn't be allowed to login?

Hi @ismaelw,
Yes definitely, I do this now internally.
Import all users you want inside your local applications database, then use a rule to only allow members of "App_Admin" to authenticate:
Rule:
namespace App\Rules;

use Adldap\Laravel\Validation\Rules\Rule;

class OnlyApplicationAdministrators extends Rule
{
    /**
     * Determines if the user is allowed to authenticate.
     *
     * @return bool
     */
    public function isValid()
    {
        return $this->user->inGroup('App_Admin');
    }
}

Config:
'rules' => [
    \App\Rules\OnlyApplicationAdministrators::class,
],

@stevebauman Thank you so much for your fast reply.
What I have now is:

All users to import are in the App_Users group (including the admins from the group App_Admin)
Rule created, checking if the user is in the group App_Admin
Added Rule to ldap_auth.php file
MemberOf Scope checks the user if he is in the group App_Users

With my tests it seems to work. Is this the right way to go how I did it now?
One thing though: After I add a user to the App_Admins group i have to clear the cache that the user can login. Is this right? Or is there still something wrong?

No problem @ismaelw!

With my tests it seems to work. Is this the right way to go how I did it now?

Yup, this is definitely the way to go about this.

One thing though: After I add a user to the App_Admins group i have to clear the cache that the user can login. Is this right? Or is there still something wrong?

You don't have to clear any caches (unless you're caching something yourself).
When you add a user into your App_Admins group in ActiveDirectory, they should be able to login to your application without clearing anything. When a user attempts logging into your application, their ActiveDirectory group memberships will be queried for during that authentication attempt - they are not cached.
However, if you remove a user from your App_Admins group and the user is logged into your web application, they will need to logout for the changes to take effect.

Thanks @stevebauman !
Everything clear now :) Again thanks for this super fast support on this!

Glad I could help @ismaelw! No problem at all :smile:


Since Flutter 1.22 the STACKTRACE is being swallowed when the error is inside of widgets

Since Flutter 1.22 the STACKTRACE is being swallowed when the error is inside of widgets.
For example, I am getting this:
════════ Exception caught by widgets library ════════
Failed assertion: boolean expression must not be null
The relevant error-causing widget was:
  MyWidget file:///C:/Users/Me/flutter_app/lib/my_widget/my_widget.dart:117:13
══════════════════════════════════════

It points me to the widget declaration, but the error is inside of it and this information is not being displayed.

Some of my colleagues are having the same problem, and others are not.
The ones who are not experiencing the problem are actually getting the error twice, once with the stacktrace and once without it:
════════ Exception caught by widgets library ════════
The following assertion was thrown building MyWidget(dirty):
Failed assertion: boolean expression must not be null
The relevant error-causing widget was:
  MyWidget file:///C:/Users/Me/flutter_app/lib/my_widget/my_widget.dart:117:13
When the exception was thrown, this was the stack:
#0      MyWidget.preambulo (package:xyz/participantes_widget.dart:44:27)
#1      MyWidget._varios (package:xyz/my_widget.dart:71:14)
#2      MyWidget.build (package:xyz/my_widget.dart:56:14)
#3      StatelessElement.build (package:flutter/src/widgets/framework.dart:4701:28)
#4      ComponentElement.performRebuild (package:flutter/src/widgets/framework.dart:4627:15)
...
════════════════════════════════════

════════ Exception caught by widgets library ════════
Failed assertion: boolean expression must not be null
The relevant error-causing widget was:
  MyWidget file:///C:/Users/Me/flutter_app/lib/my_widget/my_widget.dart:117:13
══════════════════════════════════════

@marcglasberg I am seeing similar behavior. Is this only in your IDE run tab? If I try in a terminal, I get the stack trace as expected.
This might be related to intellij. If you can confirm, maybe we should create an associated issue at https://github.com/flutter/flutter-intellij. I wouldn't know if either or both projects are involved in bug.
I have checked with the following diff to flutter create counter:
modified   lib/main.dart
@@ -8,6 +8,7 @@ class MyApp extends StatelessWidget {
   // This widget is the root of your application.
   @override
   Widget build(BuildContext context) {
+    throw Exception;
     return MaterialApp(
       title: 'Flutter Demo',
       theme: ThemeData(

If I try the run button in intellij, there is no stack trace. But if I try in intellij's terminal tab, or in Terminal.app, the stack trace is shown as expected. I have checked this behavior in vscode, as well as in intellij on Windows. (vscode just does an odd truncation of about five lines of stack trace.)
I will double check for an older flutter version later today.

With the following version, intellij shows stack trace again. So bug seems to start between 1.20 and 1.22.
% flutter --version
Flutter 1.20.4 • channel unknown • unknown source
Framework • revision fba99f6cf9 (3 weeks ago) • 2020-09-14 15:32:52 -0700
Engine • revision d1bc06f032
Tools • Dart 2.9.2

Hi @marcglasberg
I'm unable to reproduce with a null bool value
Can you please provide your flutter doctor -v your flutter run --verbose and a complete reproducible minimal code sample
Thank you

@TahaTesser That's not so easy. As I said, some of my colleagues are having the same problem, and others are not, so it's not just a code problem. And the bool value is just an example. The problem happens for any error thrown by a widget.
@bradyt Ok, I will test if this happens only in the IDE run tab vs the terminal.

@TahaTesser @bradyt
Yes, I can confirm that it happens  only in the IDE run tab. The terminal gives the complete information.
Also, if you downgrade the Flutter plugin from 50.0 to 49.04 the problem is gone. You can download the plugin in this page:
https://plugins.jetbrains.com/plugin/9212-flutter/versions/stable/96118
And the direct download link is this:
https://plugins.jetbrains.com/files/9212/96118/flutter-intellij.zip?updateId=96118&pluginId=9212&family=INTELLIJ

https://github.com/flutter/flutter-intellij/issues/4952

Hi @marcglasberg
Correct me if I'm wrong but this sounds like a plugin issue since downgrading plugins solves the issue
Following the indication of jetbrains' Flutter plugin, the correct way to address the problem is to open an issue in the dedicated repository.
Closing, as this isn't an issue with Flutter itself. If you disagree, please write in the comments and I will reopen it.
Thank you


⚠ Bofrost.fr has degraded performance

In d425d09, Bofrost.fr (https://www.bofrost.fr) experienced degraded performance:

HTTP code: 200
Response time: 811 ms

Resolved: Bofrost.fr performance has improved in f5f24dd after 6 minutes.


Fix removeAdditional option of ajv

This PR fixes removeAdditional option of ajv passed through ajvRequestOptions and ajvResponseOptions to make it filter extra fields correctly.

Can you please provide a test illustrating the fix? Thanks!

Can you please provide a test illustrating the fix? Thanks!


Missing styles from _custom_forms.scss in Bootstrap 4.0.0

This one caused me a lot of grief!  It looks like the following two lines are missing in _custom_forms.scss and should be placed on line 179:
-webkit-appearance: none;
-moz-appearance: none;
Strange that they're there in the CDN version.

No, they should not be added.
Bootstrap uses Autoprefixer to add vendor prefixes automatically at build time

That makes more sense, but I guess the "appearance" property is getting skipped.  Where does the fix need to happen?

I just tested appearance: none; on Autoprefixer and it adds both the -moz- and -webkit- prefix.

Closing given @wolfy1339's comments.

When I download the most recent version and compile without ANY customizations using Scout, they are not added to .custom-select.  appearance:none; is there, but no -moz- or -webkit- prefixes.

You need to add Autoprefixer to your build process. This is not a Bootstrap problem.


[Question/BUG] Query Parameters converted to float

issue / feature request
I Would like to understand the rationale of converting any query parameter that is a series of digits to floats. I am building an API that relies on Account ID's being based which are digits, these are needed in string form and python-lambdarest uses the float() function to convert all strings that are numeric, without the ability to override this behaviour from what i can tell.
Is there a reason for this - HTTP is a string based protocol afaik, hence converting to float seems somewhat arbitrary and if needed something that could be done in business logic vs the underlying library which is parsing the API Gateway JSON payload.
Thanks!

Hi @andyfase just looked at the code. Seems like it was a too general catch all so i'm up for a change.
Have you got time to make pseudocode, code + pr or a testcase that demonstrates your example?
Kind regards

Btw it only float casts arrays:
value = list(map(__float_cast, value_cand))

We could change it so it looks up the types from the input jsonschema and casts accordingly with a default on float-casting. That wouldnt strictly be backwards compatible so it would require a version bump

Hey @sloev Indeed this is just for arrays, or multi-value query string parameters. Actually i wonder if this change can be made at the same time as potentially adding support for the multiValueQueryStringParameters  field within the event object. this field is supported for both API Gateway and ALB and its actually something I looked for in terms of support initially vs comma-seperation. This would allow for foo&bar&foo=bar2 type query strings.
In this way comma-seperation float conversion can be left as is, and multiValueQueryStringParameters support can be added that either does not perform type casting or attempts to use the schema definition (if it exists) to convert to the appropriate type (string, integer, float)
I'm happy to have a go at adding support for multiValueQueryStringParameters if you feel it's something you would accept.

If you give it a go it would be a great start. Then i have something to get going from.
I've seen great contributions in this repo start with a testcase that demonstrates the issue, maybe we should start with that @andyfase ?

Nd to be clear:
I think hvaing support for multi is a need-to-have
But i would also argue thta the current json decoding behavior is wrong and should be using the jsonschema as tyoe register

@andyfase i have started work on this in here: https://github.com/trustpilot/python-lambdarest/pull/70

@andyfase https://github.com/trustpilot/python-lambdarest/pull/70 solves the issue with query params like this:
someurl?AccoundId=00012,2332300,fd000002,   120
which you can now specify to be treated as strings which will then be injected to your handler as:
def handler(...AccoundId):
assert AccountID == ["00012", "2332300", "fd000002", "   120"
about multiValueQueryStringParameters lets to that in another pr: https://github.com/trustpilot/python-lambdarest/issues/71

its out
v.10.0.1
changes:
### 10.0.1 (2020-09-11)

**This is not a backwards compatible change.**

- Use query `schema.properties.query.properties.*` as type lookup for unpacking of query params to right types (including lists/singulars of strings/ints/floats/booleans)
- **not supporting json objects as values in query-params anymore** _use json body instead_


Routing docu improvements

Current Using RailsAdmin routes should be improved.
Situation:

Create model Kaboom with field kaboom:integer
Configure model for linkage:

configure :kaboom do
  pretty_value do
    if value.present?
       linked_kaboom = Kaboom.find(value)
       unless linked_kaboom.nil?
         bindings[:view].link_to(linked_kaboom.title, bindings[:view].rails_admin.kaboom_path(linked_kaboom))
       end
    end
  end
end

What happens:
undefined method `kaboom_path' for #<ActionDispatch::Routing::RoutesProxy:0x000000059894f0>

What's the right path reference in the above scenario?
Version under question: eefa8ac

@ain You mixed up approaches from documentation:

if you want to have a link within rails_admin then you going to use
bindings[:view].rails_admin.show_path(model_name: 'kaboom', id: linked_kaboom.id)
or a external link within your application routes(excluding rails admin):
bindings[:view].main_app.kaboom_path(linked_kaboom)

Excellent! Thanks for the support @mryuriy.
I think the points you made here would be of great help in the docu.

@ain can this be closed?


feat(sdk): add token checkout

Pull Request Test Coverage Report for Build<PHONE_NUMBER>
Details

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 9.706%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
9465

Relevant Lines:
97517

💛  - Coveralls


Uncovered lines in instrumentSolidity.js

This is what instrumentSolidity.js's coverage report looks like after adding unit tests for conditionals. There are few lines that aren't being run that may be difficult to hit.

L 280 (New) Not completely sure but this might always be on the right hand side of an assignment expression. Possibly unreachable.
L 311 (BinaryExpression) Is there a test that can be written to get inside here? Possibly unreachable.
L 537 and L 541 Is this pre- preprocessor bracket handling?

(NB: This issue is book-keeping for changes in the conditional-unit-tests branch which modifies the parsing slightly. The above not necessarily true of master at present.)

Edit: qualified the above to about conditional-unit-tests branch.

The line x+2 would get hit by BinaryExpression, though obviously that doesn't do anything, and we don't do anything with the instrumentation there... even so, it's valid Solidity, so we should probably support it even if nothing happens there, and check that we do correctly!
New Contract(args) can be on a line by itself. You lose the address of the contract, obviously, but is there a reason you'd do stuff in the constructor of a contract and then selfdestruct at the end of the constructor? This would be a very edge case though! Again though, it's technically valid, so we at least need the function there and can test for it.
You're right. closeBracketStart is already not used anywhere, and the only branch that uses closeBracketEnd is only hit (I believe) when instrumenting the contract before the preprocessor has run on it, so we can remove that too.
I've made a couple of commits that deal with these situations.

And now rebased, so a PR should work properly 👍


Speed up NdMapping.groupby

This PR refactors the NdMapping.groupby operation into a separate function and provides an alternative implementation based on Pandas, which is significantly faster for large datasets. You can see the linear performance scaling by the old implementation and might just make out the sublinear performance of pandas, which becomes very significant for large datasets >10000 items. This is a temporary workaround until we come up with a general solution data API for NdMapping types that's being discussed in #347.

Definitely a very valuable PR: it cleans up groupby on MultiDimensionalMapping, moves useful functionality into util and most importantly offers a major performance improvement (for people with pandas installed) with very little code.
I'm happy to implement my suggestion of turning ndmapping_groupby into a parameterized function once the tests are passing...

I'm now done with this, I'd be happy if you refactored it into ParameterizedFunction, then we can merge.

Great! The key thing is that all the tests are passing now...
My only comment now is whether you are happy for me to make this into a parameterized function? Or do you object to having a single parameterized function for groupby?
Shouldn't take long to do and I am happy to change it if you are busy.

My only comment now is whether you are happy for me to make this into a parameterized function? Or do you object to having a single parameterized function for groupby?

Must have missed my comment somehow:

I'm now done with this, I'd be happy if you refactored it into [a] ParameterizedFunction, then we can merge.

Sorry yes - I skimmed your reply too quickly. I'll do the final refactor now.

If the tests pass now, I'll go ahead and merge.

Excellent!


Improve placement of rate-limiting for email mirror

We had our first application of the new email mirror rate-limiting in production. Unfortunately, it only sorta worked.  We indeed rate-limited messages from the offending sender, however, because the flow is:
(1) The code in postfix config's master.cf causes postfix to invoke a new copy of scripts/lib/email-mirror-postfix
(2) scripts/lib/email-mirror-postfix does an HTTP POST to /email_mirror_messages, a Django worker which puts the event into a queue for handling.
(3) The queue processor MirrorWorker does the rate-limiting check and decides to drop the message.
We end up having done too much CPU work for 10Ks of emails arriving even when we're rate-limiting.
The things which are bad here are:
(1) Python script startup takes a while, even something simple like email-mirror-postfix (which we optimized long ago to not need to import big libraries).
(2) Because the postfix pipe system invokes the script anew for every email, we end up doing that a lot of times
(3) We don't do the rate-limit check early enough in the pipeline (which would be hard to fix fully with this postfix pipe architecture, because we don't have a persistent process that can maintain an open connection to redis or any other rate-limiting database until at least the HTTP request handler).
There's a few options for how to fix this:

I think ideally we'd have an architecture where we get postfix to pass the email data via a file descriptor to a persistently running daemon process (it's possible the pass postfix configuration option supports this? I had a hard time figuring out what that does in their docs: http://www.postfix.org/master.5.html) rather than forking a new process every time. That way, we can just have that persistent daemon process do the rate-limit check (and put the item in a queue if it passes) without worrying about having to startup a new connection to redis for every email.
Replace postfix with a Python-based email server (maybe Twisted has something?) for the email mirror, which would let us do the rate-limiting in the perstent process.
Move the rate-limiting to the HTTP handler and replace email-mirror-postfix with e.g. a curl invocation (which might be a lot faster).
Look at whether there's a way to do rate-limiting directly in the postfix configuration.

@zulipbot claim

@zulipbot claim
Got distracted by other things previously, will get on this properly now.


cfitsio: add Darwin support

Motivation for this change
This PR adds support for the cfitsio library on Darwin. A couple of changes have been made in the configure script:
1 - The detection of /usr/bin/curl-config on Darwin has been turned off. As a result, the library does not support HTTPS, but I believe it is not supported on Linux either.
2 - The flags to build a universal library have been removed because they cause a link error (missing i386 symbols).
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option build-use-sandbox in nix.conf on non-NixOS)
Built on platform(s)

[ ] NixOS
[x] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[x] Fits CONTRIBUTING.md.

Thanks for the review @LnL7. I've fixed the rpath issue in d629dae.

Thanks


SkyLightStateless callbacks (afterClose, afterOpen etc.) don't work

Having SkyLight modal which should be opened when isVisible is true, I'd like do some actions after modal opens (particularly focus on some field). It seems that afterOpen callback does not work (console.log doesn't show anything, when modal opens...)
someFunc() {
    console.log('cb test')
}

 <SkyLightStateless
    isVisible={isVisible}
    afterOpen={this.someFunc}
 >
....

Did you find some solution for this? afterOpen works for me but not afterClose or beforeClose.

No. Haven't found any solution. On the moment I submitted the issue, afterOpen did not work. Maybe, they fixed something that it works for you. Have to check again...

Hi,
Somebody has an example of this problem?
For now I'll close this issue, if anyone has an example, please post here and reopen it.
Thanks


Override description from operation template

Currently when we use a template, e.g., ArmResourceRead, its responses have its own description like
"responses": {
  "200": {
    "description": "Azure operation completed successfully.",
    "schema": {
      "$ref": "#/definitions/EmployeeListResult"
    }
  },
  "default": {
    "description": "An unexpected error response.",
    "schema": {
      "$ref": "../../../common-types/resource-management/v5/types.json#/definitions/ErrorResponse"
    }
  }
}

But brownfield service defined its own description. We should have a way to override these descriptions.

@pshao25 We should not try to match the response description for existing swaggers.  This should be a non-goal.  Descriptions of response models make sense, but the descriptions of response status codes in swagger are of limited value.
If there is a need in some very strange case to do this, you can use the Response parameter in each operation template to replace the responses and add your own documentation like this
But again matching the description of the status code responses in swagger should be an explicit non-goal of conversion


add ConnectToWebSeedsImmediately setting

@proff could you share it? thanks :)
I'm looking forward a torrent lib that works on windows phone / universal apps.

If it's annoying, submit a PR with a fix, or at least say what the annoyance is :P


Can't download Aniwave

Source information
AniWave 13.53
Source language
English
Steps to reproduce
1.Enter Aniwave
2.choose Anime
3. Download Episode
Expected behavior
Download the episodes
Actual behavior
I can't download Any episode from the source
It says Failed to Fetch video
Aniyomi version

Android version
Android 12 S
Other details
In AniWave my:
Preferred Domain is AniWave.bz
Preferred Type Sub
Preferred Quality 480p
Preferred Server Mp4Upload
Enabled all Hosts
Enable TypeSub and Soft Sub
Acknowledgements

[X] I have searched the existing issues and this is a new ticket, NOT a duplicate or related to another open or closed issue.
[X] I have written a short but informative title.
[X] I have updated the app to version <IP_ADDRESS>.
[X] I have updated all installed extensions.
[X] I have tried the troubleshooting guide.
[X] If this is an issue with the app itself, I should be opening an issue in the app repository.
[X] I will fill out all of the requested information in this form.

Unable to replicate, please open a new issue and mention which anime, and which episode you're trying to play.


Portfolio_preserve-data-in-the-browser

When the user changes the content of any input field, the data is saved to the local storage.
2.When the user loads the page, if there is any data in the local storage the input fields are pre-filled with this data.
We did not create one local storage entry per input field. We made use of Javascript object to store form information.

The page saves data in the local storage when input fields change, not when the user submits.
I have used the window.load feature.
Thank you.


Improve the way gas is estimated via the API eth_estimateGas

If the network has a pretty low volume of txs atm, if someone publish a tx with a very high gasPrice (70 gwei, which is more appropriate for mainnet, whereas our pricing should look more like .0001 gwei as we have a low volume of txs) and if it's the only tx in the sample used by estimateGas() this API call will end up return the 70 gwei as the estimated price, which is too high.

I want to say no for 1559 transactions.

Closing as stale for post-1559 world. Can re-open if significant need elsewhere.


Script files are downloaded with LOW priority

As script files are initiated in another script (required to not download polyfills on older browsers) the script files are all downloaded with low priority even if these are required to make the page interactive.

This is mitigated using the preload resource hint for critical script files.


Initial setup

retest this please

SonarQube analysis reported 2 issues

 1 major
 1 minor

Watch the comments in this conversation to review them.


Implement package assembly in scancode.io

This PR updates the application package scanning step in scancode.io to reflect the updates made to package scanning in scancode-toolkit. Package scanning is now a two step process, where we first detect Package data from CodebaseResources, then we iterate through all the Resources with Package data and process them using the new Package handlers from scancode-toolkit.

@JonoYang thanks for splitting those PR, much easier to review and test.

I'm getting the following error running the scan_codebase on https://files.pythonhosted.org/packages/9b/41/e1e7d6ecc3bc76681dfdc6b373566822bc2aab96fa3eceaaed70accc28b6/Django-4.1-py3-none-any.whl

DiscoveredPackage matching query does not exist.

Traceback:
  File "scancode.io/scanpipe/pipelines/__init__.py", line 115, in execute
    step(self)
  File "scancode.io/scanpipe/pipelines/scan_codebase.py", line 93, in scan_for_application_packages
    scancode.scan_for_application_packages(self.project)
  File "scancode.io/scanpipe/pipes/scancode.py", line 332, in scan_for_application_packages
    assemble_packages(project=project)
  File "scancode.io/scanpipe/pipes/scancode.py", line 375, in assemble_packages
    for item in items:
  File "scancode.io/lib/python3.9/site-packages/packagedcode/models.py", line 941, in assemble
    cls.assign_package_to_resources(
  File "scancode.io/lib/python3.9/site-packages/packagedcode/models.py", line 1005, in assign_package_to_resources
    package_adder(package_uid, resource, codebase)
  File "scancode.io/scanpipe/pipes/scancode.py", line 344, in add_to_package
    package = project.discoveredpackages.get(package_uid=package_uid)
  File "scancode.io/lib/python3.9/site-packages/django/db/models/manager.py", line 85, in manager_method
    return getattr(self.get_queryset(), name)(*args, **kwargs)
  File "scancode.io/lib/python3.9/site-packages/django/db/models/query.py", line 496, in get
    raise self.model.DoesNotExist(

We should add a simple test for assemble_packages, to expose how a couple resources with package_data are assembled into a package.

We need to optimize this data migration https://github.com/nexB/scancode.io/pull/485/files#diff-53edf14fc544b3829f4f4afbe3b0e97534e97829e9bc3d1a9be7e4e2680868b0R6
I just takes too much time on large database with hundred of thousands existing resources. Loading the resources then calling save() on each one is too slow, I would suggested to use update() instead. The goal is to convert all the Python logic into SQL logic. We may need to write raw SQL here if the Django QuerySet API is not enough.

@JonoYang Did you have the chance to investigate the issue reported above?

@tdruez The issue is caused by DatafileHandler.assemble_from_many(), where Resources are yielded before Packages. I've set up the CodebaseResource creation logic in load_inventory and scan_codebase to create DiscoveredPackages before the CodebaseResources of a Project, such that I can associate the CodebaseResources to their DiscoveredPackages. I've modified the .assemble() methods of other DatafileHandlers to yield Packages before dependencies and resources, but I'm also looking into sorting these objects on the scancode.io side in the assemble_packages function in my PR.
This is my PR on scancode-toolkit that modifies DatafileHandler.assemble_from_many() to yield Packages before Resources and Dependencies
https://github.com/nexB/scancode-toolkit/pull/3042

Sorting the items yielded by .assemble() doesn't work. We still run into the issue where we need a DiscoveredPackage to exist for a Project before we can relate a CodebaseResource to it when the .assemble() method code is determining the resources of a package.

@JonoYang could you extract the changes related to https://github.com/nexB/scancode.io/issues/467 into it's own PR so we can get this one merge while we are sorting the assembly issues?

@tdruez
I've updated CodebaseResource.for_packages to return a list of package_uids of the DiscoveredPackages associated to the CodebaseResource. package_uid values are different every time they are generated, so in tests where we compare package_uid values, we normalize them using purl_with_fake_uuid. I was wondering what was the best way to normalize a package_uid from the CSV output test (https://github.com/nexB/scancode.io/blob/implement-package-assembly/scanpipe/tests/test_pipes.py#L132)

I've updated CodebaseResource.for_packages to return a list of package_uids of the DiscoveredPackages associated to the CodebaseResource. package_uid values are different every time they are generated, so in tests where we compare package_uid values, we normalize them using purl_with_fake_uuid. I was wondering what was the best way to normalize a package_uid from the CSV output test (https://github.com/nexB/scancode.io/blob/implement-package-assembly/scanpipe/tests/test_pipes.py#L132)

Looking at it again, I now realize there is no need to normalize the package_uids in the for_packages field in the CSV tests because the Package data is set in code and in the fixtures and we will always get the same package_uid returned. In scancode-toolkit, we need to normalize the package_uids because scancode generates a unique package_uid on each test run.

@JonoYang I'm not sure your latest changes were intended to fix https://github.com/nexB/scancode.io/pull/485#issuecomment-1206381058 but I'm still getting the same issue with the latest code.

@JonoYang I'm not sure your latest changes were intended to fix #485 (comment) but I'm still getting the same issue with the latest code.

The PR with this fix has been merged into scancode-toolkit and should be available in the next version and I'll bump the scancode version in scio when it comes out. (https://github.com/nexB/scancode-toolkit/pull/3042)

@JonoYang I've merged the latest main branch including the ScanCode-toolkit v31.0.1 version.

The issue "DiscoveredPackage matching query does not exist." from https://github.com/nexB/scancode.io/pull/485#issuecomment-1206381058 appears to be fixed.

I'm seeing an extra resource associated to the second package using the main branch that I do not see in this current branch:

main

implement-package-assembly

Also, shouldn't we only detect 1 package here?

I'm still getting this issue in the assemble_packages() with this branch running the docker pipeline on docker://python:3.8-slim-buster:

CodebaseResource matching query does not exist.

Traceback:
  File "/app/scanpipe/pipelines/__init__.py", line 115, in execute
    step(self)
  File "/app/scanpipe/pipelines/root_filesystems.py", line 118, in scan_for_application_packages
    scancode.scan_for_application_packages(self.project)
  File "/app/scanpipe/pipes/scancode.py", line 332, in scan_for_application_packages
    assemble_packages(project=project)
  File "/app/scanpipe/pipes/scancode.py", line 375, in assemble_packages
    for item in items:
  File "/usr/local/lib/python3.9/site-packages/packagedcode/models.py", line 949, in assemble
    cls.assign_package_to_resources(
  File "/usr/local/lib/python3.9/site-packages/packagedcode/pypi.py", line 319, in assign_package_to_resources
    site_packages = resource.parent(codebase).parent(codebase).parent(codebase)
  File "/app/scanpipe/models.py", line 1632, in parent
    return parent_path and self.project.codebaseresources.get(path=parent_path)
  File "/usr/local/lib/python3.9/site-packages/django/db/models/manager.py", line 85, in manager_method
    return getattr(self.get_queryset(), name)(*args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/django/db/models/query.py", line 650, in get
    raise self.model.DoesNotExist(

@tdruez

CodebaseResource matching query does not exist.
Traceback:
File "/app/scanpipe/pipelines/init.py", line 115, in execute
step(self)
File "/app/scanpipe/pipelines/root_filesystems.py", line 118, in scan_for_application_packages
scancode.scan_for_application_packages(self.project)
File "/app/scanpipe/pipes/scancode.py", line 332, in scan_for_application_packages
assemble_packages(project=project)
File "/app/scanpipe/pipes/scancode.py", line 375, in assemble_packages
for item in items:
File "/usr/local/lib/python3.9/site-packages/packagedcode/models.py", line 949, in assemble
cls.assign_package_to_resources(
File "/usr/local/lib/python3.9/site-packages/packagedcode/pypi.py", line 319, in assign_package_to_resources
site_packages = resource.parent(codebase).parent(codebase).parent(codebase)
File "/app/scanpipe/models.py", line 1632, in parent
return parent_path and self.project.codebaseresources.get(path=parent_path)
File "/usr/local/lib/python3.9/site-packages/django/db/models/manager.py", line 85, in manager_method
return getattr(self.get_queryset(), name)(*args, **kwargs)
File "/usr/local/lib/python3.9/site-packages/django/db/models/query.py", line 650, in get
raise self.model.DoesNotExist(

This error is happening because we do not create the directory Resources when we create Resources from a docker image. The fix for this is to set with_dir=True as an argument into layer.get_resources() (https://github.com/nexB/scancode.io/blob/main/scanpipe/pipes/docker.py#L176)
After fixing that issue, the pipeline failed from a syntax error in PythonInstalledWheelMetadataFile.assign_package_to_resources(). I've created a PR for it (https://github.com/nexB/scancode-toolkit/pull/3059)
After fixing the syntax error in PythonInstalledWheelMetadataFile.assign_package_to_resources(), I'm able to run the docker pipeline without errors.

@JonoYang with the latest toolkit 31.0.2 the DoesNotExist is now properly fixed.
I've encountered a new ProjectError reported https://github.com/nexB/scancode-toolkit/issues/3067 but unrelated to this PR.
Merging!


Add endpoint to list Grid teams

We need this to list teams in a workspace https://api.slack.com/methods/admin.teams.list

we don't have the scope for this


Can i use Rancher of multi Project?

I wanna setup Rancher server at only one But I have projects that separate from each other.
Ex :
Project A  have 3 Services and 1 API Key Infra  that can create one or more node.
Project B have 10 Services and 2 API Key Infra  #that can create one or more node.
and each Project can't use the same infra.
Thank you.

Yes, you would use multiple environments for this purpose.
http://docs.rancher.com/rancher/v1.5/en/environments/

Excuse me , How I manage environments via API or Nodejs lib ?


Add Abi-ko.com to the list of merchants

What's the name of your business?
Abi-ko.com
What's the URL of the website?
https://abi-ko.com/
Write a brief description of your business/service (max 50 characters)
Abi-ko.com - Anonymous Crypto Exchange
Enter the URL where a Monero mention can be found
https://abi-ko.com/
How do you accept Monero? (choose only one option)

[ ] Monero integrations (github.com/monero-integrations)
[ ] Globee
[ ] Native wallet
[+] Other payment gateaway (Coinpayments, Morphtoken, etc. Please specify)

How would you categorize your business? (choose only one option)

[+] Exchange
[ ] Block Explorer
[ ] Payment Gateway
[ ] Web Hosting
[ ] Tool
[ ] Service
[ ] Goods
[ ] Entertainment

Comment

NACK

#1524

#1524

Hello
Please tell me why you closed our issue, and linked us to another exchanger?


mydeeplearning

Expected behavior
Actual behavior
Information about the Issue
Steps to reproduce the behavior

...
...

test

No information provided or steps to replicate - Closing 😞


[Vue warn]: Failed to resolve component: dino-color-picker

Env: Vue3
It will always show warning when I pick up a color:
[Vue warn]: Failed to resolve component: dino-color-picker

This is expected, as it doesn't have any specific Vue integration. Here's how to keep it from showing this message for tags that are expected to come from customElements:
https://vuejs.org/guide/extras/web-components#example-vite-config


DOUBT || Regarding UI response on uploading Faulty Files

Hi @anirudh-0, @manimaarans
DPG-DEV
IS this Correct ERROR when uploading faulty files ??

Getting Something Went Wrong as  UI Response when uploading Faulty files.
API RESPONSE:
{
"ResponseInfo": null,
"Errors": [
{
"id": null,
"parentId": null,
"code": "EG_FILESTORE_INVALID_INPUT",
"message": "Inalvid input provided for file, the extension does not match the file format. Please upload any of the allowed formats : [jpg, jpeg, png, pdf, odt, ods, docx, doc, dxf, csv, txt, xlsx, xls]",
"description": null,
"params": null
}
]
}

Also I am not getting ERROR when I am uploading Online converted files
Refer Screenshot


193 review textinput

By creating this pull request you agree to the terms in CONTRIBUTING.md.
https://github.com/Infineon/.github/blob/master/CONTRIBUTING.md
--- DO NOT DELETE ANYTHING ABOVE THIS LINE ---
CONTRIBUTING.md also tells you what to expect in the PR process.
Description
Text Input component reviewed
Added support for v-model
Added e2e tests
Added component to example applications

📦 Published PR as canary version: 18.2.6--canary.200.153e54b099df80dc93cc79c990834f467f7600c5.0

:sparkles: Test out this PR locally via:
npm install<EMAIL_ADDRESS># or
yarn add<EMAIL_ADDRESS>

I updated the PR a little bit:

I removed the cursor: pointer on hover, because the standard cursor should be the default text one. I only changed it because the text-input component was used for the select component, but now since it's not, the cursor should not be pointer.
I removed some commented out css styles that I have forgotten to remove.
Removed :host { width: 100% } because it's not needed. I think it was only there for when textInput is used as a Select component.
Replaced 1d1d1d with its corresponding token name.
Ddded the component in the React examples folder.
Added readonly to the control options in Storybook

One issue:

I can't run it on Storybook.
When I go inside packages/components, and run npm run dev, I keep getting: 'storybook' is not recognized as an external or internal commend. Same happens when I run dev:storybook. I did npm install, but still getting this error. I wonder why?


Error when AWS config path specified

chef: 11.18.0.rc.1   -- awscli 1.6.5
Attempted multiple variations of the below knife.rb setting (also with single quotes)
knife[:aws_credential_file] = "~/.aws/config"
knife[:aws_credential_file] = "~/.aws/credentials"
All return error on execution knife ec2 server list
ERROR: Errno::ENOENT: No such file or directory @ rb_sysopen - ~/.aws/config
Setting an environment variable for the awscli config file and using this in knife.rb works.
knife[:aws_credential_file] = ENV['AWS_CONFIG_FILE']

Larry take a look around here https://github.com/chef/knife-ec2/blob/master/lib/chef/knife/ec2_base.rb#L103
and you could probably just make ~/.aws/config the default and add a flag for the AWS credentials ie --aws-config ~/dev/foo/.aws/config.

@larryebaum @stephenlauck
Here, please use  knife[:aws_credential_file]= <full_path> instead of  knife[:aws_credential_file]= ~/.aws/config.
EX-
knife[:aws_credential_file]= '/home/ubuntu/.aws/config'


Time component is hidden

Coverage increased (+0.01%) to 85.168% when pulling 4b8311074cd73185bccec2b503bad44e8f46ce93 on symonenkov:time-container into 2e174adb5e5badd907e9d0ebeabcc920d77538f0 on chmln:master.

Hello,
Thank you for your contribution!
The calculation was still a bit off, and I found it was due to input.offsetHeight.
Here's what is was before:

And now that its correct:


returning errors from "deep" methods

Hi, Paul
So, I have found an .eaf file with an error in it, a mismatch between the number of tabbed words in the morpheme line and the number in the morphemeGlosses line. It would be nice to be able to tell the author exactly where and what the error is—is there some way to percolate that information up from IjalLine to the webapp so I can show it on the page?
David
eafFileName: PROJECTS/Inferno/JIT0006_ori.eaf
projectDirectory: PROJECTS/Inferno
audioDirectoryRelativePath: audio
grammaticalTermsFile: None
tierGuideFile: PROJECTS/Inferno/tierGuide.yaml
ijal.css
[2019-05-12 09:42:13,309] ERROR in app: Exception on /_dash-update-component [POST]
Traceback (most recent call last):
File "/Users/David/OpenSource/github/slexil/ijalLine.py", line 201, in calculateMorphemeSpacing
assert(len(morphemes) == len(glosses))
AssertionError
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/flask/app.py", line 2292, in wsgi_app
response = self.full_dispatch_request()
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/flask/app.py", line 1815, in full_dispatch_request
rv = self.handle_user_exception(e)
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/flask/app.py", line 1718, in handle_user_exception
reraise(exc_type, exc_value, tb)
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/flask/_compat.py", line 35, in reraise
raise value
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/flask/app.py", line 1813, in full_dispatch_request
rv = self.dispatch_request()
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/flask/app.py", line 1799, in dispatch_request
return self.view_functionsrule.endpoint
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/dash/dash.py", line 1151, in dispatch
response.set_data(self.callback_map[output]'callback')
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/dash/dash.py", line 1037, in add_context
output_value = func(*args, **kwargs)
File "webapp.py", line 762, in createWebPageCallback
os.path.join(projectDirectory, "tierGuide.yaml"))
File "webapp.py", line 1031, in createWebPage
return(text.toHTML())
File "/Users/David/OpenSource/github/slexil/text.py", line 143, in toHTML
line.parse()
File "/Users/David/OpenSource/github/slexil/ijalLine.py", line 61, in parse
self.calculateMorphemeSpacing()
File "/Users/David/OpenSource/github/slexil/ijalLine.py", line 203, in calculateMorphemeSpacing
raise Exception((morphemes,glosses)) from e
Exception: (['que', '∅–ʔa¢i=pɨʔ=ʔiṣ̌=tam=koʔ', 'que', 'heʔ', 'pɨn', 'y–¢am–hay–¢o¢–wɨ', 'y–yomo', 'que', 'ʔuy¢i', 'ʔak–toko–¢ɨk–i', 'mok', 'porque'], ['SUBORD', '3S–uncle=REL=ERG=PL=then', 'SUBORD', 'DEF', 'hombre', '3A–tell–APPL–begin–CMP', '3PSR–woman', 'SUBORD', 'NEG.IMP', '', 'CAUS–go.bad–do–DEP1', 'corn', 'because'])

This is where exceptions are very useful.  They get thrown down deep, and when using a custom exception, you are free to add all the detail you know to that custom exception.  Then you catch the bouquet exception up high, in the ui, displaying all of that detal for the user's edification.
google "python custom exception" should give you a good start.

Paul

On May 12, 2019, at 8:52 AM, David Beck<EMAIL_ADDRESS>wrote:
Hi, Paul
So, I have found an .eaf file with an error in it, a mismatch between the number of tabbed words in the morpheme line and the number in the morphemeGlosses line. It would be nice to be able to tell the author exactly where and what the error is—is there some way to percolate that information up from IjalLine to the webapp so I can show it on the page?
David
eafFileName: PROJECTS/Inferno/JIT0006_ori.eaf
projectDirectory: PROJECTS/Inferno
audioDirectoryRelativePath: audio
grammaticalTermsFile: None
tierGuideFile: PROJECTS/Inferno/tierGuide.yaml
ijal.css
[2019-05-12 09:42:13,309] ERROR in app: Exception on /_dash-update-component [POST]
Traceback (most recent call last):
File "/Users/David/OpenSource/github/slexil/ijalLine.py", line 201, in calculateMorphemeSpacing
assert(len(morphemes) == len(glosses))
AssertionError
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/flask/app.py", line 2292, in wsgi_app
response = self.full_dispatch_request()
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/flask/app.py", line 1815, in full_dispatch_request
rv = self.handle_user_exception(e)
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/flask/app.py", line 1718, in handle_user_exception
reraise(exc_type, exc_value, tb)
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/flask/_compat.py", line 35, in reraise
raise value
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/flask/app.py", line 1813, in full_dispatch_request
rv = self.dispatch_request()
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/flask/app.py", line 1799, in dispatch_request
return self.view_functionsrule.endpoint
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/dash/dash.py", line 1151, in dispatch
response.set_data(self.callback_map[output]'callback')
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/dash/dash.py", line 1037, in add_context
output_value = func(*args, **kwargs)
File "webapp.py", line 762, in createWebPageCallback
os.path.join(projectDirectory, "tierGuide.yaml"))
File "webapp.py", line 1031, in createWebPage
return(text.toHTML())
File "/Users/David/OpenSource/github/slexil/text.py", line 143, in toHTML
line.parse()
File "/Users/David/OpenSource/github/slexil/ijalLine.py", line 61, in parse
self.calculateMorphemeSpacing()
File "/Users/David/OpenSource/github/slexil/ijalLine.py", line 203, in calculateMorphemeSpacing
raise Exception((morphemes,glosses)) from e
Exception: (['que', '∅–ʔa¢i=pɨʔ=ʔiṣ̌=tam=koʔ', 'que', 'heʔ', 'pɨn', 'y–¢am–hay–¢o¢–wɨ', 'y–yomo', 'que', 'ʔuy¢i', 'ʔak–toko–¢ɨk–i', 'mok', 'porque'], ['SUBORD', '3S–uncle=REL=ERG=PL=then', 'SUBORD', 'DEF', 'hombre', '3A–tell–APPL–begin–CMP', '3PSR–woman', 'SUBORD', 'NEG.IMP', '', 'CAUS–go.bad–do–DEP1', 'corn', 'because'])
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.

Okay, I do know how to use exceptions, but I was under the impression that they were more local than that. If they don’t have to go back up the chain of methods via some kind of return function, then this should be easy to take care of. (Famous last words.)
Good thing, too, I’ve found this kind of mismatch error in 2/4 files I’ve tested so far.
Thanks!
David

On May 12, 2019, at 11:21 AM, Paul Shannon<EMAIL_ADDRESS>wrote:
This is where exceptions are very useful. They get thrown down deep, and when using a custom exception, you are free to add all the detail you know to that custom exception. Then you catch the bouquet exception up high, in the ui, displaying all of that detal for the user's edification.
google "python custom exception" should give you a good start.

Paul

On May 12, 2019, at 8:52 AM, David Beck<EMAIL_ADDRESS>wrote:
Hi, Paul
So, I have found an .eaf file with an error in it, a mismatch between the number of tabbed words in the morpheme line and the number in the morphemeGlosses line. It would be nice to be able to tell the author exactly where and what the error is—is there some way to percolate that information up from IjalLine to the webapp so I can show it on the page?
David
eafFileName: PROJECTS/Inferno/JIT0006_ori.eaf
projectDirectory: PROJECTS/Inferno
audioDirectoryRelativePath: audio
grammaticalTermsFile: None
tierGuideFile: PROJECTS/Inferno/tierGuide.yaml
ijal.css
[2019-05-12 09:42:13,309] ERROR in app: Exception on /_dash-update-component [POST]
Traceback (most recent call last):
File "/Users/David/OpenSource/github/slexil/ijalLine.py", line 201, in calculateMorphemeSpacing
assert(len(morphemes) == len(glosses))
AssertionError
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/flask/app.py", line 2292, in wsgi_app
response = self.full_dispatch_request()
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/flask/app.py", line 1815, in full_dispatch_request
rv = self.handle_user_exception(e)
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/flask/app.py", line 1718, in handle_user_exception
reraise(exc_type, exc_value, tb)
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/flask/_compat.py", line 35, in reraise
raise value
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/flask/app.py", line 1813, in full_dispatch_request
rv = self.dispatch_request()
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/flask/app.py", line 1799, in dispatch_request
return self.view_functionsrule.endpoint
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/dash/dash.py", line 1151, in dispatch
response.set_data(self.callback_map[output]'callback')
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/dash/dash.py", line 1037, in add_context
output_value = func(*args, **kwargs)
File "webapp.py", line 762, in createWebPageCallback
os.path.join(projectDirectory, "tierGuide.yaml"))
File "webapp.py", line 1031, in createWebPage
return(text.toHTML())
File "/Users/David/OpenSource/github/slexil/text.py", line 143, in toHTML
line.parse()
File "/Users/David/OpenSource/github/slexil/ijalLine.py", line 61, in parse
self.calculateMorphemeSpacing()
File "/Users/David/OpenSource/github/slexil/ijalLine.py", line 203, in calculateMorphemeSpacing
raise Exception((morphemes,glosses)) from e
Exception: (['que', '∅–ʔa¢i=pɨʔ=ʔiṣ̌=tam=koʔ', 'que', 'heʔ', 'pɨn', 'y–¢am–hay–¢o¢–wɨ', 'y–yomo', 'que', 'ʔuy¢i', 'ʔak–toko–¢ɨk–i', 'mok', 'porque'], ['SUBORD', '3S–uncle=REL=ERG=PL=then', 'SUBORD', 'DEF', 'hombre', '3A–tell–APPL–begin–CMP', '3PSR–woman', 'SUBORD', 'NEG.IMP', '', 'CAUS–go.bad–do–DEP1', 'corn', 'because'])
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub https://github.com/paul-shannon/slexil/issues/32#issuecomment-491613310, or mute the thread https://github.com/notifications/unsubscribe-auth/AKN4HBVPXHII4DT2HA2CMOLPVBGZRANCNFSM4HMKVEGQ.


File based user configuration

I'd like to suggest seeding pre-populated users through a config file.
This is particularly useful when habilitating CN authentication (even more when we're able to create user without passwords https://github.com/coreos/etcd/issues/9590).
So we wouldn't have to mess with the API.
Currently, when I need to create some users. The process looks like this:
echo rootpasswd | etcdctl user add root --interactive false

etcdctl auth enable

gen_passwd | etcdctl --user root:rootpasswd --interactive false user add kubernetes
etcdctl --user root:rootpasswd user grant-role kubernetes-role root
etcdctl --user root:rootpasswd role grant-permission kubernetes-role --prefix=true readwrite /registry/

gen_passwd | etcdctl --user root:rootpasswd --interactive false user add calico
etcdctl --user root:rootpasswd user grant-role calico-role root
etcdctl --user root:rootpasswd role grant-permission calico-role --prefix=true readwrite /calico/

The file based configuration could look something like this and could be passed as an init flag --user-config $FILE:
users:
- name: root
  password: rootpasswd
- name: kubernetes
  role: kubernetes-role
- name: calico
  role: calico-role
roles:
- name: calico-role
  access: readwrite
  prefix: /calico/
- name: kubernetes-role
  access: readwrite
  prefix: /registry/

good suggestion.
but passwords need to be stored as encrypted

ref: https://github.com/coreos/etcd/issues/9581


removing job-scheduler zip and replacign with distribution build

Signed-off-by: Amit Galitzky<EMAIL_ADDRESS>Description
Remove job-scheduler zip and instead download distribution from ci.opensearch.org and using that for running integCluster. This will later be replaced with a maven download when zips are uploaded to maven.
Issues Resolved
#17
Check List

[x] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Codecov Report

Merging #487 (5160344) into main (0c191c0) will increase coverage by 0.14%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##               main     #487      +/-   ##
============================================
+ Coverage     77.96%   78.11%   +0.14%
- Complexity     4145     4156      +11
============================================
  Files           296      296
  Lines         17652    17652
  Branches       1877     1877
============================================
+ Hits          13762    13788      +26
+ Misses         2995     2967      -28
- Partials        895      897       +2

Flag
Coverage Δ

plugin
78.11% <ø> (+0.14%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

...ain/java/org/opensearch/ad/model/ModelProfile.java
70.90% <0.00%> (ø)

...rch/ad/transport/AnomalyResultTransportAction.java
80.13% <0.00%> (ø)

...ansport/handler/AnomalyResultBulkIndexHandler.java
70.96% <0.00%> (+3.22%)
:arrow_up:

...va/org/opensearch/ad/feature/SearchFeatureDao.java
86.64% <0.00%> (+3.85%)
:arrow_up:

...c/main/java/org/opensearch/ad/util/ParseUtils.java
77.77% <0.00%> (+3.94%)
:arrow_up:


Possible rename symbol ?

Hi
Thank you for plugin , but I have questions
Possible rename symbol use JSON data ?

@napathello you may want to see #94... long story short is yes via layer names/content but not via overrides. There's an example in the demo.sketch file.


Add default home config

The home config could reside in ~/.omnifmt.yaml.

After #41 this will effectively be done as it will just fall back to using it.


Your Pull Requests includes issues

Pull Requests Issues
I've forked your repo (congrats on your project) and implemented a code review tool to check a few pull requests and found a couple issues in seconds.
This maybe useful for your project. Free for open source!
(mind that you and your contributors can see comments on code reviews directly inside your GitHub Pull requests!)
Disclaimer: I work at Codacy and I'm trying to get closer to this amazing open source community!
If you find this useful, would you be kind enough to use our Codacy Badge on your repo? Let me know if you need any help.
Cool Repos that are using Codacy:

https://github.com/cabaletta/baritone
https://github.com/faruktoptas/FancyShowCaseView
https://github.com/nlohmann/json
https://github.com/igorwojda/android-showcase
https://github.com/alfianandaa/projectbish

Thank you @Gsandec ! We'll give a try.
Btw, no need to scan dev-tests, it's just development tests for checking the output of plugins. ;)


fix documentation url

Codecov Report

Merging #2 into master will decrease coverage by 3.03%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master       #2      +/-   ##
==========================================
- Coverage   43.98%   40.95%   -3.04%
==========================================
  Files           9        8       -1
  Lines         607      525      -82
==========================================
- Hits          267      215      -52
+ Misses        340      310      -30

Impacted Files
Coverage Δ

ngage/__init__.py

ngage/plugins/__init__.py
100% <0%> (+36.58%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 74f9016...61597f2. Read the comment docs.

@mszabo Thanks!


JSI Frame Processors (iOS)

Update (3.5.2021)
Frame Processors are ready for iOS 🎉. Here's what actually happened:

I had to create a custom AVCaptureVideoDataOutput delegate which uses a custom AVAssetWriter to write the video files (turned out quite complex!), since you cannot use the AVCaptureMovieFileOutput and a AVCaptureVideoDataOutput (for frame processing) delegate at the same time.
I had to create a custom AVCaptureAudioDataOutput delegate which uses a custom AVAssetWriter for the same reason as above
I had to figure out how Swift <-> (Objective-)C++ communication worked
I had to figure out how Reanimated implemented worklets.
I have created numerous PRs at the react-native-reanimated repo to fix a few threading issues, increase performance of worklets, and touched almost all files to extract the "workletization API" to make it re-usable for other libraries (VisionCamera) (#1768, #1859, #1860, #1861, #1863, #1883, #1984)
I created react-native-multithreading to experiment with the workletization API I extracted from react-native-reanimated in #1861
I spawned a separate JS-Runtime which uses the Reanimated workletization API to workletize frame processors and runs them.
I added a plugin API which uses Objective-C macros to "inject" functions into the VisionCamera JS-Runtime.
I added the possibility to use return values and parameters for the Plugins, which requires conversion between Objective-C types and JS types (jsi::Value)
I added Swift support for the Plugin API
I tweaked reanimated's babel plugin to allow passing custom globals (= frame processor plugins), PR yet to be merged.
I spent a few nights debugging threading issues (EXC_BAD_ACCESS errors), and submitted a PR to reanimated to fix those.
I wrote comprehensive documentation for frame processors, the plugin API and a step by step guide on how you can create your own plugins.

Right now I have compared RAM and CPU usage between current main (https://github.com/cuvent/react-native-vision-camera/commit/ae1dde1993af201e5c81124fb3d917dd70e93763) and current frame-processor branch, and noticed that with the custom AVCaptureVideoDataOutput delegate the memory usage has increased from 58 MB to 187 MB (even with all the frame-processor code removed). That's a very high increase in memory which is currently blocking me from merging this thing. I have tried debugging this to find out where it comes from, but couldn't figure it out (yet). I've posted this to stackoverflow for now: https://stackoverflow.com/q/67370456/5281431 - if anyone has an idea, lmk
If you want, you can already write frame processor plugins. They're fairly easy to write, as you're probably just using some API anyways, and you just have to forward those calls then.
As for Android, I'll do that in a separate PR. I'll wait for #1960 and #1879 to be merged before, since those PRs change a lot of reanimated's Android infra.
Original comment:
Frame Processors
Implements "frame processors".
Frame Processors are functions created in JS that can be used to process frames from the Camera.
They will be called for each frame the camera sees, and can analyse the current frame using simple JS code. They can call other JS functions, but those have to be workletized (achieved with Reanimated).
Example use-cases include (but are not limited to-):

Scan QR codes in realtime
Scan and Translate text in realtime
Use facial recognition APIs
Basically any AI stuff (Tensorflow, OpenCV)
Send frames over the network (realtime video chat, FaceTime)
Draw over the camera, e.g. QR code box (idea WIP)
Draw filters on the camera, e.g. depth-filters, Snapchat dog filter (idea WIP)

Other functions (such as AI stuff) have to be either workletized, or implemented natively using JSI (C++).
In other words, they're just like Reanimated worklets, but on a separate JS-Runtime specifically created for the Camera (can be explained as some sort of JS multithreading)
const frameProcessor = useFrameProcessor((frame: Frame) => {
  const qrCodes = QRCodeAPI.scanCodes(frame)
  // TODO: draw box around QR code coordinates
}, []);

return <Camera frameProcessor={frameProcessor} />

Notes

Frame processors must be called synchronously from the Camera thread to avoid thread hopping
JS code must be workletized (e.g. external variables must be copied over into the new runtime) using REA
Functions that have a C++ implementation (using JSI) can easily be used without workletization.
You can assign to reanimated SharedValues (e.g. for updating a QR code's frame which will be displayed), but unlike reanimated worklets, the frame processor will not be called when a SharedValue changes (it's not a mapper.). I still have to make sure all thread-checkers are correctly set up for this, see my PR https://github.com/software-mansion/react-native-reanimated/pull/1883.
Other libraries can provide react-native-vision-camera plugins which are basically just functions that operate on a frame. Those can be implemented in JS or C++. (e.g. QR Code detection, AI like Tensorflow or MLKit, etc)

Frame
The Frame object should represent a single frame from the camera. I'm not entirely sure yet what properties this frame will have, but ideally I want to support:

pixels. An array of pixels this camera sees. This should be in the size of the Preview View, not some huge format like 4k because that would result in each frame object having like 25MB of space. You can read pixels like an array: frame.pixels[0] -> { r: number, g: number, b: number } - I am not sure how this will work on the platforms since they don't stream in RGB but rather YUV (Android) or some other color space (iOS).
depth. An array of depth information for each pixel. Not sure if I can embed that into the pixels array or have it separately. We'll see.

Base Plugins
Since at release there are no cool & easy to use frame processor plugins available, I thought of creating base plugins that are always supported. Either in this lib or in a separate package/repo.

QR Code detection: Detects QR codes in a Frame.

Maybe I can also use iOS/Android specific APIs for faster execution speed, e.g. Metal or iOS AI tools.
Implementation

Create C++/JSI base. Link C++ files to Android/iOS.
Create HostObject for the Camera that "installs" the JSI bindings, in our case something like "setFrameProcessorForCamera(viewTag: number, frameProcessor: FrameProcessor)"
In that function, workletize the frameProcessor parameter on a separate thread using a Reanimated API. See: https://github.com/software-mansion/react-native-reanimated/pull/1561
Once workletized, call into the Swift/Kotlin Camera APIs to pass them the newly created worklet.
The native Camera APIs should then notice that a frame processor is available, install a metadata/image analyzer, and call into that jsi::Function.
Call that JSI function from the Camera.ts view where the result gets memoized.

Swift <-> C++
Since the library is written in Swift, we need a way to interop with JSI (written in C++).
I've found the following solutions:

Write a custom .cpp wrapper, which manually wraps the calls I need in an extern "C" block so I can call it from Swift. I have to be careful with UnsafePointer<T> and deallocating the objects, since that is not done automatically (no ARC)
Use scapix bridge for automatic bridge code-generation between Swift and C++.

I really wish Swift had direct C++ interop. This incompatibility is making this whole thing really really hard.
Tasks
Following is already done:

[x] Copy over needed headers and code from Karol's "multithreading with worklets" PR
[x] Create Objective-C++ bindings to JSI
[x] Import ObjC++ header and install bindings for JSI from Swift codebase
[x] Create new JSI runtime
[x] Attach to VideoOutputDelegate in Swift CameraView (actually capture frames)
[x] Import NativeReanimatedModule (~roadblock: https://github.com/CocoaPods/CocoaPods/issues/10472~)
[x] Get NativeReanimatedModule instance to call makeShareable ("workletize") (roadblock: No idea how to get a TurboModule outside of a TurboModule context.)
[x] Find a suitable format for the captured output. jsi::HostObject with custom accessors, group bytes in color format?
[x] Call JSI function with captured output data (jsi::HostObject)
[x] Add a solution for third party libraries to register their frame processor plugins
[ ] Do the same things for Android

Testing
Since this PR required a few refactors and restructures of the react-native-reanimated library, I have created a PR over there: https://github.com/software-mansion/react-native-reanimated/pull/1790. Because that PR is not merged yet, you have to have those changes locally - either install react-native-reanimated directly from that GitHub branch, or install it normally through npm (2.0.0), download the repo from my PR's branch, and drag the ios and Common files from my PR into your react-native-vision-camera/example/node_modules/react-native-reanimated folder.
Android and .aars
Android is a bit more complicated than iOS because react-native-reanimated is not distributed from Source. I will have to play around with CMake to try and get the react-native-reanimated.aar file (that lives on the end-user's machine) embedded into my library, no idea if that's even possible.
Maybe useful links:

Babylon's CMakeLists
Babylon's build.gradle

I'm having trouble calling the Swift function from the Objective-C++ file. :(
Apparently CocoaPods renames the ObjC Generated Interface Header Name from VisionCamera-Swift.h to react_native_vision_camera-Swift.h, and I can't import that without build errors.
Mission: I want to call a Swift function (actually just use the CameraView type) in this line.
If anyone has an idea, please let me know as this is blocking me a lil bit

this is awesome.
I don't have time to contribute at the moment, but I wanted to drop in here and cheer you on 🙌

🙃🙃🙃

🚀🎉 Got it running successfully:
https://user-images.githubusercontent.com/15199031/110769814-e2e01000-8258-11eb-94c7-4ff4c1990077.mov

This is exciting. Seems like a good abstraction of worklets in general.

My PR at reanimated was finally merged!: https://github.com/software-mansion/react-native-reanimated/commit/815847eea25576b28aa0f4d20d38d2e84d7c3814

Update: Frame Processors are ready for iOS 🎉. Here's what actually happened:

I had to create a custom AVCaptureVideoDataOutput delegate which uses a custom AVAssetWriter to write the video files (turned out quite complex!), since you cannot use the AVCaptureMovieFileOutput and a AVCaptureVideoDataOutput (for frame processing) delegate at the same time.
I had to create a custom AVCaptureAudioDataOutput delegate which uses a custom AVAssetWriter for the same reason as above
I had to figure out how Swift <-> (Objective-)C++ communication worked
I had to figure out how Reanimated implemented worklets.
I have created numerous PRs at the react-native-reanimated repo to fix a few threading issues, increase performance of worklets, and touched almost all files to extract the "workletization API" to make it re-usable for other libraries (VisionCamera) (#1768, #1859, #1860, #1861, #1863, #1883, #1984)
I created react-native-multithreading to experiment with the workletization API I extracted from react-native-reanimated in #1861
I spawned a separate JS-Runtime which uses the Reanimated workletization API to workletize frame processors and runs them.
I added a plugin API which uses Objective-C macros to "inject" functions into the VisionCamera JS-Runtime.
I added the possibility to use return values and parameters for the Plugins, which requires conversion between Objective-C types and JS types (jsi::Value)
I added Swift support for the Plugin API
I tweaked reanimated's babel plugin to allow passing custom globals (= frame processor plugins), PR yet to be merged.
I spent a few nights debugging threading issues (EXC_BAD_ACCESS errors), and submitted a PR to reanimated to fix those.
I wrote comprehensive documentation for frame processors, the plugin API and a step by step guide on how you can create your own plugins.

Right now I have compared RAM and CPU usage between current main (https://github.com/cuvent/react-native-vision-camera/commit/ae1dde1993af201e5c81124fb3d917dd70e93763) and current frame-processor branch, and noticed that with the custom AVCaptureVideoDataOutput delegate the memory usage has increased from 58 MB to 187 MB (even with all the frame-processor code removed). That's a very high increase in memory which is currently blocking me from merging this thing. I have tried debugging this to find out where it comes from, but couldn't figure it out (yet). I've posted this to stackoverflow for now: https://stackoverflow.com/q/67370456/5281431 - if anyone has an idea, lmk
If you want, you can already write frame processor plugins. They're fairly easy to write, as you're probably just using some API anyways, and you just have to forward those calls then.
As for Android, I'll do that in a separate PR. I'll wait for #1960 and #1879 to be merged before, since those PRs change a lot of reanimated's Android infra.

Thanks for your amazing work 🎉


Sui ECDSA

I can see that the SUI Derivation path is: m/44'/784'/0'/0'/0', so it means it is Ed25519
Does WC also support ECDSA Secp256k1, Derivation path  m/54'/784'/0'/0'/0'?
https://docs.sui.io/concepts/cryptography/transaction-auth/keys-addresses

Hi @enriquesouza, we do not support secp256k1 and secp256p1 schemes for SUI blockchain yet

Hi @enriquesouza, we do not support secp256k1 and secp256p1 schemes for SUI blockchain yet

Thank you


YARN-11450. Improvements for TestYarnConfigurationFields and TestConfigurationFieldsBase

…onfigurationFields
Description of PR
How was this patch tested?
For code changes:

[ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
[ ] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
[ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
[ ] If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 52s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+0 :ok:
detsecrets
0m  1s

detect-secrets was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 2 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
40m 47s

trunk passed

+1 :green_heart:
compile
25m 21s

trunk passed with JDK Ubuntu-11.0.18+10-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
compile
21m 59s

trunk passed with JDK Private Build-1.8.0_362-8u362-ga-0ubuntu1~20.04.1-b09

+1 :green_heart:
checkstyle
1m  6s

trunk passed

+1 :green_heart:
mvnsite
1m 39s

trunk passed

+1 :green_heart:
javadoc
1m 10s

trunk passed with JDK Ubuntu-11.0.18+10-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javadoc
0m 42s

trunk passed with JDK Private Build-1.8.0_362-8u362-ga-0ubuntu1~20.04.1-b09

+1 :green_heart:
spotbugs
2m 46s

trunk passed

+1 :green_heart:
shadedclient
25m 13s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
1m  1s

the patch passed

+1 :green_heart:
compile
24m 37s

the patch passed with JDK Ubuntu-11.0.18+10-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javac
24m 37s

the patch passed

+1 :green_heart:
compile
21m 52s

the patch passed with JDK Private Build-1.8.0_362-8u362-ga-0ubuntu1~20.04.1-b09

+1 :green_heart:
javac
21m 52s

the patch passed

-1 :x:
blanks
0m  0s
/blanks-eol.txt
The patch has 2 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply

-0 :warning:
checkstyle
0m 59s
/results-checkstyle-hadoop-common-project_hadoop-common.txt
hadoop-common-project/hadoop-common: The patch generated 2 new + 8 unchanged - 39 fixed = 10 total (was 47)

+1 :green_heart:
mvnsite
1m 37s

the patch passed

+1 :green_heart:
javadoc
0m 59s

the patch passed with JDK Ubuntu-11.0.18+10-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javadoc
0m 42s

the patch passed with JDK Private Build-1.8.0_362-8u362-ga-0ubuntu1~20.04.1-b09

+1 :green_heart:
spotbugs
2m 41s

the patch passed

+1 :green_heart:
shadedclient
25m 23s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
19m  3s

hadoop-common in the patch passed.

-1 :x:
asflicense
0m 53s
/results-asflicense.txt
The patch generated 1 ASF License warnings.

220m 54s

Subsystem
Report/Notes

Docker
ClientAPI=1.42 ServerAPI=1.42 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5455/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5455

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets

uname
Linux 2bc7b03627cb 4.15.0-197-generic #208-Ubuntu SMP Tue Nov 1 17:23:37 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 1d164d75c934ec75a2b7ffbea239357e2f5b5744

Default Java
Private Build-1.8.0_362-8u362-ga-0ubuntu1~20.04.1-b09

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.18+10-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u362-ga-0ubuntu1~20.04.1-b09

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5455/1/testReport/

Max. process+thread count
3096 (vs. ulimit of 5500)

modules
C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5455/1/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 50s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+0 :ok:
detsecrets
0m  1s

detect-secrets was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 2 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
40m 48s

trunk passed

+1 :green_heart:
compile
25m 17s

trunk passed with JDK Ubuntu-11.0.18+10-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
compile
21m 44s

trunk passed with JDK Private Build-1.8.0_362-8u362-ga-0ubuntu1~20.04.1-b09

+1 :green_heart:
checkstyle
1m  5s

trunk passed

+1 :green_heart:
mvnsite
1m 40s

trunk passed

+1 :green_heart:
javadoc
1m 10s

trunk passed with JDK Ubuntu-11.0.18+10-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javadoc
0m 42s

trunk passed with JDK Private Build-1.8.0_362-8u362-ga-0ubuntu1~20.04.1-b09

+1 :green_heart:
spotbugs
2m 43s

trunk passed

+1 :green_heart:
shadedclient
25m  1s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 59s

the patch passed

+1 :green_heart:
compile
24m 40s

the patch passed with JDK Ubuntu-11.0.18+10-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javac
24m 40s

the patch passed

+1 :green_heart:
compile
21m 43s

the patch passed with JDK Private Build-1.8.0_362-8u362-ga-0ubuntu1~20.04.1-b09

+1 :green_heart:
javac
21m 43s

the patch passed

-1 :x:
blanks
0m  0s
/blanks-eol.txt
The patch has 2 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply

-0 :warning:
checkstyle
0m 59s
/results-checkstyle-hadoop-common-project_hadoop-common.txt
hadoop-common-project/hadoop-common: The patch generated 4 new + 8 unchanged - 39 fixed = 12 total (was 47)

+1 :green_heart:
mvnsite
1m 40s

the patch passed

+1 :green_heart:
javadoc
0m 59s

the patch passed with JDK Ubuntu-11.0.18+10-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javadoc
0m 43s

the patch passed with JDK Private Build-1.8.0_362-8u362-ga-0ubuntu1~20.04.1-b09

+1 :green_heart:
spotbugs
2m 41s

the patch passed

+1 :green_heart:
shadedclient
24m 53s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
18m  9s

hadoop-common in the patch passed.

-1 :x:
asflicense
0m 53s
/results-asflicense.txt
The patch generated 1 ASF License warnings.

219m  4s

Subsystem
Report/Notes

Docker
ClientAPI=1.42 ServerAPI=1.42 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5455/2/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5455

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets

uname
Linux 29a19c725a7f 4.15.0-197-generic #208-Ubuntu SMP Tue Nov 1 17:23:37 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 311f25ae70e8ec3e7b859d2f8d546870987fb616

Default Java
Private Build-1.8.0_362-8u362-ga-0ubuntu1~20.04.1-b09

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.18+10-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u362-ga-0ubuntu1~20.04.1-b09

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5455/2/testReport/

Max. process+thread count
1445 (vs. ulimit of 5500)

modules
C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5455/2/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 58s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 2 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
40m 39s

trunk passed

+1 :green_heart:
compile
23m  1s

trunk passed with JDK Ubuntu-11.0.18+10-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
compile
20m 30s

trunk passed with JDK Private Build-1.8.0_362-8u362-ga-0ubuntu1~20.04.1-b09

+1 :green_heart:
checkstyle
1m 13s

trunk passed

+1 :green_heart:
mvnsite
1m 44s

trunk passed

+1 :green_heart:
javadoc
1m 17s

trunk passed with JDK Ubuntu-11.0.18+10-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javadoc
0m 51s

trunk passed with JDK Private Build-1.8.0_362-8u362-ga-0ubuntu1~20.04.1-b09

+1 :green_heart:
spotbugs
2m 43s

trunk passed

+1 :green_heart:
shadedclient
22m 32s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 58s

the patch passed

+1 :green_heart:
compile
22m 28s

the patch passed with JDK Ubuntu-11.0.18+10-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javac
22m 28s

the patch passed

+1 :green_heart:
compile
20m 41s

the patch passed with JDK Private Build-1.8.0_362-8u362-ga-0ubuntu1~20.04.1-b09

+1 :green_heart:
javac
20m 41s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

-0 :warning:
checkstyle
1m  8s
/results-checkstyle-hadoop-common-project_hadoop-common.txt
hadoop-common-project/hadoop-common: The patch generated 1 new + 8 unchanged - 39 fixed = 9 total (was 47)

+1 :green_heart:
mvnsite
1m 42s

the patch passed

+1 :green_heart:
javadoc
1m  7s

the patch passed with JDK Ubuntu-11.0.18+10-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javadoc
0m 51s

the patch passed with JDK Private Build-1.8.0_362-8u362-ga-0ubuntu1~20.04.1-b09

+1 :green_heart:
spotbugs
2m 40s

the patch passed

+1 :green_heart:
shadedclient
22m 41s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
18m 45s

hadoop-common in the patch passed.

+1 :green_heart:
asflicense
1m  2s

The patch does not generate ASF License warnings.

211m  1s

Subsystem
Report/Notes

Docker
ClientAPI=1.42 ServerAPI=1.42 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5455/3/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5455

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets

uname
Linux f95b70e8d4b1 4.15.0-206-generic #217-Ubuntu SMP Fri Feb 3 19:10:13 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / a3d8511004f57be4f93f67ca62274a0dc6ee6462

Default Java
Private Build-1.8.0_362-8u362-ga-0ubuntu1~20.04.1-b09

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.18+10-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u362-ga-0ubuntu1~20.04.1-b09

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5455/3/testReport/

Max. process+thread count
3149 (vs. ulimit of 5500)

modules
C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5455/3/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.


Fix #107: Switch torch asserts

This PR fixes issues #107.
I have replaced all the assert utils.check_equal_torch with assert_allclose

@rsdel2007 please make sure all test pass so that we can merge

@rsdel2007 could you fix the test errors so that we can merge ?

closing https://github.com/arraiyopensource/kornia/issues/107


Does not precompile

I can add JuliaFEM, but when I am using JuliaFEM I get the following error.
Cheers!
[ Info: Precompiling JuliaFEM [f80590ac-b429-510a-8a99-e7c46989f22d]
ERROR: LoadError: LoadError: Evaluation into the closed module `Calculus` breaks incremental compilation because the side effects will not be permanent. This is likely due to some other module mutating `Calculus` with `eval` during precompilation - don't do this.
Stacktrace:
 [1] eval at ./boot.jl:331 [inlined]
 [2] simplify(::Expr) at /users/akgray/.julia/packages/Calculus/mbqhh/src/symbolic.jl:96
 [3] calculate_interpolation_polynomials(::Expr, ::Array{Float64,2}) at /users/akgray/.julia/packages/FEMBasis/hrK6J/src/create_basis.jl:25
 [4] create_basis(::Symbol, ::String, ::Tuple{Tuple{Float64},Tuple{Float64}}, ::Expr) at /users/akgray/.julia/packages/FEMBasis/hrK6J/src/create_basis.jl:48
 [5] top-level scope at /users/akgray/.julia/packages/FEMBasis/hrK6J/src/lagrange_segments.jl:4
 [6] include(::Function, ::Module, ::String) at ./Base.jl:380
 [7] include at ./Base.jl:368 [inlined]
 [8] include(::String) at /users/akgray/.julia/packages/FEMBasis/hrK6J/src/FEMBasis.jl:4
 [9] top-level scope at /users/akgray/.julia/packages/FEMBasis/hrK6J/src/FEMBasis.jl:16
 [10] include(::Function, ::Module, ::String) at ./Base.jl:380
 [11] include(::Module, ::String) at ./Base.jl:368
 [12] top-level scope at none:2
 [13] eval at ./boot.jl:331 [inlined]
 [14] eval(::Expr) at ./client.jl:467
 [15] top-level scope at ./none:3
in expression starting at /users/akgray/.julia/packages/FEMBasis/hrK6J/src/lagrange_segments.jl:4
in expression starting at /users/akgray/.julia/packages/FEMBasis/hrK6J/src/FEMBasis.jl:16
ERROR: LoadError: Failed to precompile FEMBasis [353fb843-c566-51e6-ba49-78b3e3d5ebb5] to /users/akgray/.julia/compiled/v1.5/FEMBasis/x3cNT_grSpN.ji.
Stacktrace:
 [1] error(::String) at ./error.jl:33
 [2] compilecache(::Base.PkgId, ::String) at ./loading.jl:1305
 [3] _require(::Base.PkgId) at ./loading.jl:1030
 [4] require(::Base.PkgId) at ./loading.jl:928
 [5] require(::Module, ::Symbol) at ./loading.jl:923
 [6] include(::Function, ::Module, ::String) at ./Base.jl:380
 [7] include(::Module, ::String) at ./Base.jl:368
 [8] top-level scope at none:2
 [9] eval at ./boot.jl:331 [inlined]
 [10] eval(::Expr) at ./client.jl:467
 [11] top-level scope at ./none:3
in expression starting at /users/akgray/.julia/packages/FEMBase/qGDOl/src/FEMBase.jl:19
ERROR: LoadError: Failed to precompile FEMBase [fbcbbc08-f1bf-5204-9233-b69f5d396135] to /users/akgray/.julia/compiled/v1.5/FEMBase/6HUoq_grSpN.ji.
Stacktrace:
 [1] error(::String) at ./error.jl:33
 [2] compilecache(::Base.PkgId, ::String) at ./loading.jl:1305
 [3] _require(::Base.PkgId) at ./loading.jl:1030
 [4] require(::Base.PkgId) at ./loading.jl:928
 [5] require(::Module, ::Symbol) at ./loading.jl:923
 [6] include(::Function, ::Module, ::String) at ./Base.jl:380
 [7] include(::Module, ::String) at ./Base.jl:368
 [8] top-level scope at none:2
 [9] eval at ./boot.jl:331 [inlined]
 [10] eval(::Expr) at ./client.jl:467
 [11] top-level scope at ./none:3
in expression starting at /users/akgray/.julia/packages/JuliaFEM/DbhTT/src/JuliaFEM.jl:111
ERROR: Failed to precompile JuliaFEM [f80590ac-b429-510a-8a99-e7c46989f22d] to /users/akgray/.julia/compiled/v1.5/JuliaFEM/JKouA_grSpN.ji.
Stacktrace:
 [1] error(::String) at ./error.jl:33
 [2] compilecache(::Base.PkgId, ::String) at ./loading.jl:1305
 [3] _require(::Base.PkgId) at ./loading.jl:1030
 [4] require(::Base.PkgId) at ./loading.jl:928
 [5] require(::Module, ::Symbol) at ./loading.jl:923

Yeah, we should get away from Calculus. The bug is coming from FEMBasis. I already prepared an alternative to do some simple symbolic differentiation, but haven't time to take it into use in FEMBasis yet.

Any progress? Do we have a work around?


feat: add autobumper for tichi

Part of #317
I want to test autobump by @rustin-bot first.

@Mini256 Can we test it first in presubmits job?
/hold
Needs docs.

@Mini256 Can we test it first in presubmits job?

Great, it seems that this test is more appropriate.

I want to test autobump by @rustin-bot first.

I think this not work, because the token of ti-chi-bot is used in the test pod.

@rustin-bot  Only used in dev.

/test pull-tichi-test-autobump

It's working. You can start by configuring it in configs for tichi.

It's working. You can start by configuring it in configs for tichi.

It looks like it will bring other commits. Is this normal?

It's working. You can start by configuring it in configs for tichi.

It looks like it will bring other commits. Is this normal?

I think this maybe because we use the presubmits job.

Great job!


Cheat Sheet Typo

Issue Description
There's a small typo in the Cheat Sheet page.
What
The word "identidier" is used a few times, in this section of the Cheat Sheet page. I think this should be "identifier".
Reproduce
https://github.com/onevcat/Kingfisher/wiki/Cheat-Sheet#use-processor-with-imagecache
Other Comment
Loving Kingfisher so far! Thanks!

Fixed. Thanks!


Correct RFC number

RFC 4180 is the one that describes CSV files.

Done! Sorry I didn't think to find and fix them all in one commit.

I think that's all of them now!

Thank you for the PR!


root and leaves with test_association()

Hi, this is a great package, thank you.
in the test_association documentation (https://scfates.readthedocs.io/en/latest/scFates.tl.test_association.html) it mentions there are optional root and leaves parameters to "restrain the test to a subset of the tree".
This looks like an association will be assessed for only the shortest root-to-tips path, is that correct?
When i try to use this I get an error:
e.g.
scf.tl.test_association(adata, leaves=[23,24], root=49)
>>>
`test_association() got an unexpected keyword argument 'leaves'`

When I inspect the source code for that function I can't see how one passes the root and leaves parameters either.
I can see there is a scf.tl.root() function to assign root, this seems like a good way to assign the root for ongoing analysis...but AFAICT there is no equiavlent function for leaves.
Any help would be gratefully received!

Hi @james-cranley,
root and leaves parameters have been removed from test_association, the API documentation was not properly updated unfortunately, sorry for the confusion.
As there is no easy way to figure out later on whether the results from test_association relate to the whole tree or a subset, function always run on the whole tree.
I would recommend to subset the tree before running test_association using scf.tl.subset_tree function, here is some information about how to use that function.

Thanks, Louis. I will try that route. Best, James.


Prevent a few unnecessary recompositions in Popup and DesktopMenu.

Proposed Changes

Prevent a few unnecessary recompositions by accessing remembered values in lambdas.
Switch DesktopMenuTests to runComposeUiTest.

This isn't a must-have PR.
I started working on it when I noticed that focusManager and inputModeManager in OpenDropdownMenu weren't remembered, but then I realized that I couldn't make a bug out of that because I don't think it's possible for OpenDropdownMenu to be recomposed without the Popup content also recomposing.
So I decided to pivot to slightly improving the code instead :-)


Is bee-queue for me?

I will need a heavy processing queue(thousands of jobs per second), no need to respond to the requestor.

The queue itself is extremely performance-focused and is certainly capable of handling thousands of jobs per second, especially if you have more than one worker. How many it can handle is pretty much a function of how fast your Redis is and how many workers you have. All the overhead of responding to the requestor can be removed by setting getEvents and sendEvents to false, and you can keep Redis memory from ballooning by setting removeOnSuccess to true.
One case where bee-queue might not be performance-optimal is if you ever have several jobs to enqueue at the same time from the same source; it'll make a separate Redis pipeline for each job enqueued, but could theoretically enqueue multiple jobs on one pipeline. If this would be useful, it's certainly not out of the question to add it.

Hmm, I think I didn't understand what you're saying about several jobs to enqueue at the same time from the same source. Do you mean the common use case where a producer sends at least a job per request always to the same queue?

I mean if, say, a request comes in to a producer, and it knows immediately that it wants to create not just one but 5 jobs as a result of that request. They're all being created effectively at the same time, but this would be done with 5 pipelines (and thus 5 roundtrips). It could theoretically be done with just one if there was some way to give bee-queue 5 jobs at once and have it send them together.
If you just send one job per request, it sounds like you line right up with the second of my target use cases outlined at the top of https://github.com/LewisJEllis/bee-queue/wiki/Origin, but if you might send multiple from one request, then there's this room for improvement. I'm not completely sure how much room, but there's room nonetheless. My guess is that if most of your jobs usually come in groups of ~4 or more, it could be a worthwhile improvement.

oh okay, that's not my case!

I'm just afraid the payload can be higher than 100kb sometimes

More than 100kb is not in and of itself necessarily a problem - it's kind of a guideline to avoid using too much memory on Redis. There are certainly scenarios where 100kB can be a reasonably payload, especially if only from time to time, but if it's regularly much more than that and you have high job throughput, you might risk running into a spike where Redis runs out of memory. Smaller payloads help avoid this, but if you're aware of the risk and have considered it, there's no major problem with bigger payloads.


previousSelection returned entire object vs ids

Fixes #1688
previousSelection was returning the entire node and edge objects rather than just an array of ids. This fixes it. I only tested it via modifying the vis-network.min.js file directly, but have translated it back to this format. Please check and improve as necessary. - I am brand new to javascript, so assume there are more efficient ways of extracting the ids.
value: function (g, A) {
    var t = !1,
        e = this._selectionAccumulator.commit(),
        C = {},
        nodes = [],
        edges = [];
    for (let i = 0; i < e.nodes.previous.length; i++ ){
        nodes.push(e.nodes.previous[i].id);
    };
    for (let i = 0; i < e.edges.previous.length; i++ ){
        edges.push(e.edges.previous[i].id);
    };
    C = {
        nodes: nodes,
        edges: edges
    };

The following might be neater:
Replace lines 18179 - 18182 in vis-network/esnext/esm/vis-network.js :
const previousSelection = {
      nodes: selectionChanges.nodes.previous,
      edges: selectionChanges.edges.previous,
    };

with
const previousSelection = {
    nodes: selectionChanges.nodes.previous.map(node => node.id),
    edges: selectionChanges.edges.previous.map(edge => edge.id),
  };


FittedRow does not ignore invisible items when doing layouts

https://studio.ensembleui.com/app/a2qNNXgcmhBxfrTMBVGB/screen/NOLnvltgCao7UVAXuVfU
here's my yaml -
            id: gridAllAccounts
            styles:
              horizontalTileCount: 1
              itemHeight: 50
              padding: 24
            item-template:
              data: ${plugGetAllAccounts.body.data.data.resolved.accounts}
              name: item
              template:
                Column:
                  styles:
                    gap: 16
                  children:
                    - FittedRow:
                        styles:
                          crossAxis: center
                          childrenFits:
                            - 1
                            - auto
                            - auto
                            - auto
                        children:
                          - Text:
                              label: Id
                              text: ${item.accountId}
                              styles:
                                visible: false
                          - Text:
                              label: Name
                              text: ${item.name}
                              styles:
                                visible: true
                          - Text:
                              label: Value
                              text: ${item.value}
                              styles:
                                visible: true
                          - Icon:
                              name: chevron_right

and the screenshot of the app. Platform must ignore the invisible items. Is there any other way to do this, I can't just remove the ID field.

I want the name to be left aligned and value and chevron to be right aligned

I can work around for now.


get_thread_id() implementation throws SIGILL on my ARM CPU

Hi, i've discovered that the implementation of get_thread_id() here https://github.com/mjansson/rpmalloc/blob/develop/rpmalloc/rpmalloc.c#L787-L818 doesn't appear to work on my hardware and I get SIGILL when using it:
# cat /proc/cpuinfo
Processor       : ARM926EJ-S rev 4 (v5l)
BogoMIPS        : 199.06
Features        : swp half thumb fastmult edsp java
CPU implementer : 0x41
CPU architecture: 5TEJ
CPU variant     : 0x0
CPU part        : 0x926
CPU revision    : 4

Using this implementation from another piece of software I get the following error, caught by GDB:
Program received signal SIGILL, Illegal instruction.
0x000f232c in tracy::get_thread_id() ()
(gdb)

And the offending asm appears to be:
0xf232c <_ZN5tracyL13get_thread_idEv+12>                mrc    15, 0, r3, cr13, cr0, {3}

Is it possible the problematic assembly isn't supported on my version of ARM?

Could you try changing the implementation of get_thread_id to return (uintptr_t)__builtin_thread_pointer(); instead and see if that compiles and work for your platform/arch?


GPU recognition

I changed my GPU and fastfetch didn't recognize it and display the old one.
neofetch
GPU: AMD ATI Radeon RX 6600/6600 XT/6600M

fastfetch
GPU: AMD ATI Radeon RX 550 640SP / RX 560/560X

fastfetch -v
fastfetch r407.588a68a

fastfetch --recache once

Danke, it works perfect.


Suffix tree: validation fails

Hi,
I have tested your implementation of the Suffix Tree data structure. The validation step fails when using:
SuffixTree st = new SuffixTree("GGACTACGATTTGTGTTCATATTAGTTCA".toCharArray());
st.build();
System.out.println(st.validate());

And the output is:
Mismatch found $ T
Failed validation
false

Do you know where is the problem?
Emilio

Let me look at it. Thanks for brining it up.
 On Tuesday, July 14, 2015 7:48 AM, ercoppa<EMAIL_ADDRESS>wrote:

Hi,I have tested your implementation of the Suffix Tree data structure. The validation step fails when using:
SuffixTree st = new SuffixTree("GGACTACGATTTGTGTTCATATTAGTTCA".toCharArray());
st.build();
System.out.println(st.validate());
And the output is:
Mismatch found $ T
Failed validation
false
Do you know where is the problem?Emilio—
Reply to this email directly or view it on GitHub.

fixed the bug.
https://github.com/mission-peace/interview/commit/02f0b6fc92143cb2dd61cf748efd629e10a7bdcb
Closing

Fixed some bugs.
https://github.com/mission-peace/interview/commit/02f0b6fc92143cb2dd61cf748efd629e10a7bdcb
Probably this will fix this bug as well.