Fix class loading strategy to no longer rely on sun.misc.Unsafe and several performance improvements

Updates to Byte Buddy 1.8.4.
Adds support for class loading under Java 11 after changing the default class loading strategy in Byte Buddy 1.8.4.
Make interception stateless to allow for better reuse of classes.

There are still a few test failures which seem related to filtering stack traces what might have changed after my recent alterations.

@raphw No significant performance changes after upgrading from 1.8.5 to 1.8.8 (in my tests at least).

Integrated thanks @raphw!

That is strange, @testn said he had executed the performance tests and noted a difference. I will keep on looking into how to improve performane of proxy creation in the future for such use cases. Thanks for helping out!

I tested SoftAssertionsPerfTest scenario and the time dropped  significantly. Which jdk do you use?

Java version: 1.8.0_161, vendor: Oracle Corporation

No significant changes after integrating https://github.com/joel-costigliola/assertj-core/pull/1233.
For the sake of testing, I ran SoftAssertionsPerfTest on 3.9.0 (in branch https://github.com/joel-costigliola/assertj-core/tree/perf-soft-proxy-3.9.0), it ran actually in ~2600ms.

Hmm interesting, I use 1.8.0_151 and it first started with around 9 seconds in 3.9.1 but down to 3-4 seconds in latest code for me.

I have a few more patches on byte-buddy side to reduce it down to < 4000 ms.

@testn thanks for all the time you spent on improving assertj and byte buddy the performance.


Travis-CI: add go_import_path

The go_import_path option of Travis-CI (see doc) allows to tell Travis-CI the path where the code should be cloned in $GOPATH.
This allows external contributors to use Travis-CI on their fork without incorrectly running the testsuite with the original import path instead of their modified code.

Pull Request Test Coverage Report for Build 36

0 of 0   changed or added relevant lines in 0 files are covered.
3019 unchanged lines in 38 files lost coverage.
Overall coverage decreased (-94.9%) to 3.992%

Files with Coverage Reduction
New Missed Lines
%

cmp_funcs_bool.go
8
0.0%

td_smugggler.go
9
0.0%

context.go
9
76.92%

td_ignore.go
10
0.0%

td_list.go
12
0.0%

td_zero.go
15
0.0%

location.go
16
20.0%

t_struct.go
17
0.0%

td_any.go
20
0.0%

td_bag.go
21
0.0%

Totals

Change from base Build 34:
-94.9%

Covered Lines:
127

Relevant Lines:
3181

💛  - Coveralls


various error cleanup

Description of changes
While working on writing tests for the FFI edits, I found I wanted to make some adjustments to the error messages. Then before I knew it, I had a bunch of changes in my local repo -- this PR contains a (harmless?) subset of them. My next PR will have more interesting changes, but requires this one to be merged first.

Added expect_err checks to some existing tests to better keep track of how error messages are displayed.
Added some new tests to cedar-policy/src/test.rs to check error behavior not covered by other tests (most tests are related to request validation & context creation).
Deleted JsonDeserializationError::ContextCreation since it was unused.
Deleted FromJsonError::PolicySet, FromJsonError::Linking, and impl TryFrom<PolicySet> for ast::PolicySet since they were unused & redundant with the cedar-policy definitions.
Changed the error type of typecheck_partial_value to be ExtensionFunctionLookupError, which is more specific than the previous error type GetSchemaTypeError.
Moved most of the content from the entities module from api.rs to api/err.rs so we can keep all the re-exported errors in one place.
Removed some indirection from the public ContextJsonError type. I noticed that we had a version of ContextCreationError in the public API, but were using the internal version under the hood in ContextJsonError, which was leading to inconsistent error messages with changes I was making for the followup PR mentioned above.
Minor fixes in error messages.

Issue #, if available
Checklist for requesting a review
The change in this PR is (choose one, and delete the other options):

[X] A change (breaking or otherwise) that only impacts unreleased or experimental code.

(Breaking changes are only in unreleased code, I think)
I confirm that this PR (choose one, and delete the other options):

[X] Does not update the CHANGELOG because my change does not significantly impact released code.

I confirm that cedar-spec (choose one, and delete the other options):

[X] Does not require updates because my change does not impact the Cedar formal model or DRT infrastructure.

By popular demand, I've moved the est::PolicySet parsing logic back to est/policy_set.rs. This ended up being more complicated than I expected since we need to maintain some invariants about the public PolicySet type. Careful review of the latest commit would be appreciated.


No permission to edit with Remote authentication

I could not find a way to edit a wiki with Remote authentication from a different hub. I'm using Forum - Mostly Public category.
If it is not possible, it should be explicitly documented.

Wiki edit possibility / permissions settings
Posting possibility / permissions settings

By default "wiki write" permissions are not automatically granted except for the 'repository' permission role. The original wiki write permission is granted to those that 'can upload/modify my channel storage and photos'. This means that any of your friends can delete any of your files/photos/wikis. We didn't feel this permission should be granted without your explicit knowledge/approval.
In 2.2 (which will be released any day now) you can assign a permission group to those you want to grant wiki write access and also provide a separate wiki write permission from your files and photos. Currently you must either use a custom permissions role or specifically edit the permissions of those connections you wish to have this ability.

Will it also be possible to grant wiki write access to any authenticated user, not just friends (public community scenario)?

Yes, but I think this will require using  a custom permission role. This doesn't fit very well in any of our "preset" permission roles. You can do this today, though the specific "write_wiki" permission is new to 2.2. There were a couple of late breaking bugs but 2.2 is still scheduled for official release in the next day or two.


[W-10150836] Replace email field label with apex field name

This pull request ensures the standard email field is excluded from translations associated to preferred email.
Issues Closed

W-10150836

Testing Notes

Test Results: Before
Test Results: After

Test scenarios updated:

T-4509341: Verify Preferred Email works as expected with a Custom Email Field

Manual test above to be automated in W-10244155.

We currently have a prettier check failure on the base branch. The team is collaborating with RelEng to resolve the issue (reference).


fix direction angle

It seem that there is some problem for the compass direction. I am trying to fix this.
The angle is come from FlutterCompass. The document of FlutterCompass said that "The heading varies from 0-360, 0 being north." Therefore, I have changed direction of MyDirectionPainter from downward to upward.
Also, Transform.rotate() gives the rotation in clockwise radians. To convert degree to radians, all we need is _direction / 180 * math.pi,.

Thanks @tlserver it was something we were struggling to find the cause of.


feat: add dev container

Signed-off-by: Chojan Shang<EMAIL_ADDRESS>I hereby agree to the terms of the CLA available at: https://databend.rs/dev/policies/cla/
Summary
Close: #925

with packages for --all-features, jdk libssl-dev
with useful tools like mold
with out node and maturin

The init hang on here:

And running cargo build will meet:
builder@codespaces-c7d3d1:/workspaces/opendal$ cargo build
    Updating crates.io index
warning: spurious network error (2 tries remaining): failed to create temporary file '/opt/rust/cargo/registry/index/github.com-1ecc6299db9ec823/.git/objects/pack/pack_git2_c95b667278ef086b': Permission denied; class=Os (2)
warning: spurious network error (1 tries remaining): failed to create temporary file '/opt/rust/cargo/registry/index/github.com-1ecc6299db9ec823/.git/objects/pack/pack_git2_d6c3737348f26a64': Permission denied; class=Os (2)
error: failed to get `anyhow` as a dependency of package `opendal v0.25.2 (/workspaces/opendal)`

Caused by:
  failed to load source for dependency `anyhow`

Caused by:
  Unable to update registry `crates-io`

Caused by:
  failed to fetch `https://github.com/rust-lang/crates.io-index`

Caused by:
  failed to create temporary file '/opt/rust/cargo/registry/index/github.com-1ecc6299db9ec823/.git/objects/pack/pack_git2_236d4573de3cb376': Permission denied; class=Os (2)
builder@codespaces-c7d3d1:/workspaces/opendal$ ^C

postCreateCommand is running inside container, maybe it's too late?

I did not encounter hangs and other strange errors, maybe you can try it again


⚠ Bofrost.de has degraded performance

In 963942e, Bofrost.de (https://www.bofrost.de) experienced degraded performance:

HTTP code: 200
Response time: 1514 ms

Resolved: Bofrost.de performance has improved in b4c7340 after 304 days, 2 hours, 6 minutes.


[Event Request] Application Tests-Bank, Codeunit 134268 "Payment Proposal UT 2"

[Event Request] Application Tests-Bank, Codeunit 134268 "Payment Proposal UT 2"

Could you please insert an OnTestInitialize at the beginning of the procedure Initialize?

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. We will update this issue with information about availability.

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. We will update this issue with information about availability.

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. We will update this issue with information about availability.

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. We will update this issue with information about availability.


Toast is declaring variables and not using them

toast.component.ts
'Inject' is declared but never used.
'Optional' is declared but never used.
I don't know if this is intentional, or not. Just to point it. Also, you might want to use Codelyzer with the proper rules.

thank's @michaeljota we will update it soon.

This errors are actually being threw by the compiler, no the linter. New configuration options are available in Typescript 2, this are: noUnusedParameters and noUnusedLocals. Because of this are set in my configuration, they are impeding me to build with this.
Can I make a PR commenting those out or removing them? Are they necessary?

@dharmeshpipariya Yeah, the error it's caused because the source file it's being distributed in the module, and it shouldn't. It's the only source file in the module, and if I delete it everything works out just fine.

@michaeljota we have already started work on it. you can get it in next release.


Add a new "Guide" plugin? (feature-request)

When the plugin is enabled, right-clicking on a quest or a diary or a skill would have an "open youtube guide" option
Concept: https://i.imgur.com/zyhYezz.png (made it in paint cause ps won't open)
Edit: Video could be played either through the runelite plugin or the user's default browser when this sign is clicked

Related #3038

I have made something that will link to the wiki page for most things in game. You can check it out here.

Duplicate of #3038 and #2038


Anyone knows how to install vtk?

I've got this message
Builder <class 'preview_generator.preview.builder.cad__vtk.ImagePreviewBuilderVtk'> is missing a dependency: this builder requires vtk to be available"
Even if I run pip install vtk
requirements.txt:
...
vtk==9.0.20210612.dev0
...

if you don't need vtk, you can safely ignore this message. Otherwise, you can install vtk from packages provided by your distribution.
@inkhey we might want to make this clear, these warnings can make it seem like something is missing for Preview-Generator to work correctly.

@inkhey we might want to make this clear, these warnings can make it seem like something is missing for Preview-Generator to work correctly.

There was already a ticket (https://github.com/algoo/preview-generator/issues/88) and a pending PR (2019 !!) about it : https://github.com/algoo/preview-generator/pull/109.
I do think, we can rework on it (us directly or @JulienPalard if he want to) about it after implementation of a weight process at builder level: https://github.com/algoo/preview-generator/issues/237 which permit us to have a strict ordering of loading of builder which will permit to have a less random result.


Cannot use items, only spells

Need to add the code to read the contents of bags and add items to the nb.itemcache on startup, and update on getting a new item.
Should add event for for gaining new spells too!!!

fixed in 1.3 release


urls: Generate narrow links using "channel" operator in web app and server.

Updates the web app and server to generate links using the "channel" operator instead of the deprecated "stream" operator.
Fixes #30385.
Notes:

Prep commit to update any existing links in our documentation that use the "stream" operator.
Existing links with the "stream" operator continue to work as expected in the web app, and the URL in the browser is not updated when one navigates to those links.
git grep -c '#narrow/stream' returns two results:

zerver/migrations/0501_delete_dangling_usermessages.py:1: Print logging strings of near message URLs in this migration.
zerver/tests/fixtures/rocketchat_fixtures/rocketchat_message.bson:3: Some chat.zulip.org links that were included in messages in the export data fixtures to test the import code.

In the commit with frontend changes, updates a few comments in web/src/filter.ts that have been added since the channel to stream rename happened. It's useful for that file in particular to use "channel" unless referring to the message type or an imported module/function.
~Final commit updates message fetching to use the channel ID instead of the channel name in the narrow, if it exists.~

Self-review checklist

[ ] Self-reviewed the changes for clarity and maintainability
(variable names, code reuse, readability, etc.).

Communicate decisions, questions, and potential concerns.

[ ] Explains differences from previous plans (e.g., issue description).
[ ] Highlights technical choices and bugs encountered.
[ ] Calls out remaining decisions and concerns.
[ ] Automated tests verify logic where appropriate.

Individual commits are ready for review (see commit discipline).

[ ] Each commit is a coherent idea.
[ ] Commit message(s) explain reasoning and motivation for changes.

Completed manual review and testing of the following:

[ ] Visual appearance of the changes.
[ ] Responsiveness and internationalization.
[ ] Strings and tooltips.
[ ] End-to-end functionality of buttons, interactions and flows.
[ ] Corner cases, error conditions, and easily imagined bugs.

Updates:

Dropped final commit that updated message_fetch.handle_operators_supporting_id_based_api for the "channel" operator. That's now addressed separately in #31934.

Merged, thanks @laurynmm! splitting the more controversial change to another PR was definitely helpful.


Please invite me to the GitHub Community Organization

Name
Haseeb Yousuf
Discord Username (if applicable)
haseebyousuf
Additional Context
I know Eddie from Kunal Kushwaha's Podcast.
I am new to open source and i believe this community will be a great start for me.

Thank You!
Hope to learn at from this community and start contributing.


Fix lms1xx dependency

All packages requiring victoria_ros need this line in their .travis.yml
sudo apt-get install -y ros-${ROS_DISTRO}-lms1xx
It seems to be a dependency of victoria_control but it's not certain why.
In the meantime, all of the dependent packages need this in their build file, which is bad.

I think this is coming in through victoria_ros


Multiple records with radio buttons for each record

Here's the situation:
Editing multiple form records at the same time. Form are set up properly using formKey. Each form has an active field which is rendered as two radio buttons (one Yes, one No).
The problem is that all the radio buttons will have the same name attribute of active, and the browser will think that they all belong to the same group of inputs even though they are intended to be two separate groups.
If you need more clarity I can set up an example.

No, I got it. Very interesting. So the name needs to be prefixed with the form key. Perhaps the library should be wise to this, but I can give you a work around until that day comes. What follows is pseudo code and may contain small errors.
render() {
  const {formKey, fields: {active}} = this.props;
  return (
    <form>
      <label>
        <input type="checkbox" {...active}
          checked={active.value === true}
          name={formKey + '_active'}/>
          Yes
      </label>
      <label>
        <input type="checkbox" {...active}
          checked={active.value !== true}
          name={formKey + '_active'}/>
          No
      </label>
   </form>
  );
}

Any props that you specify after the destructured field props will override them, so you can set a new unique name value based on the formKey.
That help?

Oh! Brilliant. I thought that perhaps name was used to identify the form field name, but not the case. Easy enough to do. Thanks!


feat(tracking) Add a fullstory boolean to TrackingOptions type

Overview

A small change: Fullstory only accepts client-side tracking (using analytics.track()).  So this adds an option for us to add fullstory tracking to events.  We plan to add this to onboarding-related events.

PR Checklist

[ ] Related to designs:
[x] Related to JIRA ticket: GROW-2047
[ ] I have run this code to verify it works
[ ] This PR includes unit tests for the code change

📬Published Alpha Packages<EMAIL_ADDRESS>
📬Published Alpha Packages<EMAIL_ADDRESS>
📬Published Alpha Packages<EMAIL_ADDRESS>
📬Published Alpha Packages<EMAIL_ADDRESS>
🚀 Styleguide deploy preview ready!https://5ffddc9bc5f9e801127d5a68--gamut-preview.netlify.appDeploy Logs

🚀 Styleguide deploy preview ready!https://5ffddc9bc5f9e801127d5a68--gamut-preview.netlify.appDeploy Logs

📬Published Alpha Packages<EMAIL_ADDRESS>
📬Published Alpha Packages<EMAIL_ADDRESS>
🚀 Styleguide deploy preview ready!https://5ffdf120c0aa100cce84fb98--gamut-preview.netlify.appDeploy Logs

🚀 Styleguide deploy preview ready!https://5ffdf120c0aa100cce84fb98--gamut-preview.netlify.appDeploy Logs


Add alt name for <IP_ADDRESS> traffic to CredHub

Talked to Dmitriy - We plan to expose the configured config server address, so we will change this to internal IP and not need the <IP_ADDRESS> address on the certificate.


gaston version

I think it would be nice to have a command that returns the version of gaston.
Mostly, it would be nice to differentiate a local install from a global install, stuff like that.

version 0.16.0 tells you the version when you run gaston -v or gaston --version.


How to call a custom member action on a resource

Say you have a group resource within your api-server like this:
resources :groups do
  put :approve, on: :member
end

How to call this action from the Her Api?
I would expect something like Group.find(15).put(:approve) but that itsn't working. Could someone indicate if is possible?

I also notice that I have to manually specify /groups


env: node\r not found

Love the tool.
I was playing with this on a Mac and ran into an issue trying to use it because it looks like perhaps it was developed on a Windows computer, assuming I'm understanding the issue correctly.
When I used the dos2linux command line tool to strip the new line characters, it worked ok.  Would you be interested in reviewing https://help.github.com/articles/dealing-with-line-endings/ to see what might be the best practice around supporting multiple line endings?

Yea, absolutely. I'm surprised my GitHub settings aren't configured correctly.
If I may ask, what is your use case for electron-wrapper? I developed it for personal use but found I could add websites to my desktop and launch them as separate windows natively in Chrome, without the need for something like electron-wrapper.

Hey @bbatliner after reviewing some of the issues and googling a bit more, my use case is mostly what nativefier is after. Since that's my use case, I'm not sure it's necessary to make any changes. I thought you'd appreciate knowing that Mac/Linux users may run into build issues.

Yup, that project seems much farther along than this one! Good luck and thank you for the heads up.


Adding referrer uri to url params sent to Northstar.

What's this PR do?
This PR adds an additional url param which passes the referring uri (basically the last page which had a link that was clicked on) before it gets sent over to Northstar, so that Norhtstar can know which campaign or other page on Phoenix to go back to after authentication.
How should this be reviewed?
👁
Any background context you want to provide?
💅
Relevant tickets
Refs https://github.com/DoSomething/northstar/issues/495
Checklist

[ ] Documentation added for new features/changed endpoints.
[ ] Tested on staging.

@angaither @sbsmith86

💯

Huzzah! thanks 💃


CB-11936 - Add docs for the four new App Transport Security (ATS) keys

Platforms affected
iOS
What does this PR do?
Support docs for:

https://github.com/apache/cordova-lib/pull/496
https://github.com/apache/cordova-ios/pull/264

What testing has been done on this change?
Ran "gulp serve" and inspected the output in a browser.
Checklist

[X] Reported an issue in the JIRA database
[X] Commit message follows the format: "CB-3232: (android) Fix bug with resolving file paths", where CB-xxxx is the JIRA ID & "android" is the platform affected.

Only pull in for cordova-ios 4.3.0 release.


How to force the tool output as final output.

My tool is fetching the details from the web and formatting it to Json. I want my tool object as final output from the agent, I was wondering is there any method do this.

If you just want a tool which finishes the run, use the result_type, see https://ai.pydantic.dev/results/.
If you want to end a run within or after a function tool, see #142

Closing for now as I think that answer your question, but happy to answer more questions, or open.


Fix Certificates table typo

@kojinak : Thanks for your contribution! The author, @mattbriggs, has been notified to review your proposed change.

#sign-off


Config doc

I've created a document describing the configuration options for all the packages. I thought it made the most sense to have them all together as the document also explains parsing to lists, floats etc. and how to override the roocs.ini file.
We could then link to this page in the docs for all the other packages.

@ellesmith88 excellent. Thanks for putting this together.
Should refer to this document (on readthedocs) in each of the other package docs (dachar, daops etc)?

@agstephens Yes, I'll make a reference to this in each of clisops, daops, dachar and rook's docs


Analysis of large (1.67GB) docker image completes with ""status": "fail" and no details.

Is this a request for help?:
No
Is this a BUG REPORT or a FEATURE REQUEST? (choose one):
BUG REPORT  potential bug

Version of Anchore Engine and Anchore CLI if applicable:
I run anchor-cli via engine-api container, i.e.,
$ /usr/local/bin/docker-compose exec engine-api anchore-cli --version
anchore-cli, version 0.4.1
$ docker-compose exec engine-api anchore-cli system status
Service policy_engine (anchore-quickstart, http://engine-policy-engine:8228): up
Service analyzer (anchore-quickstart, http://engine-analyzer:8228): up
Service simplequeue (anchore-quickstart, http://engine-simpleq:8228): up
Service catalog (anchore-quickstart, http://engine-catalog:8228): up
Service apiext (anchore-quickstart, http://engine-api:8228): up
Engine DB Version: 0.0.10
Engine Code Version: 0.4.1
Some more info of interest:
$ cat /etc/system-release
CentOS Linux release 7.4.1708 (Core)
$ docker --version
Docker version 18.03.0-ce, build 0520e24
$ docker-compose --version
docker-compose version 1.24.1, build 4667896b
What happened:
The analysis of large docker image complete with no error (  "analysis_status": "analyzed", )but with application's analysis status set to "status": "fail"
What did you expect to happen:
The analysis completes with no error with "status": "fail". It is not clear to as of how to interpret this.
If "status": "fail" means that the docker image had some vulnerability, I could not see any details in the output regarding which  vulnerability, i.e.
DEBUG:anchorecli.cli.utils:fetched httpcode from response: 200
[
{
"sha256:ddc044b3f534a633c899ec1f620b0cd866b70c88a35382925e133b7e9543b704": {
"localhost.localdomain:5000/my_third_image:latest": [
{
"detail": {},
"last_evaluation": "2019-08-07T19:27:03Z",
"policyId": "2c53a13c-1765-11e8-82ef-23527761d060",
"status": "fail"
}
]

Any relevant log output from /var/log/anchore:
N/A
What docker images are you using:
An Ubuntu-16.04+Python+Bash complex program. It executes correctly
How to reproduce the issue:
The problem could be due to the size of image (1.67GB). So it might be possible to reproduce the issue using a Large Ubuntu-16.04 Python image.
I can reproduce it every time with the same result.
Anything else we need to know:
See the output below. Note that the analysis took a relatively long time, i.e. i saw many instances of the following two lines:
Status: analyzing
Waiting 5.0 seconds for next retry.
============================
DEBUG:anchorecli.cli.image:discovery from input: tag : localhost.localdomain:5000/my_third_image:latest
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): localhost:8228
DEBUG:urllib3.connectionpool:http://localhost:8228 "GET /swagger.json HTTP/1.1" 200 99400
INFO:anchorecli.clients.apiexternal:As Account = None
DEBUG:anchorecli.clients.apiexternal:GET url=http://localhost:8228/images
DEBUG:anchorecli.clients.apiexternal:GET params={'fulltag': 'localhost.localdomain:5000/my_third_image:latest', 'history': 'false'}
DEBUG:anchorecli.clients.apiexternal:Use get body because detected api version (0, 1, 11) < (0, 1, 6)? False
DEBUG:anchorecli.clients.apiexternal:GET insecure=True
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): localhost:8228
DEBUG:urllib3.connectionpool:http://localhost:8228 "GET /images?fulltag=localhost.localdomain%3A5000%2Fmy_third_image%3Alatest&history=false HTTP/1.1" 200 4654
DEBUG:anchorecli.cli.utils:fetched httpcode from response: 200
[
{
"analysis_status": "analyzed",
"analyzed_at": "2019-08-07T19:26:52Z",
"annotations": {},
"created_at": "2019-08-07T19:19:51Z",
"imageDigest": "sha256:ddc044b3f534a633c899ec1f620b0cd866b70c88a35382925e133b7e9543b704",
"image_content": {
"metadata": {
"arch": "amd64",
"distro": "ubuntu",
"distro_version": "16.04",
"dockerfile_mode": "Guessed",
"image_size":<PHONE_NUMBER>,
"layer_count": 8
}
},
"image_detail": [
{
"created_at": "2019-08-07T19:19:51Z",
"digest": "sha256:ddc044b3f534a633c899ec1f620b0cd866b70c88a35382925e133b7e9543b704",
"dockerfile": "RlJPTSBzY3JhdGNoCkFERCBmaWxlOjkxNmE0NTAzMGRlZTg4MWJiYzhiYmFiZjhiY2ZjYzg4MjhjMjljZTFjMzE4MDAwOTUwYmJlODRjNTdmOWRmNzMgaW4gLyAKUlVOIC9iaW4vc2ggLWMgc2V0IC14ZSAJCSYmIGVjaG8gJyMhL2Jpbi9zaCcgPiAvdXNyL3NiaW4vcG9saWN5LXJjLmQgCSYmIGVjaG8gJ2V4aXQgMTAxJyA+PiAvdXNyL3NiaW4vcG9saWN5LXJjLmQgCSYmIGNobW9kICt4IC91c3Ivc2Jpbi9wb2xpY3ktcmMuZCAJCSYmIGRwa2ctZGl2ZXJ0IC0tbG9jYWwgLS1yZW5hbWUgLS1hZGQgL3NiaW4vaW5pdGN0bCAJJiYgY3AgLWEgL3Vzci9zYmluL3BvbGljeS1yYy5kIC9zYmluL2luaXRjdGwgCSYmIHNlZCAtaSAncy9eZXhpdC4qL2V4aXQgMC8nIC9zYmluL2luaXRjdGwgCQkmJiBlY2hvICdmb3JjZS11bnNhZmUtaW8nID4gL2V0Yy9kcGtnL2Rwa2cuY2ZnLmQvZG9ja2VyLWFwdC1zcGVlZHVwIAkJJiYgZWNobyAnRFBrZzo6UG9zdC1JbnZva2UgeyAicm0gLWYgL3Zhci9jYWNoZS9hcHQvYXJjaGl2ZXMvKi5kZWIgL3Zhci9jYWNoZS9hcHQvYXJjaGl2ZXMvcGFydGlhbC8qLmRlYiAvdmFyL2NhY2hlL2FwdC8qLmJpbiB8fCB0cnVlIjsgfTsnID4gL2V0Yy9hcHQvYXB0LmNvbmYuZC9kb2NrZXItY2xlYW4gCSYmIGVjaG8gJ0FQVDo6VXBkYXRlOjpQb3N0LUludm9rZSB7ICJybSAtZiAvdmFyL2NhY2hlL2FwdC9hcmNoaXZlcy8qLmRlYiAvdmFyL2NhY2hlL2FwdC9hcmNoaXZlcy9wYXJ0aWFsLyouZGViIC92YXIvY2FjaGUvYXB0LyouYmluIHx8IHRydWUiOyB9OycgPj4gL2V0Yy9hcHQvYXB0LmNvbmYuZC9kb2NrZXItY2xlYW4gCSYmIGVjaG8gJ0Rpcjo6Q2FjaGU6OnBrZ2NhY2hlICIiOyBEaXI6OkNhY2hlOjpzcmNwa2djYWNoZSAiIjsnID4+IC9ldGMvYXB0L2FwdC5jb25mLmQvZG9ja2VyLWNsZWFuIAkJJiYgZWNobyAnQWNxdWlyZTo6TGFuZ3VhZ2VzICJub25lIjsnID4gL2V0Yy9hcHQvYXB0LmNvbmYuZC9kb2NrZXItbm8tbGFuZ3VhZ2VzIAkJJiYgZWNobyAnQWNxdWlyZTo6R3ppcEluZGV4ZXMgInRydWUiOyBBY3F1aXJlOjpDb21wcmVzc2lvblR5cGVzOjpPcmRlcjo6ICJneiI7JyA+IC9ldGMvYXB0L2FwdC5jb25mLmQvZG9ja2VyLWd6aXAtaW5kZXhlcyAJCSYmIGVjaG8gJ0FwdDo6QXV0b1JlbW92ZTo6U3VnZ2VzdHNJbXBvcnRhbnQgImZhbHNlIjsnID4gL2V0Yy9hcHQvYXB0LmNvbmYuZC9kb2NrZXItYXV0b3JlbW92ZS1zdWdnZXN0cwpSVU4gL2Jpbi9zaCAtYyBybSAtcmYgL3Zhci9saWIvYXB0L2xpc3RzLyoKUlVOIC9iaW4vc2ggLWMgbWtkaXIgLXAgL3J1bi9zeXN0ZW1kICYmIGVjaG8gJ2RvY2tlcicgPiAvcnVuL3N5c3RlbWQvY29udGFpbmVyCkNNRCBbIi9iaW4vYmFzaCJdCkFSRyB1aWQ9Z3NreWRlbW8KQVJHIHB3PWc1a3lEM20wCkFSRyBob21lPS9pbWdfZGVtby8KUlVOIHwzIGhvbWU9L2ltZ19kZW1vLyBwdz1nNWt5RDNtMCB1aWQ9Z3NreWRlbW8gL2Jpbi9zaCAtYyBhcHQtZ2V0IHVwZGF0ZSAgICAgJiYgYXB0LWdldCBpbnN0YWxsIC15IHNvZnR3YXJlLXByb3BlcnRpZXMtY29tbW9uICAgICAgICBzdWRvICAgICAgICBzc2hwYXNzICAgICAgICBweXRob24tcGlwICAgICAgICB6aXAgICAgICYmIGFwdC1nZXQgYXV0b3JlbW92ZSAgICAgJiYgcGlwIGluc3RhbGwgbnVtcHkgICAgICYmIHBpcCBpbnN0YWxsIHRlbnNvcmZsb3cKUlVOIHwzIGhvbWU9L2ltZ19kZW1vLyBwdz1nNWt5RDNtMCB1aWQ9Z3NreWRlbW8gL2Jpbi9zaCAtYyBwaXAgaW5zdGFsbCAtLXVwZ3JhZGUgcGlwClJVTiB8MyBob21lPS9pbWdfZGVtby8gcHc9ZzVreUQzbTAgdWlkPWdza3lkZW1vIC9iaW4vc2ggLWMgcGlwIGluc3RhbGwgaW11dGlscyAgICAgJiYgcGlwIGluc3RhbGwgc2Npa2l0LWltYWdlICAgICAmJiBhcHQtZ2V0IGluc3RhbGwgLXkgcHl0aG9uLW9wZW5jdiAgICAgJiYgc3VkbyB1c2VyYWRkIC1tIC1kICR7aG9tZX0gLXMgL2Jpbi9iYXNoIC1wICQob3BlbnNzbCBwYXNzd2QgIC0xICR7cHd9KSAtdSAzMTQxICR7dWlkfSAgICAgJiYgZWNobyAke3B3fSA+ICR7aG9tZX0vLnB3ICAgICAmJiBhcHQtZ2V0IGF1dG9yZW1vdmUgICAgICYmIHJtIC1yZiAvdmFyL2xpYi9hcHQvbGlzdHMvKgpBUkcgdWlkPWdza3lkZW1vCkFSRyBwdz1nNWt5RDNtMApBUkcgaG9tZT0vaW1nX2RlbW8vCldPUktESVIgL2ltZ19kZW1vLwpBREQgbXVsdGk6Nzk3ZmU1YzNmMmQ3MmMxMGZiZWYzN2NiN2JiODdlZjllYzA4NGRkNmVjYzcyMTRjN2MwOTFmYTJiODNlZTA4YyBpbiAvaW1nX2RlbW8vIApVU0VSIGdza3lkZW1vCkNNRCBbImJhc2giICItYyIgIi4vaW1nX2RlbW8gMiA1IDEwLjMuMi42MyJdCg==",
"fulldigest": "localhost.localdomain:5000/my_third_image@sha256:ddc044b3f534a633c899ec1f620b0cd866b70c88a35382925e133b7e9543b704",
"fulltag": "localhost.localdomain:5000/my_third_image:latest",
"imageDigest": "sha256:ddc044b3f534a633c899ec1f620b0cd866b70c88a35382925e133b7e9543b704",
"imageId": "752f8eea14330275ff2c3e1611f7db98cc13cfa9c9cc635b6970a7afb0f113e3",
"last_updated": "2019-08-07T19:26:52Z",
"registry": "localhost.localdomain:5000",
"repo": "my_third_image",
"tag": "latest",
"tag_detected_at": "2019-08-07T19:19:51Z",
"userId": "admin"
}
],
"image_status": "active",
"image_type": "docker",
"last_updated": "2019-08-07T19:26:52Z",
"parentDigest": "sha256:ddc044b3f534a633c899ec1f620b0cd866b70c88a35382925e133b7e9543b704",
"userId": "admin"
}
]
INFO:anchorecli.clients.apiexternal:As Account = None
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): localhost:8228
DEBUG:urllib3.connectionpool:http://localhost:8228 "GET / HTTP/1.1" 200 5
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): localhost:8228
DEBUG:urllib3.connectionpool:http://localhost:8228 "GET /swagger.json HTTP/1.1" 200 99400
INFO:anchorecli.clients.apiexternal:As Account = None
DEBUG:anchorecli.clients.apiexternal:GET url=http://localhost:8228/images
DEBUG:anchorecli.clients.apiexternal:GET params={'fulltag': 'localhost.localdomain:5000/my_third_image:latest', 'history': 'false'}
DEBUG:anchorecli.clients.apiexternal:Use get body because detected api version (0, 1, 11) < (0, 1, 6)? False
DEBUG:anchorecli.clients.apiexternal:GET insecure=True
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): localhost:8228
DEBUG:urllib3.connectionpool:http://localhost:8228 "GET /images?fulltag=localhost.localdomain%3A5000%2Fmy_third_image%3Alatest&history=false HTTP/1.1" 200 4654
DEBUG:anchorecli.cli.image:discovery from input: tag : localhost.localdomain:5000/my_third_image:latest : sha256:ddc044b3f534a633c899ec1f620b0cd866b70c88a35382925e133b7e9543b704
INFO:anchorecli.clients.apiexternal:As Account = None
DEBUG:anchorecli.clients.apiexternal:GET url=http://localhost:8228/images/sha256:ddc044b3f534a633c899ec1f620b0cd866b70c88a35382925e133b7e9543b704/content
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): localhost:8228
DEBUG:urllib3.connectionpool:http://localhost:8228 "GET /images/sha256:ddc044b3f534a633c899ec1f620b0cd866b70c88a35382925e133b7e9543b704/content HTTP/1.1" 200 62
DEBUG:anchorecli.cli.utils:fetched httpcode from response: 200
[
"os",
"files",
"npm",
"gem",
"python",
"java"
]
INFO:anchorecli.clients.apiexternal:As Account = None
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): localhost:8228
DEBUG:urllib3.connectionpool:http://localhost:8228 "GET / HTTP/1.1" 200 5
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): localhost:8228
DEBUG:urllib3.connectionpool:http://localhost:8228 "GET /swagger.json HTTP/1.1" 200 99400
INFO:anchorecli.clients.apiexternal:As Account = None
DEBUG:anchorecli.clients.apiexternal:GET url=http://localhost:8228/images
DEBUG:anchorecli.clients.apiexternal:GET params={'fulltag': 'localhost.localdomain:5000/my_third_image:latest', 'history': 'false'}
DEBUG:anchorecli.clients.apiexternal:Use get body because detected api version (0, 1, 11) < (0, 1, 6)? False
DEBUG:anchorecli.clients.apiexternal:GET insecure=True
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): localhost:8228
DEBUG:urllib3.connectionpool:http://localhost:8228 "GET /images?fulltag=localhost.localdomain%3A5000%2Fmy_third_image%3Alatest&history=false HTTP/1.1" 200 4654
INFO:anchorecli.clients.apiexternal:As Account = None
DEBUG:anchorecli.clients.apiexternal:GET url=http://localhost:8228/images/sha256:ddc044b3f534a633c899ec1f620b0cd866b70c88a35382925e133b7e9543b704/vuln?vendor_only=True
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): localhost:8228
DEBUG:urllib3.connectionpool:http://localhost:8228 "GET /images/sha256:ddc044b3f534a633c899ec1f620b0cd866b70c88a35382925e133b7e9543b704/vuln?vendor_only=True HTTP/1.1" 200 32
DEBUG:anchorecli.cli.utils:fetched httpcode from response: 200
[
"os",
"non-os",
"all"
]
INFO:anchorecli.clients.apiexternal:As Account = None
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): localhost:8228
DEBUG:urllib3.connectionpool:http://localhost:8228 "GET / HTTP/1.1" 200 5
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): localhost:8228
DEBUG:urllib3.connectionpool:http://localhost:8228 "GET /swagger.json HTTP/1.1" 200 99400
INFO:anchorecli.clients.apiexternal:As Account = None
DEBUG:anchorecli.clients.apiexternal:GET url=http://localhost:8228/images
DEBUG:anchorecli.clients.apiexternal:GET params={'fulltag': 'localhost.localdomain:5000/my_third_image:latest', 'history': 'false'}
DEBUG:anchorecli.clients.apiexternal:Use get body because detected api version (0, 1, 11) < (0, 1, 6)? False
DEBUG:anchorecli.clients.apiexternal:GET insecure=True
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): localhost:8228
DEBUG:urllib3.connectionpool:http://localhost:8228 "GET /images?fulltag=localhost.localdomain%3A5000%2Fmy_third_image%3Alatest&history=false HTTP/1.1" 200 4654
INFO:anchorecli.clients.apiexternal:As Account = None
DEBUG:anchorecli.clients.apiexternal:GET url=http://localhost:8228/images/sha256:ddc044b3f534a633c899ec1f620b0cd866b70c88a35382925e133b7e9543b704/check?history=false&detail=false&tag=localhost.localdomain:5000/my_third_image:latest
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): localhost:8228
DEBUG:urllib3.connectionpool:http://localhost:8228 "GET /images/sha256:ddc044b3f534a633c899ec1f620b0cd866b70c88a35382925e133b7e9543b704/check?history=false&detail=false&tag=localhost.localdomain:5000/my_third_image:latest HTTP/1.1" 200 353
DEBUG:anchorecli.cli.utils:fetched httpcode from response: 200
[
{
"sha256:ddc044b3f534a633c899ec1f620b0cd866b70c88a35382925e133b7e9543b704": {
"localhost.localdomain:5000/my_third_image:latest": [
{
"detail": {},
"last_evaluation": "2019-08-07T19:27:03Z",
"policyId": "2c53a13c-1765-11e8-82ef-23527761d060",
"status": "fail"
}
]
}
}
]

hi @dforouhari
Couple of clarifications:

anchore has two main 'phases' of handling images, the first is 'analysis' where the image is downloaded, and its contents are inspected/categorized.  No scans or evals happen at this point, but rather the image is 'analyzed' so that the higher level applications (vuln scan, policy eval, content reports, etc) then be used.  The second phase is running said applications, which require an image to have been successfully 'analyzed'.

if you see an image failing to analyze, as per the info in 1), it won't be due to any 'application' issues like vulnerability scans/policy evals, etc, but rather that the image could not be downloaded/analyzed/contents categorized correctly by anchore for some reason.  To find out why, you can investigate the events, and further look into the analyzer (worker) logfiles for lots of detail on what has happened to prevent successful image analysis.

There are some links here that describe these topics and troubleshooting in more detail!
https://docs.anchore.com/current/docs/troubleshooting/
https://docs.anchore.com/current/docs/overview/concepts/images/analysis/
Let us know what you find using the troubleshooting techniiques to investigate further!

@nurmi
Hello Dan. Thanks for your detailed follow up (and help).
Two things:
1. After getting the list of events in the system, below is the list of all events relevant to the this issue. Below is the list:
{
"item_count": 100,
"next_page": true,
"page": 1,
"results": [
{
"created_at": "2019-08-07T20:35:35.557160Z",
"event": {
"details": {
"sync_feed_types": [
"vulnerabilities"
]
},
"level": "INFO",
"message": "Feed sync completed",
"resource": {
"type": "feeds",
"user_id": "admin"
},
"source": {
"base_url": "http://engine-policy-engine:8228",
"hostid": "anchore-quickstart",
"servicename": "policy_engine"
},
"timestamp": "2019-08-07T20:35:35.507985Z",
"type": "feed_sync_complete"
},
"generated_uuid": "4b6f069399124a58b9a428665b8139ba"
},
{
"created_at": "2019-08-07T20:35:06.816272Z",
"event": {
"details": {
"sync_feed_types": [
"vulnerabilities"
]
},
"level": "INFO",
"message": "Feed sync started",
"resource": {
"type": "feeds",
"user_id": "admin"
},
"source": {
"base_url": "http://engine-policy-engine:8228",
"hostid": "anchore-quickstart",
"servicename": "policy_engine"
},
"timestamp": "2019-08-07T20:35:06.769926Z",
"type": "feed_sync_start"
},
"generated_uuid": "ab9114c8b5f2456e8b3dc2235ae95c6b"
},
I don't see any sign of trouble, based on above info.
Question:  Does  'level' in "level": "INFO",  has to do with the log-level setting which could be set to something else to provide more data, or the 'level' would had turned to, say ERROR, if an error was encountered?
2. For whatever reason, there are no log files in /var/log/anchore.  Would u plz let me know what needs to be done in order to have logging enable. Note that I used 'Quickstart' document for installing anchore-engine. Is there some other document that I should has used?
Pls advise.
Thanks

Thanks @dforouhari
Not all failure events will register in the event log (but some do, which is why it is always good to check there).  The logfiles will be next - since anchore is running in containers, you'll need to look in the container(s) themselves, for each anchore service, where you'll find the logs in /var/log/anchore.  You can also use regular docker logging commands to view the logs (e.g. docker logs ), as anchore uses regular docker logging facilities also!
The logs you're looking for will be in the analyzer service container - (look for 'engine-analyzer' as the substring in the name of the container to get its id, etc).

@nurmi
Hi Dan.

Sorry for  forgetting that my anchore-engine components run in containers.

Below is the relevant log lines from engine-analyzer's anchore-worker.log file. I did not see any log entries would indicate any sort of errors/failures/... Pls see below.
$ docker exec aevolume_engine-analyzer_1 /bin/bash -c "ls /var/log/anchore"
anchore-worker.log

$ docker exec aevolume_engine-analyzer_1 /bin/bash -c "grep -v 'GET' /var/log/anchore/anchore-worker.log | grep '^2019-08-07'" ...
2019-08-07 19:19:54+0000 [-] [Thread-146831] [anchore_engine.services.analyzer/process_analyzer_job()] [INFO] image dequeued for analysis: admin : sha256:ddc044b3f5
34a633c899ec1f620b0cd866b70c88a35382925e133b7e9543b704
2019-08-07 19:19:54+0000 [-] [Thread-146831] [anchore_engine.services.analyzer/perform_analyze_nodocker()] [INFO] performing analysis on image: ['admin', 'localhost
.localdomain:5000/my_third_image@sha256:ddc044b3f534a633c899ec1f620b0cd866b70c88a35382925e133b7e9543b704', 'localhost.localdomain:5000/my_third_image:latest']
2019-08-07 19:25:45+0000 [-] [Thread-146831] [anchore_engine.services.analyzer/perform_analyze_nodocker()] [INFO] performing analysis on image complete: localhost.l
ocaldomain:5000/my_third_image@sha256:ddc044b3f534a633c899ec1f620b0cd866b70c88a35382925e133b7e9543b704
2019-08-07 19:25:54+0000 [-] [Thread-146831] [anchore_engine.services.analyzer/process_analyzer_job()] [INFO] Loading image into policy engine: admin 752f8eea143302
75ff2c3e1611f7db98cc13cfa9c9cc635b6970a7afb0f113e3
2019-08-07 19:26:52+0000 [-] [Thread-146831] [anchore_engine.services.analyzer/process_analyzer_job()] [INFO] analysis complete: admin : sha256:ddc044b3f534a633c899
ec1f620b0cd866b70c88a35382925e133b7e9543b704

@dforouhari - my apologies, I think that I had misinterpreted your above report - I had read that your image had failed 'analysis' but from the output we can see that analysis completed successfully (i.e. the image went to 'analyzed').  What you're displaying is that the policy evaluation is reporting that the policy check itself has executed successfully, but determined that, based on the policy checks in place, the 'result' of the policy evaluation is 'fail'.  You can get more detail by adding '--detail' to the 'anchore-cli evaluate check' command, so see all of the checks that are triggering.
It looks like everything in anchore is working properly, it is expected that policy evaluations can result in a 'fail' status, when images do not pass the policy checks that you are running.
There is a good overview of policies and the concepts at our docs site:
https://docs.anchore.com/current/docs/overview/concepts/policy/
Let us know if you have more questions about anchore usage, but I believe that this ticket could be  closed (if you agree!) as we're not seeing any system bug/failures in the shared output

@dforouhari https://github.com/dforouhari - my apologies, I think that
I had misinterpreted your above report

DF yup. See  "analysis_status": "analyzed", in the original/first bug
report.

I had read that your image had failed 'analysis' but from the output we
can see that analysis completed successfully (i.e. the image went to
'analyzed'). What you're displaying is that the policy evaluation is
reporting that the policy check itself has executed successfully, but
determined that, based on the policy checks in place, the 'result' of the
policy evaluation is 'fail'. You can get more detail by adding '--detail'
to the 'anchore-cli evaluate check' command, so see all of the checks that
are triggering.

DF OK. I'l turn on the --detail flag on and see what I get.
As I had listed in my original comment, we have
{
"detail": {},
"last_evaluation": "2019-08-07T19:27:03Z",
"policyId": "2c53a13c-1765-11e8-82ef-23527761d060",
"status": "fail"
}
Question/suggestion: Why not provide some info in the  "detail": {} field
regarding the nature of the failure?
Thank you.
Danesh

It looks like everything in anchore is working properly, it is expected
that policy evaluations can result in a 'fail' status, when images do not
pass the policy checks that you are running.
There is a good overview of policies and the concepts at our docs site:
https://docs.anchore.com/current/docs/overview/concepts/policy/
Let us know if you have more questions about anchore usage, but I believe
that this ticket could be closed (if you agree!) as we're not seeing any
system bug/failures in the shared output
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/anchore/anchore-engine/issues/250?email_source=notifications&email_token=AG652YB5ZB5AHYACRIMOXCDQDR7SDA5CNFSM4IKD7ED2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD342PFQ#issuecomment-519677846,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AG652YH3QS45UNDEMSTZA63QDR7SDANCNFSM4IKD7EDQ
.

Hi @dforouhari
Indeed!  If you supply the '--detail' flag, you'll see details in that field with a lot of information.

@nurmi
Thanks for the help & guidance. I will close the tkt shortly.
I still believe providing zero details (or what to do) when "status": fail is less than desirable. God knows how long would had taken for me to find out that I should run 'anchor-cli evaluate check --detail ..." to find the cause of these failure. If there is a FAQ that would list what to do in this case, then I take full-responsibility for not having read it, and my apologies.
Danesh


[SPARK-34843][SQL][FOLLOWUP] Fix a test failure in OracleIntegrationSuite

What changes were proposed in this pull request?

This PR fixes a test failure in OracleIntegrationSuite.
After SPARK-34843 (#31965), the way to divide partitions is changed and OracleIntegrationSuites is affected.
[info] - SPARK-22814 support date/timestamp types in partitionColumn *** FAILED *** (230 milliseconds)
[info]   Set(""D" < '2018-07-11' or "D" is null", ""D" >= '2018-07-11' AND "D" < '2018-07-15'", ""D" >= '2018-07-15'") did not equal Set(""D" < '2018-07-10' or "D" is null", ""D" >= '2018-07-10' AND "D" < '2018-07-14'", ""D" >= '2018-07-14'") (OracleIntegrationSuite.scala:448)
[info]   Analysis:
[info]   Set(missingInLeft: ["D" < '2018-07-10' or "D" is null, "D" >= '2018-07-10' AND "D" < '2018-07-14', "D" >= '2018-07-14'], missingInRight: ["D" < '2018-07-11' or "D" is null, "D" >= '2018-07-11' AND "D" < '2018-07-15', "D" >= '2018-07-15'])

Why are the changes needed?

To follow the previous change.
Does this PR introduce any user-facing change?

No.
How was this patch tested?

The modified test.

I ran other integration tests but only OracleIntegrationSuites seems to be affected for now.

Test build #137408 has started for PR 32186 at commit 644d7f1.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41984/

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41984/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41984/

Test build #137408 has finished for PR 32186 at commit 644d7f1.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137408/

cc @hanover-fiste and @srowen , too.


feat: use UIKit scrollspy for lazy vega plots

Prerequisites:

[x] Unless it is a hotfix it should be merged against the dev branch
[x] Branch is up-to-date with the branch to be merged with, i.e. dev
[x] Build is successful
[x] Code is cleaned up and formatted

Summary
uses https://getuikit.com/docs/scrollspy to only render vega plots that are visible, improving the initial loading time on the cost of the scrolling time.

@tildechris pinging, I think this would be a good addition for the next release

@tildechris pinging, I think this would be a good addition for the next release


Port to the Oculus 0.5.0 sdk.

The 0.5.0 sdk has some minor API changes.  Mostly adding some extra
arguments to some methods.  This change addresses that.  (rebased edition)
GearVRf-DCO-1.0-Signed-off-by: Tom Flynn
<EMAIL_ADDRESS>

Ok, this is rebased and the spacing should be fixed.  Once this goes in, we'll need to update the build instructions in the Dev Guide.  I can take care of that.

The code looks fine - will switch to new VRLib and verify, after lunch. (If I verify now, there may be no food by the time I get down there.)

Verified. We can pull the change as soon as we've updated the Developer's Guide.

Verified + 1. Code Review + 2 :-)

ok, changed the build instructions on the wiki.  The pdf of the Dev Guide still needs to be updated, re-generated and uploaded to the wiki, but that's a lengthy process that can be done tomorrow.


Alluxio Fuse leads high CPU useage

Alluxio Version:
2.1.1
Describe the bug
I'm running AI workload on Alluxio, and notice it uses very high cpu. It's about 2000% CPU usage.

And the following is the thread dump raw file:
77737.log
And here is the complete analysis : https://fastthread.io/my-thread-report.jsp?p=c2hhcmVkLzIwMjAvMDIvMTEvLS03NzczNy5sb2ctLTAtMzgtMzk=&

ft-report-77737.pdf
Looks like the DirectMemoryIO uses the most CPU. Any suggestions on it?
at com.kenai.jffi.Foreign.putByteArray(Native Method)
at com.kenai.jffi.MemoryIO$UnsafeImpl.putByteArray(MemoryIO.java:911)
at jnr.ffi.provider.jffi.DirectMemoryIO.put(DirectMemoryIO.java:127)
at alluxio.fuse.AlluxioFuseFileSystem.read(AlluxioFuseFileSystem.java:595)
at ru.serce.jnrfuse.AbstractFuseFS.lambda$init$3(AbstractFuseFS.java:134)
at ru.serce.jnrfuse.AbstractFuseFS$$Lambda$56/187472540.read(Unknown Source)
at jnr.ffi.provider.jffi.NativeClosureProxy$$impl$$9.invoke(Unknown Source)

To Reproduce
Steps to reproduce the behavior (as minimally and precisely as possible)
Expected behavior
A clear and concise description of what you expected to happen.
Urgency
Describe the impact and urgency of the bug.
Additional context
Add any other context about the problem here.

addressed through jni-fuse


Rewording tanh activation description

Thank you so much.
I've added you an acknowledgement in the main readme.md :)

@mbadry1 No problem. Thank you) And thanks again for your notes


Reproduce the Shrine home page portrait grid layout

The Shrine home page arranges the product cards into two columns. The card on every 4th and 5th row spans two columns.
Also:

Moved more of the app's colors into ShrineTheme.
Export GridChildPlacement in basic.dart.


HTTPS is not being enforced

Hey Guys, Why could it be the HTTPS is not enforced on the domains even though I have enabled it.
I have a platformDomain and a deis-router-platform-cert set up.
All domains have individual certificates attached to them too with deis certs:attach <cert> <domain>
apiVersion: extensions/v1beta1
kind: Deployment
metadata:
  name: deis-router
  namespace: deis
  labels:
    heritage: deis
  annotations:
    helm-keep: "true"
    router.deis.io/nginx.ssl.enforce: "true"
    router.deis.io/nginx.ssl.hsts.enabled: "true"
    router.deis.io/nginx.platformDomain: “mydomain.com"

@pixeleet what version are you running?

quay.io/deis/router:v2.3.0

@pixeleet if you are on 2.3.0 then you have to edit the RC. https://github.com/deis/router/pull/224 is in 2.4.0

That solves it :)


[Deploy] StandardNotes

Service
StandardNotes
Link to your repository
https://github.com/vantezzen/franz-recipe-standardnotes

can confirm seems to be working fine


Document minimum requirements

I think the current DB is ~130GBs, but I need to double-check and we also need to figure out cpu/ram requirements

Some other related service stats
57G	mainnet/node-db
4.0K	mainnet/node-ipc
34G	mainnet/postgres-data
8.0K	mainnet/tmp

RAM below 16 GBs sometimes crashes cardano-node
Also I believe 4+ CPUs are welcome


Provide UI to control whether thumbnails have text superimposed

         … would it be possible to turn off the green 3MF and red GCODE text? Could be a setting in preferences if some people like having the text. I know if I clicked on a .3MF or a .gcode file and I would rather not have the text cover up the object I want to see. Thank you for your consideration. I feel the same way about the folded-over corner, too.

Originally posted by @alsmithson in https://github.com/DavidPhillipOster/ThumbHost3mf/issues/5#issuecomment-1926156246

The 3MF host app could certainly have a Settings dialog box that wrote to a Preferences file. I think that the plugin could then see it.
The folded corner is the default behavior of the operating system.
If the option existed, I'd have to research if there is an API to get Quicklook to re-scan files to get the current icon.
The reason the labeling behavior is on by default is to support Mac users who have kept the default setting of hiding file extensions.
Note that you can give files custom icons by:
Position the camera to the best angle, use ⌘⇧4 then the mouse to sweep out a rectangle for a screenshot, open the screenshot, and do a select all, copy, then ⌘i on the file to open a Get Info window, use the mouse to click on the icon in the upper left of the window, and paste. It sounds tedious written out in text, but it is only a few seconds in practice.
i.e.:
$OACIV - all with the command key held down.
The $OACIV trick is quite fast. I added icons to a dozen files as an experiment.
The custom icon overrides the ThumbHost3mf icon, but if you copy a file to a FAT-32 SD card, I'm under the impression that the custom icon is not preserved.

Thanks for your detailed reply. I never thought about people who hide extensions as I always change that setting to show them. They would surely benefit from the text on the icon. Now I do see a couple files that have the folded corner, but it is pretty rare on my system. XLSX files use them while DMG files use a fancier curled corner. Py and md files also have the folded corner. All of the ones I've found are white on white, so I never really noticed the corner. I don't care for it, but I can certainly live with it.
Thanks for the reminder about custom icons. I used that in the past, but forgot how. I recently searched, unsuccessfully, how to change folder icons. I tried this just now and I see that it works on folders too!

I know you have your reasons for adding the text, but I'd also second disabling that by default. I think users that leave the file extensions hidden will probably not care about this filetype either.


provide a method to user to define discoveryAddress for their sidecar

We now have  annotation sidecar.istio.io/discoveryAddress for user to define their custom discoveryAddress. But that means they need rebuild their pod spec to make use of it.
Need a way to specify this in manifest and let use customize this.

We already have it. meshConfig.defaultConfig.discoveryAddress


Encountered an exception while running action 'action_retrieve_bank'. Bot will continue, but the actions events are lost. Make sure to fix the exception in your custom code.

Rasa version: 1.1.4
Rasa X version (if used & relevant):
Python version:3.6.8
Operating system (windows, osx, ...):windows
Issue:
Encountered an exception while running action 'action_retrieve_bank'. Bot will continue, but the actions events are lost. Make sure to fix the exception in your custom code.
Error (including full traceback):

Command or request that led to error:

Content of configuration file (config.yml) (if relevant):

Content of domain file (domain.yml) (if relevant):

it is working in jupyter notebook or rasa x. but not on cmdline or interactive shell

this is my actions:
class ApiActionBank(Action):
def name(self):
return "action_retrieve_bank"
def output_string(bnk):
    return article_df[my_dict.get(bnk)][0]

def run(self, dispatcher, tracker, domain):

    my_dict = {'motorbike_':'automotive', 'car_':'automotive', 'ai_':'it_digital', \
           'saas_':'it_digital', 'retail_':'business', 'consumer_':'business'}

    article_df = pd.read_csv("data/industry_report.csv")
    bnk = tracker.get_slot('bnk')
    #group = tracker.get_slot('group')

    #display(Image(response[0], height=550, width=520))
    dispatcher.utter_message("Here is something to help your search for Banking: {}".format(article_df[my_dict.get(bnk)][0]))
    return []

domain file and config file is perfect according to rasa documents.

Hi @ravikrcs,
the command you are running is rasa shell? Please try adding the --debug flag and posting the output.

same thing happen

Yes, adding the --debug option is not a solution but a way to obtain more information. Rasa should print a lot more messages when run with this option. Please copy the relevant parts and post them here.

i got it.
it is solved by exposing the port on which the action server is running. i.e., 5055
i am using NGROK for exposing port.
ngrok http 5055

Glad you could solve it!

@ravikrcs

i got it.
it is solved by exposing the port on which the action server is running. i.e., 5055
i am using NGROK for exposing port.
ngrok http 5055

hey help me please I couldn't understand


Instagram phishlet not redirecting nor capturing cookies

PLEASE READ THE POSTING GUIDELINES AND ANSWER THE QUESTION BEFORE POSTING, OTHERWISE ISSUE WILL BE CLOSED AND MARKED AS INVALID

I hereby declare the following issue is a [tool specific question/bug report] and it is NOT a help request about creating a phishlet.
I am fully aware that this is not a customer support portal, I can't demand answers and I'm aware I am using a free tool.
I am not going to use Evilginx to hax my girlfriend's account or use it for any other illegal purpose.
I am not trying to set up a domain on FreeNOM (also read the sentence above again).
I am not a robot.

Please type in "I CONFIRM" below if you confirm the sentences above or otherwise make some funny remark:
I CONFIRM
Thanks!
Hi,
i managed to get the site working just fine but when i put in my own login to test (which had 2FA) it just showed a message in red saying cannot connect to instagram and to check your internet connection and won't redirect nor capture the cookies, however it did capture username & password just fine. Is this a problem with the .yaml phishlet itself or on IG's end?

@5ky1ar  did you manage to fix it? Got the same!


[REQ]  Search populer topics and follow as a feed in customized groups

Describe the problem that needs solving
A clear description of what the problem is. E.g. I'm always frustrated when [...]
Describe the solution you'd like
A clear description of what you want to happen.

Could you fill out the issue infomation?
Sorun bilgilerini doldurabilir misiniz?

dome


Every user displays as offline

Tested on Fedora. Every user (including my own account) displays as offline at all times. I don't believe this is the result of any settings within Riot, as it was like this before I configured any settings.

Indeed. This is an RPM packaging repo development site. Please take this up with the riot folks (developers) if the behavior continues. https://github.com/vector-im/riot-web


Is this compatible with the CatGenie-120 PLUS

Hello thanks for the project, very good idea. I had a spare cartridge and turned out RFID is broken while changing the old one. So I have an arduino and I thought should I take the risk, why not? But mine is CG 120 plus, do you think is this works with this version?

Dude, thank you so much. It worked! Awesome.

Glad to hear, I couldn't find a cat genie 120 plus on the company site.
On Wed, Aug 22, 2018 at 8:57 AM Ahmet Salih<EMAIL_ADDRESS>wrote:

Closed #1
https://github.com/davidhampgonsalves/CR14-emulator-for-CatGenie-120/issues/1
.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/davidhampgonsalves/CR14-emulator-for-CatGenie-120/issues/1#event-1802452521,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAK6zUfOJaVGa_PcfAebNVECQdDpNLgzks5uTUdBgaJpZM4WEwwd
.

Oh I see this is some kind of marketing thing for Turkey. Thanks again.


Spray and Paint tools are acting like one another

Terrain3D version
v0.8.3 alpha gd4.1.1
Godot version
v4.1.1 stable version And v4.1.3 stable version
System information
Windows 10
Is the issue reproducable in the demo?
No
Issue description
Hi, i've recently installed this plugin and for some reason, when using the "spray texture" and "paint texture" tools, they somehow seem to have broken behaviors
when using the spray with a different texture, the old texture gets instantly replaced regardless of the opacity value.
It seems to happen at some places where you've painted/sprayed over previously, or over that different texture with the original one. and the same, possibly inverted behavior happens with  the "paint texture" tool, mimicking the behavior of the "spray texture" tool.
in the following examples, anything in the green outlines behaves correctly, meanwhile anything in the red areas are instantly, sharply replaced by the stroke of the spray brush.
the textures used are the third one in the list that's applied with the tool, and the original one is the fourth texture.

it has the rather jarring effect of disproportionately affecting some places you've sprayed on once compared to one done multiple times (edge of the two textures),
Aswell as the very annoying problem of not being able to blend textures regardless of the opacity value

Logs
I did have a problem earlier before i switched renderer from Compatibility to Forward+, tripping dozens of
USER SHADER ERROR: Built-in function "fma(float, float, float)" is only supported on high-end platforms.    at: (null) (:189) USER ERROR: Shader compilation failed.    at: set_code (drivers/gles3/storage/material_storage.cpp:2932)
but after changing renderer those errors stopped showing
the only log i get now:
USER WARNING: Terrain3D::_initialize: Storage version 0.80 will be updated upon save    at: push_warning (./core/variant/variant_utility.cpp:925)

I think i actually found out, it might not be a bug, but using spray paint is completely different compared to the normal paint, where using it makes it into some sort of 0-strength mark that can be instantly written over by other sprayed textures, making them not blend with each other.
the only way to have a permanent  one is to first use the paint brush and then detail that base with the spray of another texture, they'll blend unlike two sprays.
If this is not a bug but a feature then consider this issue closed.

This system uses two textures, a base layer and an overlay texture. Paint does the base layer, spray does the overlay texture. You can only blend two textures in any given control map pixel (aka terrain vertex). When you spray, you replace the overlay texture, regardless of opacity.
Blending does work fine and can look natural. The challenge is you don't know how the tools work, I haven't yet made a tutorial video, and you don't have an intuitive sense of painting with them yet. The technique you should use is:

Paint in large swathes first. Mountains, grass, paths, and variant textures.
Spray the edges to blend to hide lines and seams

Also see #243


reactivate bugfix in git flow tab completion

This LGTM but I'm not a git flow user.  @dahlbyk ?

Thanks!

you're welcome :)
Thanks for posh-git!


Color flash

wondering if you could make a flash where instead of flashing the transparency, it would flash to a certain color instead. thanks

hi! unfortunately, changing the color is not as easy as changing the alpha of a window. but i would like to investigate the possibility of shader support, which means that color changes would be possible (along with some other cool effects)!

That would be really cool! thanks for your time and response


Wrong error message in case all API tokens have been removed

Hi, I've found issue with very rare repro steps, but I believe it should be fixed due to server returns correct response.
Environment:
$ appcenter -v
appcenter version 1.0.5

Repro steps:

appcenter login
go to the https://appcenter.ms/settings/apitokens and remove appcenter-cli token
appcenter tokens list or another command that requires authorization

Actual:
Error: Command 'tokens list' failed with exception "apiTokensResponse.result.map is not a function"
Expected:
Error: Command 'appcenter tokens list' requires a logged in user. Use the 'appcenter login' command to log in.

Hey @sergey-akhalkov, thanks for calling this out and the clear repro steps. I repro-ed and received the response Error: Command token list not found. The error message can be clearer and improved on. We've taken the feedback and will update again when this is fixed.


Confusion about additionalManifestEntries

Library Affected:
workbox-webpack-plugin 5.1.3
Browser & Platform:
All browsers
Issue or Feature Request Description:
I have some JSON assets, part of my create-react-app-and-ejected public directory, that are copied into my web directory. Since some of these are needed for the software to run, I'd like to precache them with Workbox. I'm using InjectManifest, so additionalManifestEntries seemed like a good approach to doing this. However, I'm having some problems:

If I pass an array of strings, I get a warning:

Some items were passed to additionalManifestEntries without revisioning info. This is generally NOT safe. Learn more at https://bit.ly/wb-precache.

However, if I look at the generated service worker, the entries include revisions (presumably generated by InjectManifest), so it actually is safe, and the warning is incorrect?

The docs state that the revision property is optional, so I tried passing objects with just a url property, in hopes of silencing the warning. However, that fails:

Please check your InjectManifest plugin configuration: child "additionalManifestEntries" fails because ["additionalManifestEntries" at position 0 does not match any of the allowed types]

I saw where the schema requires the revision property; can either the docs or schema be updated to clarify "required but may be null" versus "optional" (which I assumed meant "could be omitted")?

The behavior described in item 1 - where workbox-webpack-plugin adds entries to the manifest and generates revision hashes for them itself - is what I want, but I see in the docs that passing an array of strings is deprecated and will no longer be supported in Workbox v6. Is there a supported way of getting the behavior that I want? Or is additionalManifestEntries not the correct way of doing this?

Thank you.

Apologies for the confusion. We've been a bit wishy-washy about enforcing the presence of the revision property over time; the current idea is that it should always be present, but can be set to null to explicitly indicate that the URL itself includes revision information (in the form of a hash, etc.).
I'll make sure our docs are updated for v6 to reflect that.
In terms of the easiest approach for your use case, using copy-webpack-plugin to turn your files that exist on disk into webpack assets is probably the easiest approach. workbox-webpack-plugin will just include them in your normally generated precache manifest in that case.

Where can I file a PR on this issue?
It took me quite a while to figure out that the documentation is wrong and the revision property isn't optional as stated.
https://developers.google.com/web/tools/workbox/reference-docs/latest/module-workbox-build#.ManifestEntry

Sorry, again. I've filed https://github.com/GoogleChrome/workbox/compare/revision-jsdoc-fix


Add shuffle_custom method to Array

Alternative to #64318
Adds void Array::shuffle_custom(const Callable &p_callable),
where p_callable is random number generating method
Pros:

shuffle_custom is called upon object to be modified (easier to reason about, makes codebase a bit cleaner)
User can in theory provide their implementation of custom method

Cons:

There is no checking for validity of passed custom method (as in Array::all)
User is responsible to init any state of this custom method himself

Example:
func _ready():
    var arr = [1, 2, 3, 4, 5, 6, 7]
    var rng = RandomNumberGenerator.new()
    rng.seed = hash("Level_01")
    arr.shuffle_custom(rng.randi)
    print(arr) # Always prints [2, 3, 4, 7, 5, 1, 6] for the given seed

To me it woulld make more sense to name this method `shuffle()| and making the Callable optional but I don't know if it's even possible. This is pretty nice still for consistent RNG outputs.

@Mickeon

making the Callable optional

In my opinion, it is not possible due to header dependencies (at least that's what I tried) and it's the reason methods like Array::sort and Array::bsearch have _custom counterparts

The code duplication between Array::shuffle and Array::Array::shuffle_custom could be potentially resolved if there is a way to cast Math::rand to Callable type or the other way around: the Callable object to a C++ function pointer.
But I have no idea how to do it

if there is a way to cast Math::rand

Maybe with callable_mp()? Not sure if it supports non-Objects though.

@KoBeWi
As I can see from the source code, callable_mp only applies to instances and non-static methods, and Math::rand is static

Actually you can do something like:
if (p_callable.is_null()) {
retv = Math::rand()
} else {
p_callable.callp()
}

i.e. if callable is invalid, use a default method.

And that's what I've already tried to do. If p_callable becomes optional, it should have some default value (like const Callable &p_callable = Callable()), which is not possible due to header files dependencies.
Anyway, maybe having two separate methods is not such a big issue for consistency with other code.
See https://github.com/godotengine/godot/pull/64716#issuecomment-1222462930

It could work if you added an internal method (not exposed) that requires the callable, but it's called either with the callable provided by user or an empty callable from another method. You'd still have 2 methods, but at least avoid the code duplication.
void internal_shuffle(callable) { my above snippet }
void shuffle1() { internal_shuffle(Callable()) }
void shuffle2(callable) { internal_shuffle(calalble) }

It could work if you added an internal method

Thanks for suggestion, I've done a PR update


Decorating Null Objects

Lately I've changed how I decorate associations from this:
decorates_association :something

to this:
def something
  SomethingDecorator.new object.try(:something)
end

So I can use decorators as Null Objects in the view.
I wanted to ask if there were "best practices" related to this pattern, some design
problem I can't see with this approach or even if there was interest in an option like decorates_association :something, null_object: true, but then I found this
commit which implies some kind of issue with this usage.
Any thoughts about it? Thanks!

Seems just fine to me!


WxWidgets 3.2.3 released

@generalloki,
I don't know impact but I think it would be interesting to try an update with this release 3.2.3.
Other point, .NET8.0 first official release will be available soon. I have try RC1 with windows and Linux. All seems to be ok : scripts, compile, tests.
With these two components, AlternetUI will be up to date.

@neoxeo, This is great to have new wxWidgets version. It's better to wait about 1-2 month as they can release something like 3.2.31 like it was previously. Also yesterday we have released new build, so wxWidgets update (and also webView update) will be done in the next build. As to net8, I beleive we will fully support it after it's release. It has no sense to use beta.

In 0.9.405

Updated webview to <IP_ADDRESS>5.28.
Updated wxWidgets to 3.2.3.

So I am closing this issue.

@generalloki
Thanks a lot for this update.
If you have an old version installed of webview and wxWidgets, version 3.2.3 is not downloaded by install.bat or install.sh.
It would be a good thing to control version of wxWidgets. You can use "version-script.in" file to check this and download automatically the good version of wxWidgets it is not up-to-date.

@generalloki
I have a warning message when I use install.sh :

I don't remember if I have it before and if I have it with Windows

@neoxeo 👍 Many thanks for the report!

Webkit warning: I have seen this. You can run Install.Scripts\Ubuntu.Install.Packages.sh
in order to install required packages (including webkit2gtk-4.1) and this warning will not be shown.

In order to download latest version, just delete \External\WxWidgets\ folder
and latest supported wxWidgets will be installed when Install.sh or Install.bat is runned.
I doubt we will change anything related to the installation in the near future as there are many
more imported issues to fix/improve.


wamp/protocol.py, _swallow_error; self.log appears to be None

#[... an uncaught exception in my own code]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/autobahn/wamp/protocol.py", line 430, in _swallow_error
    self.onUserError(fail, msg)
  File "/usr/lib/python3.6/site-packages/autobahn/wamp/protocol.py", line 411, in onUserError
    self.log.error(
AttributeError: 'NoneType' object has no attribute 'error'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.6/asyncio/events.py", line 126, in _run
    self._callback(*self._args)
  File "/usr/lib/python3.6/site-packages/txaio/aio.py", line 392, in done
    errback(create_failure())
  File "/usr/lib/python3.6/site-packages/autobahn/wamp/protocol.py", line 624, in _error
    return self._swallow_error(e, errmsg)
  File "/usr/lib/python3.6/site-packages/autobahn/wamp/protocol.py", line 432, in _swallow_error
    self.log.error(
AttributeError: 'NoneType' object has no attribute 'error'

my object is created as:
from autobahn.asyncio.wamp   import ApplicationSession
from autobahn.asyncio.wamp   import ApplicationRunner

class _Component(ApplicationSession):
    log   = None
    _ldap = None
    cache = {}
    topic_subscribers = {}

    @asyncio.coroutine
    def meta_on_join(self, details, b):
        print('meta_on_join {}, details: {}'.format(b, details))
[...]

def make(config):
    return _Component(config)

if __name__ == '__main__':
[...]
    runner = ApplicationRunner(
        url=irl,
        realm="smvfd",
        extra={'authid':'provider', 'cfg':cfg})

    runner.run(make)

I think it's because you're overriding the "log" class-attribute that ApplicationSession uses https://github.com/crossbario/autobahn-python/blob/master/autobahn/twisted/wamp.py#L86

@FirefighterBlu3 yeah, you are setting log = None, @meejah is right


Add token expiration management.

Late child of interview session.
This version is just a scratch; should be developed with some management of expired tokens (more than just raising an exception).

Ok, although I have added freezegun to requirements-test.txt, the builed apparently doesn't seem to install it. I'm not sure what to do with it - this version of code works both on python2.7 and 3.4 (it doesn't work on python 2.6 since django uses syntax from python2.7). Can someone check the Travis CI builder?


[FEATURE REQUEST] Add data parameter to heat map functions

Description

A data parameter would contain an earlier snapshot of the archive as a Pandas dataframe. This parameter would allow one to plot an earlier version of the archive -- this is useful if one has multiple snapshots of an archive lying around and wants to plot heatmaps of them after the fact.

This was already completed some time ago; the heatmap functions have a df parameter nowadays.


style imprint page

Fix #24

@gplssm Yes, it looks better like that! But headings tags are not used for styling but for structuring the page. Their parent element (Imprint title) is a
 and therefore it would not make sense to have a child element having a
. I can see now that imprint.md is free from HTML. Is it possible to add a CSS class to the elements you put into
 so I can style them?

Thanks for clarifying!
We are free to mix HTML and markdown in  the .mdfile. So, as example, please just replace
#### Reiner Lemoine Institut gGmbH

by

Reiner Lemoine Institut gGmbH

Like in the last line of the file

I updated the document. Is that ok for you like that? If so, you can merge :)


RS interop without Take

The Subscriber implementation in RS interop currently uses a Queue of Take, resulting in a lot of short lives objects created.

#661


Would it be possible to add the Manhattan distance (L1) option when drawing Voronoi diagram?

As far as I can tell, scipy.spatial uses the Euclidean (L2) metric for all the calculations. Would it be possible to add a feature that enables user to choose which distance (L1 or L2 or possibly other?) they want to calculate and then visualize? I believe that it would be really helpful and as far as I can tell there is no easy way to do it at the moment.
Below a simple sketch of L2 vs L1 metrics (from https://freakonometrics.hypotheses.org/19156):

I don't see the option from a quick scan of the Qhull Voronoi docs (we use Qhull as our backend for Voronoi).
That doesn't mean we couldn't do it, but if the option doesn't exist, it may take a bit more work. Interesting idea I think.


logs: faster and more correct JSON format

This PR builds a custom formatter for JSON logs. We already have a custom formatter for plaintext logs.
Benefits:

Fast. With the same workload, this allocates 100mb while the old one was allocating 260mb, and has a ~20% improvement on throughput of requests.
Correct. The old one had bugs that impacted us a lot (https://github.com/tokio-rs/tracing/issues/2973) and didn't follow the same format as the rest of Istio.
Consistent. Same format used in the rest of istion

Before:
{
  "bytes_recv": 22,
  "bytes_sent": 11,
  "direction": "outbound",
  "dst.addr": "<IP_ADDRESS>:8080",
  "dst.namespace": "default",
  "dst.workload": "server",
  "duration": "1ms",
  "level": "INFO",
  "message": "connection complete",
  "span": {
    "id": "22a77cebe3297cdc0b93bc10f12c4100",
    "name": "outbound"
  },
  "spans": [
    {
      "name": "proxy",
      "uid": "cluster1//v1/Pod/default/client"
    },
    {
      "id": "22a77cebe3297cdc0b93bc10f12c4100",
      "name": "outbound"
    }
  ],
  "src.addr": "<IP_ADDRESS>:60364",
  "src.namespace": "default",
  "src.workload": "client",
  "target": "access",
  "timestamp": "2024-05-17T18:59:01.742549Z"
}

After:
{
  "bytes_recv": 22,
  "bytes_sent": 11,
  "direction": "outbound",
  "dst.addr": "<IP_ADDRESS>:8080",
  "dst.namespace": "default",
  "dst.workload": "server",
  "duration": "0ms",
  "level": "info",
  "message": "connection complete",
  "scope": "access",
  "src.addr": "<IP_ADDRESS>:52968",
  "src.namespace": "default",
  "src.workload": "client",
  "time": "2024-05-17T18:59:37.481338Z"
}

(An obvious concern looking at above is: we lost data; we didn't, that data was supposed to not be logged. When we actually do wanted nested spans logged they still are)

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

@howardjohn: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name
Commit
Details
Required
Rerun command

test_ztunnel
e8db16c0f5791a4501f6ba31eb4f4a4470d9c2b3
link
true
/test test

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

In response to a cherrypick label: new pull request created: #1073


aws-core: avoid double-free in classes that use AWSProfileConfigLoader

AWSProfileConfigLoader is a base class from which several other classes are derived, and it is also employed
within ConfigAndCredentialsCacheManager.
If there is any chance of these related classes running its destructor twice (such as fixed by #2108),  a double-free of the m_profiles map results, causing a crash (an example trace is shown in #1851).
Avoid the possibility of a double-free by clearing the m_profiles map on destruction.
Issue #, if available:
Resolves #1850.
Check all that applies:

[X] Did a review by yourself.
[ ] Added proper tests to cover this PR. (If tests are not applicable, explain.)
Please refer to #1850 - this was tested to address the described condition.
[X] Checked if this PR is a breaking (APIs have been changed) change.
[X] Checked if this PR will not introduce cross-platform inconsistent behavior.
[] Checked if this PR would require a ReadMe/Wiki update.

Check which platforms you have built SDK on to verify the correctness of this PR.

[ ] Linux
[ ] Windows
[ ] Android
[ ] MacOS
[ ] IOS
[ ] Other Platforms

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

@jmklix -  I have rebased this PR and rephrased the description. @SergeyRyabinin fixed the bigger cause in #2108; this PR still provides a fix to avoid crashing for any situation where a constructor may be called twice.


Some of the CannedAccessControlList values throw error

Description
From Jenkins instance, using withAws and s3Upload command some of the CannedAccessControlList values throws error and some not.
Steps to Reproduce

Configure credentials in Jenkins like this
Include the following code:

        withAWS(region: 'us-west-2', credentials: 's3cred') {
            //s3Upload(bucket: 'jesusgc1', path: "folder1/", path: "build/$version/bundles", workingDir: 'web/bundles', includePathPattern: '**/*', acl: 'PublicRead')
            s3Upload(bucket: 'jesusgc1', path: "folder1", workingDir: 'web/vendor', includePathPattern: 'system*', acl: 'AwsExecRead')
            //s3Upload(bucket: 'jesusgc1', path: "build/$version/bundles", workingDir: 'web/bundles', includePathPattern: '**/*', acl: 'PublicRead')
            awsIdentity()
            s3Download(file: 'africa.jpg', bucket: 'jesusgc1', path: '/')
        }

Depending on acl parameter it works or not. I tried for all of the values and here are the results.
It works: Private, LogDeliveryWrite, BucketOwnerRead, BucketOwnerFullControl, AwsExecRead
And it does not work for: PublicRead, PublicReadWrite, AuthenticatedRead

When it throws error, it is this:
com.amazonaws.services.s3.model.AmazonS3Exception: Access Denied (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Request ID: <code-removed>; S3 Extended Request ID: <code-removed>), S3 Extended Request ID: <code-removed>
	at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1712)
	at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1367)
	at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1113)
	at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:770)
	at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:744)
	at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:726)
	at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:686)
	at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:668)
	at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:532)
	at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:512)
	at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4920)
	at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4866)
	at com.amazonaws.services.s3.AmazonS3Client.access$300(AmazonS3Client.java:389)
	at com.amazonaws.services.s3.AmazonS3Client$PutObjectStrategy.invokeServiceCall(AmazonS3Client.java:5800)
	at com.amazonaws.services.s3.AmazonS3Client.uploadObject(AmazonS3Client.java:1789)
	at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1749)
	at com.amazonaws.services.s3.transfer.internal.UploadCallable.uploadInOneChunk(UploadCallable.java:131)
	at com.amazonaws.services.s3.transfer.internal.UploadCallable.call(UploadCallable.java:123)
	at com.amazonaws.services.s3.transfer.internal.UploadMonitor.call(UploadMonitor.java:143)
	at com.amazonaws.services.s3.transfer.internal.UploadMonitor.call(UploadMonitor.java:48)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

Expected behavior: To work for all of them
Actual behavior: acl parameter throws error on some cases
Environment
Jenkins-Version: 2.176.1
Java-Version: openjdk version "1.8.0_212" OpenJDK Runtime Environment (build 1.8.0_212-b04) OpenJDK 64-Bit Server VM (build 25.212-b04, mixed mode)
Plugin-Version: 1.37
Master/Slave Setup: only master

I've just encountered same issue when trying to send s3Upload request with acl:'PublicRead' param.
As I found out that appeared due to insufficient policies of my S3 account. I needed to put "s3:PutObjectAcl" within Statement.Action. Now my user's policy looks following way:
{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Effect": "Allow",
            "Action": [
                "s3:PutObject",
                "s3:GetObject",
                "s3:DeleteObject",
                "s3:PutObjectAcl"
            ],
            "Resource": [
                "arn:aws:s3:::my_resource*"
            ]
        }
    ]
}

        "Action": [

Anything else you can think of that would cause this? I have the PutObjectAcl action but it's still failing for me

I've just encountered same issue when trying to send s3Upload request with acl:'PublicRead' param.
As I found out that appeared due to insufficient policies of my S3 account. I needed to put "s3:PutObjectAcl" within Statement.Action. Now my user's policy looks following way:
{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Effect": "Allow",
            "Action": [
                "s3:PutObject",
                "s3:GetObject",
                "s3:DeleteObject",
                "s3:PutObjectAcl"
            ],
            "Resource": [
                "arn:aws:s3:::my_resource*"
            ]
        }
    ]
}

Anything else you can think of that would cause this? I have the PutObjectAcl action but it's still failing for me

Did you try looking into CloudTrail to see which actions fail? But this might be a DataAPI call so you would have to activate this first.

I forgot I had posted here! The actual problem was that when I set up the bucket I had chosen the policy that disallows future public items from being added. This setting when creating a bucket prevented future public items.


make firmware fails with Arch Linux default arm-none-eabi-gcc + arm-none-eabi-newlib

More precisely the linkage fails:
[...]
/usr/lib/gcc/arm-none-eabi/12.1.0/../../../../arm-none-eabi/bin/ld: CMakeFiles/firmware.dir/firmware.cpp.obj: in function `std::_Vector_base<unsigned long, std::allocator<unsigned long> >::_M_allocate(unsigned int) [clone .isra.0]':
firmware.cpp:(.text._ZNSt12_Vector_baseImSaImEE11_M_allocateEj.isra.0+0x10): undefined reference to `std::__throw_bad_array_new_length()'
/usr/lib/gcc/arm-none-eabi/12.1.0/../../../../arm-none-eabi/bin/ld: /tmp/ccWLFRW6.ltrans2.ltrans.o: in function `std::_Vector_base<void*, std::allocator<void*> >::_M_allocate(unsigned int) [clone .isra.0]':
<artificial>:(.text._ZNSt12_Vector_baseIPvSaIS0_EE11_M_allocateEj.isra.0+0x10): undefined reference to `std::__throw_bad_array_new_length()'
collect2: error: ld returned 1 exit status
make[3]: *** [firmware/CMakeFiles/firmware.dir/build.make:317: firmware/firmware.elf] Error 1
make[2]: *** [CMakeFiles/Makefile2:2788: firmware/CMakeFiles/firmware.dir/all] Error 2
make[1]: *** [CMakeFiles/Makefile2:2795: firmware/CMakeFiles/firmware.dir/rule] Error 2
make: *** [Makefile:1138: firmware] Error 2

A quick search suggests this might be connected to GCC v11+, e.g. [1]
My installed packages:
$ pacman -Qs arm-none-eabi
local/arm-none-eabi-binutils 2.38-1
    A set of programs to assemble and manipulate binary and object files for the ARM EABI (bare-metal) target
local/arm-none-eabi-gcc 12.1.0-1
    The GNU Compiler Collection - cross compiler for ARM EABI (bare-metal) target
local/arm-none-eabi-gdb 12.1-1
    The GNU Debugger for the ARM EABI (bare-metal) target
local/arm-none-eabi-newlib <IP_ADDRESS>11231-1
    A C standard library implementation intended for use on embedded systems (ARM bare metal)

I just tested the official precompiled toolchains gcc-arm-none-eabi-10.3-2021.10-x86_64-linux.tar.bz2 and gcc-arm-11.2-2022.02-aarch64-arm-none-linux-gnueabihf.tar.xz
I had the same issue with version 11.2, but not with 10.3. Anyone experienced the same?

Yeah, I've run into this... It's probably our custom prebuilt stdlibs being a bit too outdated for GCC 11+.

Ow that make sense. Shouldn't that documented somewhere? Or better yet, the stdlibs updated? I spent like 2 hours doubting myself 🤣

stdlibs updated in #788, appears to build fine with GCC 8-12


Remote pipeline set to 'Specify at the time of release creation'

Hi There
I have a remote pipeline where I need to specify the build at release time and would like to trigger this one as well.
I tried and it fails with the message 'Cannot retrieve the default version for artifact 'Release' because default version type is 'selectDuringReleaseCreationType'.
Is there currently a way to pass this value or get the remote pipeline to show the prompt to select?
Thanks
Jacques

No this isn't possible at this moment. I will label your question as a feature request


fix panic when empty line in FEAT response

This is a cherry-pick of another PR that was not followed up on: https://github.com/secsy/goftp/pull/19/commits/86961aef897e1ef547741c6c60928797b39803b0
Tested with a server that returns an empty line on FEAT command: https://github.com/goftp/server

Can you add a test case for this? You can stub out response values using config.stubResponses

No problem, it's done. Tell me if you need anything else.


Deploy on platform other than Azure App Service Plan?

Please provide us with the following information:

This issue is for a: (mark with an x)
- [ ] bug report -> please search issues before submitting
- [x] feature request
- [ ] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)

Minimal steps to reproduce

Any log messages given by the failure

Expected/desired behavior

Hi, how do i deploy this application on a different platform? is it even possible to run this application without using azure app service plan?

Thank You
OS and Version?

Windows 7, 8 or 10. Linux (which distribution). macOS (Yosemite? El Capitan? Sierra?)

azd version?

run azd version and copy paste here.

Versions

Mention any other details that might be useful

Thanks! We'll be in touch soon.

Yes, it is possible, as I have deployed it to Azure Container Apps. You just need an environment which can run Python. Is there a specific platform you're hoping to deploy on?

Yes, it is possible, as I have deployed it to Azure Container Apps. You just need an environment which can run Python. Is there a specific platform you're hoping to deploy on?

Thanks for the reply, our organization have an internal platform to deploy application, what i did was using "azd package" created a build file and turn that build file into a tar.gz file which we use to deploy apps, this is the error that i got

We now formally support deployment to Azure Container Apps:
https://github.com/Azure-Samples/azure-search-openai-demo/releases/tag/2024-09-19


Setting spline order and kinematic constraints

Hi dr. Tonola,
I am writing you again to ask two more simple questions. First one is related to setting a spline order for a trajectory time parameterization/interpolation. I tried to set it here, and 3rd and 4th spline orders are OK, but 5th spline order does not seem to work properly (I think so), because the robot always instantly reaches the goal (even I have tried many different goal configurations and reducing scaling factor).
The second question is about kinematic constraints. As much as I could see, your approach (MARS) satisfies maximal velocity constraint for each robot's joint, yet does not satisfy maximal acceleration and jerk constraints. Can your approach incorporate all kinematic constraints or only maximal velocity constraint for a trajectory interpolation? I have tried setting has_acceleration_limits to true for each robot's joint, but it does not take any effect.
Thanks in advance for your kindness help.
Nermin

Hi,

The spline order can be set as follows: 0 for continuous positions, 1 for continuous velocities, 2 for continuous accelerations, 3 for continuous jerks, or 4 for continuous snaps. We are using this library for spline interpolation. Thanks for pointing out the issue; I’ll work on clarifying it further.

MARS does not handle time parameterization directly. It generates a path, after which the replanner manager computes the time parameterization, as seen in this line. This process is consistent across all replanners in the library. We rely on existing MoveIt libraries for time parameterization, which, as far as I know, take acceleration constraints into account when specified. However, splines between waypoints are calculated without explicitly considering these constraints. They are computed once defined the spline order and the position, velocity, acceleration, etc., at the waypoints as determined by the time parameterization. Although I haven’t encountered this issue personally, maybe it is possible for the spline to exceed the constraints if the initial and final waypoints are already near the limits. I have not investigated this yet.

I hope this can help you.

Yes, your answer is useful. Thank you very much!


Can't add_field %{host} for udp

bug / inconsistency: For the config below:

TCP adds a field with the IP address, eg { ... "logHost" => "<IP_ADDRESS>" }
UDP adds the literal "%{host}", eg { ... "logHost" -> "%{host}" }

input {
  tcp {
    port => "514"
    add_field => {
        "logHost" => "%{host}"
    }
  }
  udp {
    port => "514"
    add_field => {
        "logHost" => "%{host}"
    }
  }
}

I add this field to make auditing / monitoring logging coverage easier.
The fix is simple, decorate is being called before event["host"] is being set.
patch.txt

This issue seems to be fixed: https://github.com/logstash-plugins/logstash-input-udp/blob/master/lib/logstash/inputs/udp.rb#L120
Can be closed?

I have just retested with 5.6.5 as was upgrading and the problem persists.
The issues is not that host does not exist after input it is that it does not exist when add field is called.


Loading...

What do you see in F12 in the browser?

try a npm install from the command line
Do a Webpack development build

Should work.
If not post the console messages,
Greetings Damien

I get nothing in the console when I did F12...
Actually I forget to install webpack task runner...
Thanks Damien

cool, have fun

👍 👍 👍


Add files we need for workflows to this repository

I think it would be good if we could add all necessary files to run the workflows to
this repository, so that it is standalone.
What we would need:

[x]  the barrel correction file: I don't see an issue adding this
[ ] the pytorch model: I don't see an issue adding this
[ ] the stardist model: In principle no issue to add it, but we should check with @maweigert that this is ok (of course giving the proper references)
[ ] the ilastik projectsl: In principle no issue, but right now we need to embed the data in the project, we should wait till that is fixed before adding it, see also https://github.com/ilastik/ilastik/pull/2232
[x] test images

cc @imagirom @lorenzocerrone @wolny @Steffen-Wolf

I have added a few test images now after checking in with Vibor that this is ok.

And @imagirom has also added the new barrel correction file already.

Also added the stardist models with permission from Martin now.

Added the pytorch model for foreground / boundary prediction now

Everything but the ilastik models has been added.
We will not use this in production anyways, so I am closing this.


Add link to frontend in popup

Per #628, we want to show a link to the Penumbra frontend of the user's choice. By default, the Penumbra frontend is app.testnet.penumbra.zone (AKA the first pre-filled "known site"). Any
In this PR

Rename NetworksPopover to Network (seems that the previous name was a holdover from previous functionality it had), and give it the capability of rendering a link to the frontend.
Refactor <SettingsConnectedSites /> to break it up into smaller components.
Significantly refactor how the ConnectedSites slice works in the extension. Previously, Zustand actions were saving data in denormalized ways, presumably to cache their results. This may have been to avoid unnecessary re-renders. However, this is no longer necessary now that we're using Zustand selectors properly (via, e.g., useStoreShallow()). Now, all derived data is calculated via selectors and helper functions.
Convert Tailwind config to TypeScript so it can be used in JS via the new RESOLVED_TAILWIND_CONFIG const.

Punting for now

At the moment, despite app.testnet.penumbra.zone being a prefilled "known site", navigating to https://app.testnet.penumbra.zone/ still shows the "Connect" UI:

Not sure why this is, but it's a pre-existing bug, so I didn't address it in this PR.
UPDATE: Looks like there's already a ticket for this: https://github.com/penumbra-zone/web/issues/866

Closes #628

If a user deletes a site marked as the primary Penumbra frontend, they still continue to go to that site when they click on the network.
This sounds like a bug, but at the same time the solution options seem bad

block deletion of a site that is marked as primary
automatically set a new primary from the list of sites that remain

@Valentine1898

If a user deletes a site marked as the primary Penumbra frontend, they still continue to go to that site when they click on the network.

Great catch — didn't think of that. I just pushed up a commit to automatically pick the first remaining known site as the primary frontend if the currently selected one gets deleted. I actually think that's a fine way to handle that — not a bad solution.