Python: Bug: Missing "status" field in Python dynamic session plugin responses causes LLM misinterpretation of execution failures

Describe the bug
When using the Python dynamic sessions plugin as a tool for LLMs, the execution response from the API includes an explicit "status" field, but this is not included by the plugin when building the string response to the LLM.
Specifically: while the HTTP POST request status code is OK, code execution response contains an explicit status property in the response body that can be "Failure" (vs "Success").
Because this is missing from the plugin result, the LLM must infer success or failure based on the presence of stderr content. This can lead the LLM to misinterpret certain exceptional scenarios as ongoing or partial success instead of failure. As a result, the LLM may hallucinate follow-up steps, enter unnecessary retry loops, or otherwise produce incorrect responses.
To Reproduce
This is a bit involved since we must set up a tool-calling agent and specifically trigger a code execution failure. That said this scenario reliably produces it for me.
Set up a Python dynamic session and upload a CSV file to the session’s container. For example, create a sample-data.csv file with random data:
import pandas as pd
import numpy as np

N = 100
data = {
    "fiscal_period": np.random.randint(202401, 202412, N),
    "shipping_zipcode": np.random.randint(10000, 99999, N),
    "gross_profit": np.random.uniform(200, 10000, N)
}

df = pd.DataFrame(data)
df.to_csv("sample-data.csv", index=False)

Prompt the LLM through the tool to execute Python code that will intentionally fail, for example by including a deprecated library or code snippet that won’t run:
Create a heat map of gross profit on a map of the United States. Use the file at /mnt/data/sample-data.csv.

Include this snippet of code to load the map details at the beginning:
import matplotlib.pyplot as plt
import geopandas as gpd

# Load US states shapefile
world = gpd.read_file(gpd.datasets.get_path("naturalearth_lowres"))

Observe the tool’s execution result. The response includes:
Result:
null
Stdout:
""

Stderr:
"Matplotlib is building the font cache; this may take a moment"

Note that the LLM misinterprets this scenario as ongoing success, repeatedly attempting to continue execution or retry.
Expected behavior
When the interpreter fails, the returned response should include the status field from the response body. With this explicit status, the LLM recognizes the error immediately and will not enter a loop of retries or produce hallucinated follow-ups. Instead, it can gracefully handle the failure scenario.
Screenshots
N/A
Platform

OS: Any
IDE: Any
Language: Any
Source: latest as of filing (1.17.0)

Additional context

I will submit a PR to the dotnet implementation that adds the status property to the returned string. If accepted, I am also willing to submit similar PRs for other languages and integrations.

@markwallace-microsoft this isn't a bug in the Python codebase specifically, rather a bug in the python dynamic sessions plugin which is present in various languages and integrations (eg langchain).

Thanks for filing the issue and for working on the fix, @malandis. We'll have the .Net team review your PR soon!

@moonbox3 sounds good. Once we align on the problem/fix, I can port to other languages/integrations 👍

@moonbox3 sounds good. Once we align on the problem/fix, I can port to other languages/integrations 👍

Looks like you've provided the fix. When I first created the Python plugin, I don't remember there being a "status" property in the result -- I wonder if it was added recently. I've made the similar fix in #9904. Thanks for your help!


Avoid using relative imports

I'm getting issues with pyairtable:

I noticed that relative imports are being used, which seems to be the root of the issue in my case. Relative imports should be avoided in packages:

Relative imports for intra-package imports are highly discouraged. Always use the absolute package path for all imports. Even now that PEP 328 is fully implemented in Python 2.5, its style of explicit relative imports is actively discouraged; absolute imports are more portable and usually more readable.

https://github.com/gtalarico/pyairtable/blob/34eb78e5b7b9a348dcf82dd23e53abc611b67e31/pyairtable/__init__.py#L3-L6

I'm experiencing the same issue, scripts are failing as a result

The same for me

Thanks for the report! This is the same as #411, a bug in pydantic 2.10.0 and 2.10.1. It was fixed in pydantic 2.10.2. Relative imports are discouraged (and I'll cut a branch to fix them) but they're a red herring here.
Try pinning your project's dependencies to either pydantic>=2,<2.10 or pydantic>=2.10.2,<3. If you still get that error, a minimal code snippet that reproduces the problem would help a lot.


Semi-final phase

The semi final phase will end on March 8 2021 and we will be competing on set B of instances. Are we allowed/requested to send a new version of the program before that deadline?
Thanks

Dear competitors,
Please refer to the dedicated web page : https://www.roadef.org/challenge/2020/en/calendrier.php
New contribution are to be sent before March 16th 2021.

Great, thanks. What is the protocol for the submission? The same protocol used for the qualification phase but changing the subject to "ROADEF/EURO challenge 2020 semi final material from XX"?


replace method for opening pickle files

Following multiple issues coming from different cities where local tests are passing and the ones on Kitt are failing for some of the students.
According to this thread you can't read a pickle file created with a different pandas version using pickle.load. I replaced the method to pd.read_pickle which is meant to solve the issue.
Tested locally with my own notebooks, everything runs well but it would be great if you cross checked it before we update entire package for the Data program.
What would be the procedure after? Post on data-teachers to ask students to update the nbresult? Send an automated message to all running batches?

I'm gonna test it before deploying the new release. The other problem is the pandas dependency.


Package mtdowling/cron-expression is abandoned

Hello
On update the following message appears:
Package mtdowling/cron-expression is abandoned, you should avoid using it. Use dragonmantank/cron-expression instead.
May you can just replace the required package @tyler-ham

It should not break anything, if you not rely on the bug ;)
There was a big problem though, and that was that this was a huge backward compatibility break. When a bug has survived long enough and people rely on that behavior, it is no longer a bug - it's a feature. So our bad stepping fix has the potentional for breaking a huge number of systems, even if that behavior is bad. People rely on it.
https://ctankersley.com/2017/10/12/cron-expression-update/


VFS-788 - Manifest naming corrections

VFS-788 - Manifest naming corrections like symbolic name, Module-Name etc.

@garydgregory Could you please re-trigger build as some jdk versions tests were failed!


How does MediaPipe manage buffers, is there a buffer queue mechanism?

Thank you for submitting a MediaPipe documentation issue.
The MediaPipe docs are open source! To get involved, read the documentation Contributor Guide
URL(s) with the issue:
Please provide a link to the documentation entry, for example: https://github.com/google/mediapipe/blob/master/docs/solutions/face_mesh.md#models
Description of issue (what needs changing):
Kinds of documentation problems:
Clear description
For example, why should someone use this method? How is it useful?
Correct links
Is the link to the source code correct?
Parameters defined
Are all parameters defined and formatted correctly?
Returns defined
Are return values defined?
Raises listed and defined
Are the errors defined? For example,
Usage example
Is there a usage example?
See the API guide:
on how to write testable usage examples.
Request visuals, if applicable
Are there currently visuals? If not, will it clarify the content?
Submit a pull request?
Are you planning to also submit a pull request to fix the issue? See the docs
https://github.com/google/mediapipe/blob/master/CONTRIBUTING.md

Hi @l1542470446, Could you please provide more details w.r.t the above query. Thanks!


Update api.py

remove client_id from oauth code authorization

Thanks. I must have included that from the change from TD to Schwab and accedentally included that.


Wrong answers when fitting a multivariate normal

Summary:
Please provide a short couple sentence summary.
I am trying to fit a multi-normal distribution.  I try a test case with independent variables and the summary of the rho parameter clusters around the maximum allowed.  It should cluster around zero.
Description:
Describe the issue as clearly as possible.
Here is a script that produces the error
rm(list = ls())      # clear workspace")
library(rstan)

create independent sample

n=50
x1=rnorm(n,0,1)
x2=rnorm(n,0,1)

fit a bivariate normal distribution with stan

Stan script for univariate model

scodeB = "
data{
real rhomax;
real x1[50];
real x2[50];
}
transformed data{
vector[2] X[50];
for (i in 1:50){
X[i][1] <- x1[i];
X[i][2] <- x2[i];
}
}
parameters{
real mu1;
real mu2;
real<lower=0,upper=10> sigsq1;
real<lower=0,upper=10> sigsq2;
real<lower=0,upper=1> r_rho;
}
transformed parameters{
real rho;
rho<-2rhomaxr_rho-rhomax;
}
model {
matrix[2,2] Sigma;
vector[2] Mu;
mu1 ~ uniform(-4,4);
mu2 ~ uniform(-4,4);
sigsq1 ~ uniform(-4,4);
sigsq2 ~ uniform(-4,4);
r_rho ~ beta(2,2);
Mu[1] <- mu1;
Mu[2] <- mu2;
Sigma[1,1] <- sigsq1;
Sigma[1,2] <- rhosqrt(sigsq1sigsq2);
Sigma[2,1] <- Sigma[1,2];
Sigma[2,2] <- sigsq2;
for(i in 1:50){
X[i] ~ multi_normal(Mu,Sigma);
}
}
"
pars.list=c("mu1","mu2","sigsq1","sigsq2","rho")
initB=function(chain_id){
set.seed(12345+chain_id)
list(mu1=runif(1,-1,1),mu2=runif(1,-1,1),
sigsq=runif(1,0,4),r_rho=runif(1,0,1))
}
data.B=list(rhomax = 0.9,
x1 = x1,
x2 = x1)
fitB=stan(model_code=scodeB,data=data.B,seed=12345,init=initB,pars=pars.list,
chains=4,control=list(adapt_delta=0.9),iter=2000)
print(summary(fitB)$summary)
Reproducible Steps:
Please report steps to reproduce the issue. If it's not possible to reproduce, please include a description of how you discovered the issue.
If you have a reproducible example, please include it.
Current Output:
The current output. Knowing what is the current behavior is useful.
Expected Output:
Describe what you expect the output to be. Knowing the correct behavior is also very useful.
Additional Information:
Provide any additional information here.
Current Version:
v2.11.0

I took a second look at the script and comment software messed up the expression for Sigma[1,2]
It should read Sigma[1,2]=rhosqrt(sigsq1sigsq2)

It did it again  rho (times) the square root of (sigsq1 (times) sigsq2)

There's no longer an issue here.  Did you want to close this?  Are you using 2.11 rather than 2.10?

Please close.  There was a bug on my account.
I think it is great that you are on top of this so quickly.
Glenn

On Aug 8, 2016, at 9:48 PM, Bob Carpenter<EMAIL_ADDRESS>wrote:
There's no longer an issue here. Did you want to close this? Are you using 2.11 rather than 2.10?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or mute the thread.


Keyword imported ok and unused imports when include keyword in "Wait Until Keyword Succeeds"

When a keyword of another file ".resource, .roboit" is used in another .robot file and it's included in the keyword "Wait Until Keyword Succeeds", as the next example:
Wait Until Keyword Succeeds    ${timeout}    ${WUKS_DELAY}
...    KEYWORD INHERITED
An error is reported:
Keyword imported ok and unused imports:
actual_file unused import: source_file

Hi, are you sure it's issue for robotidy and not the other tool? Could you present example what your code looked like before & after robotidy formatting and what you expect?

It's true, was a python script to check dependencies... A thousand apologies...


Create license as derived from carpentries

As Github does not support the usage of CC-BY licenses, which seems to me the most appropriate for course material, I adapted the carpentries LICENSE to fit the INBO purpose. @peterdesmet, would this be ok?

GitHub does not offer CC-BY from the dropdown, but does recognize it. See e.g. in Lifewatch blog repo.

Thanks!


get logs for cdi pods on functional test failure

What this PR does / why we need it:
I think when we moved over to the cdi operator/cdi namespace, we forgot to update this (used to install in same namespace as kubevirt).
Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Fixes #
Special notes for your reviewer:
Release note:

NONE

will retrigger Travis: it's green on travis, but in progress here, so I can't merge yet


Ogmios v5.6.0

Codecov Report

Merging #265 (c2b2f83) into main (bc02bd6) will increase coverage by 0.03%.
The diff coverage is 100.00%.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.
@@            Coverage Diff             @@
##             main     #265      +/-   ##
==========================================
+ Coverage   84.97%   85.01%   +0.03%
==========================================
  Files          26       26
  Lines        2982     2983       +1
  Branches      714      715       +1
==========================================
+ Hits         2534     2536       +2
  Misses        336      336
+ Partials      112      111       -1

Impacted Files
Coverage Δ

pycardano/txbuilder.py
90.53% <100.00%> (+0.20%)
:arrow_up:


Polybar displaying rainbow colours and not working

Describe the issue
I can't get polybar to work but I can't find the cause, and I feel like it would be good to get an answer here in case people also get this problem in the future. Many updates have happened since I last used polybar so I don't know if poly has changed or something else. I'm using polybar-git from the AUR.
Expected behavior:
It used to work like in the following screenshot:

Actual behavior:
When I call my script now, it just displays rainbow lines. Here is my script, and this is what happens when I call it:

I've never experienced this before, nor do I know what is causing polybar to do this. Maybe try using my script with my config to see what happens?
Polybar Log
~ ::  master > 3:45:08
$ poly
GL_RENDERER   = GeForce GTX TITAN X/PCIe/SSE2
GL_VERSION    = 4.6.0 NVIDIA 418.56
GL_VENDOR     = NVIDIA Corporation

## Environment:
* WM: BSPWM
* Distro: Arch
* Output of `polybar -vvv`:

~ ::  master > 3:45:51
$ polybar -vvv
polybar 3.3.0-45-g31a25af3

Features: +alsa +curl -i3 +mpd +network(libnl) +pulseaudio +xkeyboard

X extensions: +randr (+monitors) -render -damage -sync +composite +xkb +xrm +xcursor

Build type: RelWithDebInfo
Compiler: /usr/bin/c++
Compiler flags: -march=x86-64 -mtune=generic -O2 -pipe -fno-plt -Wall -Wextra -Werror -Wno-noexcept-type -pedantic -pedantic-errors
Linker flags: -Wl,-O1,--sort-common,--as-needed,-z,relro,-z,now

Thank you

That rainbow image is what displays when you run poly which is not polybar but from mesa-demos. Are you sure you don't run poly by accident?

You are indeed correct, the name of my script was named poly which seems to have been pushed aside by the poly you mentioned. Thank you for the swift reply, I would never have guessed. Hopefully this issue helps someone in the future.


after sucessfully synced Non-k8s configuration, re-run kusion apply command hangs

Bug Report
Please answer these questions before submitting your issue. Thanks!
1. Minimal reproduce step (Required)

apply the configuration in konfig/appops/wordpress/dev as elaborated in #255
after successfully synced the stack, rerun kusion apply command

2. What did you expect to see? (Required)
the kusion apply command produces "all resource reconciled" info
3. What did you see instead (Required)
the command hangs.
here's the log in ~/.kusion/kusion_debug.log:
2023-02-23 16:47:24.184	INFO	i18n/i18n.go:83	Setting language to zh_CN
2023-02-23 16:47:24.190	DEBUG	kcl/kcl_generator.go:53	Compile filenames: []
...
2023-02-23 16:47:24.981	INFO	preview/options.go:150	Start compute preview changes ...
2023-02-23 16:47:24.982	INFO	preview/options.go:169	Start call pc.Preview() ...
2023-02-23 16:47:25.233	INFO	operation/preview.go:87	walking DAG and preview resources ...
2023-02-23 16:47:25.233	DEBUG	graph/resource_node.go:58	execute node:aliyun:alicloud:alicloud_oss_bucket:kusion-oss-amy
2023-02-23 16:47:25.233	DEBUG	graph/resource_node.go:58	execute node:v1:Namespace:wordpress-example
2023-02-23 16:47:25.352	DEBUG	graph/resource_node.go:58	execute node:v1:Secret:wordpress-example:mysql-pass
2023-02-23 16:47:25.470	DEBUG	graph/resource_node.go:58	execute node:v1:Service:wordpress-example:wordpress
2023-02-23 16:47:25.470	DEBUG	graph/resource_node.go:58	execute node:v1:Service:wordpress-example:wordpress-mysql
2023-02-23 16:47:25.674	DEBUG	graph/resource_node.go:58	execute node:apps/v1:Deployment:wordpress-example:wordpress-mysql
2023-02-23 16:47:25.674	DEBUG	graph/resource_node.go:58	execute node:apps/v1:Deployment:wordpress-example:wordpress-deployment
2023-02-23 16:47:27.846	INFO	cmd/cmd.go:163	error fetching latest version information: strconv.ParseUint: parsing "": invalid syntax
2023-02-23 16:49:50.139	INFO	tfops/workspace.go:294	provider hash or version change.

4. What is your KusionStack components version? (Required)

kusion version
releaseVersion: v0.7.3-0.20230208024611-7e20ed24cfbf
gitInfo: {}
buildInfo:
    goVersion: go1.19
    GOOS: darwin
    GOARCH: arm64
    numCPU: 10
    compiler: gc
    buildTime: "2023-02-23 16:55:23"
dependency: {}

@amyXia1994 please check the internet connection of Terraform registry because kusion will download or check updates when executing commands

@amyXia1994 please check the internet connection of Terraform registry because kusion will download or check updates when executing commands

After checking and reproducing this issue with @howieyuen and @markliby, it seems that it has nothing to do with the network but is related to #255 and has been fixed in main branch(not released yet). This case could be added into the End-to-end test of kusion.


Fixing local docker setup configuration for easier e2e dev testing

Summary

Fixing the local setup configuration to help with dev testing.
Added a flag (S3_FORCE_PATH_STYLE) for S3Async client to indicate how to read the buckets.

Requirements

[x] I've read and understood the Contributing Guidelines and have done my best effort to follow them.
[x] I've read and agree to the Code of Conduct.

@zarna1parekh thanks for the contribution! We actually have an existing PR that is currently in draft to completely refactor the object storage. https://github.com/slackhq/astra/pull/1030
This isn't quite ready for review yet, but should be within the next day or two. This completely removes all of the existing blob storage in favor of a more targeted implementation that is both significantly faster, and incrementally cheaper to operate. With the pending refactor we will no longer have these classes targeted by this PR as they're entirely removed.


Improved and extended backend

Integration tests with newman added for all existing routes.

Different test cases for each api-endpoint
Tests are located in docker/newman/collections

Most endpoints documented in the API specification are implemented and tested.

Create/Update/Delete RegistrationState is not implemented yet.
Not documented and implemented yet:

Presence
User Meta

The backend overall has been improved

Meaningful types are used for the data in the returned JSON (e.g. 1 instead of '1')
Fixed several bugs
Fixed a security issue (username in jwt subject)
Added/Fixed validation
Add more expressive HTTP status codes (e.g. 204 No Content)
Created a custom PHP and slim error handler.
Updated several dependencies
Added logging before each returned 500 Internal Server Error

Improved documentation:

Added recommended data types for each api-endpoint
Added missing endpoints to the documentation

Todo:
@Simai00 You have to check for compatibility issues.

Check the api specification for changed data types (e.g. true/false instead of 1/0)
Test and alter the frontend.

Note: I have merged your vuetify branch into this one, bc I wanted to check out the new UI.

Everyone have to do the following tasks:

Delete directory api/vendor
Run docker exec app composer update


NamedQueries generator problems

When generated namequerys since JPAModeler, generated namedquery from attributes deleted in the entity.
Enviroment
Netbean 8.2
glassfish  4.1.1
Hello, when an entity-attribute is deleted in the JPAModeler and you want generate de namedqueries for each entity. In properties entity-Properties -> Query -> Name Queries click the button and raise the window entity-Name Queries in the list of attributes you can select the entity attributes deleted.
I have not the  JPModeler file now but I checked  it

Can you please explain the issue in more details with example and issue generation scenario or with attached JPA Modeler file.

Issue is not much clear and user is unresponsive  but following settings option is related to this issue :
Tools > Options > JPA Modeler > Code > Delete  @NamedQuery on attribute removed


how to pass data

if cell data in left menu view selected, how to pass its related data to right view controller?
assuming there are 5 cells in menu view controller, two of them are related to url, which means if it's been tapped in menu view controller, it will leads to present a web view in right view controller. So need to pass urls to right view controller.
How to get this?
Thanks!

So how would one do this with this menu then? Instead of giving vague answer try to give an example. To be honest it kinda is library issue because of the way it has been designed.
If we are using storyboards, we have to first somehow pass our data to the presented menu and then menu has to pass it to selected view.

Forget about the menu, you just have an options view (presumably a tableview with static cells) and another content view that does changes depending on the triggered events, there's plenty of solutions for this problem and a few of them are listed above already.


Reading the public & private network data

Creating all the fields needed according to the "spec" in https://drive.google.com/drive/folders/1dDyDfGSipguiGCEpwQq2DWM1GqXpBagE
Both public and private are read,
error handling (empty nodevc and node service if they can't be reached)
timeout is 15sx3 for failiure so first time run takes a bit longer.
still issues with the procfile.

replaced by new pull #3


Tabbed compose preview

We have a widget for previewing messages. However, it can be hard to discover, as it's represented by a small "eye" icon surrounded by other icons that insert things into the message.

To make this feature easier to discover and use, we should remove the eye icon and replace it with "Write" and "Preview" tabs in the upper right of the compose box (next to the "x"), similar to the GitHub UI for writing issues.
See also CZO discussion thread.

@zulipbot claim

We're taking a different approach with the compose box redesign.


refactor: simplify configuration handling

PR Checklist

[x] A description of the changes is added to the description of this PR.
[ ] If there is a related issue, make sure it is linked to this PR.
[x] If you've fixed a bug or added code that should be tested, add tests!
[ ] Documentation in docs is updated

Description of changes
Simplify configuration handling by using function callback from click, by defining a config parameter.
This basically allows overriding the map of options with settings from pyproject.toml without the need to explicitly do that after the options are populated, removing the need for the logic in config module. The config parameter that allows that is hidden to not show it in the CLI documentation (but technically, we could also not hide it, if users have to define a custom path to a pyproject.toml). is_eager ensures that the parameter is handle before the other ones.
As can be showcased by the tests in test_cli.py, the order of options overriding is still respected:

Default value is set
Value is overrode by the one set from pyproject.toml, if any
Value is overrode by the one set from the command line, if any

About the switch from lists to tuples, this is done to be more in phase with what click does, since the arguments using multiple are already converted to tuple by click, so we might as well do the same for the comma separated parameters.
Finally, this PR makes the module closer to pleasing mypy.

On main:

$ poetry run mypy .
[...]
Found 42 errors in 13 files (checked 20 source files)

On this PR's branch:

$ poetry run mypy .
[...]
Found 17 errors in 11 files (checked 20 source files)

If this PR is ever merged, I'd be happy to help on the remaining typing errors.
Since the changes in this PR are quite heavy, let me know if you have any question.

Codecov Report

Merging #130 (7bffbb7) into main (94730ba) will decrease coverage by 0.2%.
The diff coverage is 100.0%.

@@           Coverage Diff           @@
##            main    #130     +/-   ##
=======================================
- Coverage   95.1%   94.8%   -0.3%
=======================================
  Files         34      34
  Lines       1291    1171    -120
=======================================
- Hits        1228    1111    -117
+ Misses        63      60      -3

Impacted Files
Coverage Δ

deptry/cli_defaults.py
100.0% <ø> (ø)

tests/test_dependency_specification_detector.py
86.1% <ø> (-0.8%)
:arrow_down:

deptry/config.py
100.0% <100.0%> (+3.7%)
:arrow_up:

deptry/dependency_getter/requirements_txt.py
96.5% <100.0%> (ø)

deptry/issue_finders/misplaced_dev.py
24.3% <100.0%> (ø)

deptry/issue_finders/missing.py
100.0% <100.0%> (ø)

deptry/issue_finders/obsolete.py
97.2% <100.0%> (ø)

deptry/issue_finders/transitive.py
95.8% <100.0%> (ø)

deptry/python_file_finder.py
100.0% <100.0%> (ø)

tests/test_config.py
100.0% <100.0%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

Awesome work, thanks a lot for the contribution! I was unhappy with the config handling - it was a lot of code for very simple operations - but I did not know of a way to improve that.
I took a quick look and learned a lot from your approach of using some of click's additional features. I will take a more detailed look at the proposed changes tomorrow, and merge afterwards!

Really happy with this PR! It simplifies the config handling greatly, I really did not make full use of click's capabilities before...


Fix typo in issue report

Thanks for approval! You'll need to merge it since I don't have write access.

Neither have I :)


feat!: update bberg ACIR parser to target ACVM 0.21.0

Description
Updates the ACIR parser to be compatible with the format outputted by the new nargo nightlies.
bb-bin-tests has been disabled as it tests recursion which is not implemented in the new SSA code (and the existing artifacts are incompatible with the new serialisation logic)
Mirrors https://github.com/AztecProtocol/barretenberg/pull/631
Checklist:

[x] I have reviewed my diff in github, line by line.
[x] Every change is related to the PR description.
[x] I have linked this pull request to the issue(s) that it resolves.
[x] There are no unexpected formatting changes, superfluous debug logs, or commented-out code.
[x] The branch has been merged or rebased against the head of its merge target.
[x] I'm happy for the PR to be merged at the reviewer's next convenience.

Merging master to fix stale l1-contracts tag issue

Thinking aloud: Should we create an issue to reinstate bb-bin-test or is it no longer relevant?

Thinking aloud: Should we create an issue to reinstate bb-bin-test or is it no longer relevant?

I think so

@TomAFrench mind leaving a bread crumb to this around in the commented out CI tasks? https://github.com/AztecProtocol/aztec-packages/issues/1236


Permit pretrained model to be used as baseline

I haven't looked carefully at the training procedure, but it seems like users might want to build off of their previous models without having to put every image they've curated into the same folder.

this will cause overfitting, unless the users have trained a model with many many images in the past, so we do not want to enable this from the GUI

@landoskape Yes they are different, review the paper's description of HITL. In short, the ideal is to train the pretrained model only once with your data. Each time you train using HITL you are adding data and creating a new model that is trained starting from the pretrained weights.
As mentioned, training multiple times will cause overfitting and lose the benefit of the diverse pretrained model.


README.md

README.md
Originally posted by @Ghamz0727 in https://github.com/trimstray/the-book-of-secret-knowledge/pull/400#discussion_r1285138119

README.md
Originally posted by @Ghamz0727 in https://github.com/trimstray/the-book-of-secret-knowledge/pull/400#discussion_r1285138119

Escape d


Do you plan to add refrigerators?

Please think about it. Thank you.

Yes, is in my plan...

ollo69 thank you. If you will needs to test it, I welcome.

For sure I'll need, I don't have LG refrigerator :)

i'm upgrading for refrigerator test.
i bought you another coffe for today for your works.
i have GMJ936NSHV
no refrigerator in my entities.

NOTE: anyway now is LG ThinQ and not SmartThinQ. you renamed the project, for me the best name is "LG-ThinQ". no sensors, no washer, only lg thinq. :) only an advice for future of this wonderful integration. Thanks for your work and i hope this will be integrated officially in Home Assistant integrations.

Probably you are right, anyway from today the components is merged in HACS default, so I will not rename it for the moment, we will see in the future. For the moment was required to remove the word "Washer".

NOTE: anyway now is LG ThinQ and not SmartThinQ. you renamed the project, for me the best name is "LG-ThinQ". no sensors, no washer, only lg thinq. :) only an advice for future of this wonderful integration. Thanks for your work and i hope this will be integrated officially in Home Assistant integrations.

Probably you are right, anyway from today the components is merged in HACS default, so I will not rename it for the moment, we will see in the future. For the moment was important to remove the word "Washer".

of course, restarting hass now the fridge not work.

I have sane issue. After restart HA, sensors without data.

Need debug log to analizy and fix.
You should enable debug log adding this to your configuration.yaml:
logger:
  default: warning
  logs:
    custom_components.smartthinq_sensors: debug

Then let the HA run for 10 minutes and send me the home-assistant.log files to my e-mail<EMAIL_ADDRESS>If you want check before the log file for sensible information (mac-address, e-mail, etc) and remove it.

<EMAIL_ADDRESS>
check your inbox

check your inbox

Did you update to last version (v0.3.1)?
Because I still see the error RefrigeratorStatus' object has no attribute 'run_state that I fixed with last release.
Did you reboot HA after update?

check your inbox

Did you update to last version (v0.3.1)?
Because I still see the error RefrigeratorStatus' object has no attribute 'run_state that I fixed with last release.
Did you reboot HA after update?

updated, same problem.

Please send log after update, thanks

Please send log after update, thanks

done

Now should be ok, please try version 0.3.2.
I still need to add some device attribute, I'll do it later or next days.

Hello,
I install 0.3.2 and get this:
Log Details (WARNING)
Logger: custom_components.smartthinq_sensors
Source: custom_components/smartthinq_sensors/__init__.py:354
First occurred: 7:52:33 PM (2 occurrences)
Last logged: 7:54:35 PM

Status update failed.

I need from you more log, Please enable debug and send me your log as I explained here

I need from you more log, Please enable debug and send me your log as I explained here

Done

for me works fine. there is a way to know status of water and air filters? and maybe express freeze on\off status? is good in the main sensor without

i can check "Smart Diagnosis" from app and on/off express freeze (now off)

for me works fine. there is a way to know status of water and air filters? and maybe express freeze on\off status? is good in the main sensor without

Yes it is, but as I say before, later / next days....

I need from you more log, Please enable debug and send me your log as I explained here

Done

You have Fridge based on ApiV2, some more jobs for me...

I need from you more log, Please enable debug and send me your log as I explained here

Done

You have Fridge based on ApiV2, some more jobs for me...

sorry :/

Don't worry, I was expecting....

After update to 0.3.2 works fine. Thanks.

I need from you more log, Please enable debug and send me your log as I explained here

Done

You have Fridge based on ApiV2, some more jobs for me...

very strange. my fridge is really new and use olds api?

Don't worry, I was expecting....
It's fine because I'm also able to manage version with APIv2

Working APIv2 with 0.3.3.
Thank you.

HI ollo69.
In your mailbox you can see my mail, with latest log.
Again same error.

HI ollo69.
In your mailbox you can see my mail, with latest log.
Again same error.

Ops, find the issue, I will release fix by tonight...

Just released a new version (v0.3.4) that should fix the issue.
Please try and let me know...

Again my log in mailbox.

This are not Errors, but "managed Warning" issued by the system.

the first is generated by HA core because you use Custom Component,
the second notify you that your refrigerator is providing a status that is not "mapped":
received unknown REFRIGERATOR status 'NOT_USE' of type 'SmartSavingMode'

Can you confirm that integration is working now?
You should run the integration for some time (eg. 1 day) and collect all this warning so that I can add these states to the list of possible cases.
Thx

These are not Errors, but "managed Warning" issued by the system.

the first is generated by HA core because you use Custom Component,
the second notify you that your refrigerator is providing a status that is not "mapped":
received unknown REFRIGERATOR status 'NOT_USE' of type 'SmartSavingMode'

Can you confirm that integration is working now?
You should run the integration for some time (eg. 1 day) and collect all this warning so that I can add these states to the list of possible cases.
Thx

Yes. Other works well. After 1-2 days I will send log again.
Thank you again for your job.

Yes. Other works well. After 1-2 days I will send log again.
Thank you again for your job.

You can directly post these warnings here.
There are not sensible info, are informations that is better to share, will help to extend support to additional models.

I think that you are having internet issues...

I have an LG thinq refrigerator. Using your latest commit, I'm seeing this in the home assistant logs:
2020-04-24 00:02:23 ERROR (MainThread) [homeassistant.util.logging] Exception in async_state_update when dispatching 'thinq_remote_update-REFRIGERATOR': ()
Traceback (most recent call last):
File "/config/custom_components/smartthinq_sensors/sensor.py", line 335, in async_state_update
self.async_write_ha_state()
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 297, in async_write_ha_state
self._async_write_ha_state()  # type: ignore
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 320, in _async_write_ha_state
state = self.state
File "/config/custom_components/smartthinq_sensors/sensor.py", line 307, in state
return self._defATTR_VALUE_FN
File "/config/custom_components/smartthinq_sensors/sensor.py", line 168, in
ATTR_VALUE_FN: lambda x: x._temp_refrigerator,
File "/config/custom_components/smartthinq_sensors/sensor.py", line 717, in _temp_refrigerator
return self._api.state.temp_refrigerator
File "/config/custom_components/smartthinq_sensors/wideq/refrigerator.py", line 85, in temp_refrigerator
temp = self.lookup_enum("TempRefrigerator")
File "/config/custom_components/smartthinq_sensors/wideq/device.py", line 735, in lookup_enum
return self._device.model_info.enum_name(curr_key, self._data[curr_key])
File "/config/custom_components/smartthinq_sensors/wideq/device.py", line 314, in enum_name
options = self.value(key).options
AttributeError: 'RangeValue' object has no attribute 'options'

I added a check in last version to avoid exception, but I don't know if provided values will be correct.
To really solve this issue I need debud log from you as explained here

@ollo69 Your latest code fixed the issues I was experiencing. Thank you! I'm now seeing this is the main log:
2020-04-28 00:49:15 WARNING (MainThread) [custom_components.smartthinq_sensors.wideq.device] ThinQ: received unknown REFRIGERATOR status '255' of type 'EcoFriendly'

Closing this old thread.
Please open a new one if you still have Warning for "unknown states"


Unable to Delete Workspace: Conflict Error Due to Image Reference in Use by Another Container

Issue:
When attempting to delete a workspace that uses the DevContainers Docker template, and another running container is using the same image, the deletion fails with the following error:
Error: Unable to remove Docker image: Error response from daemon: conflict: unable to remove repository reference "ghcr.io/coder/envbuilder:latest" (must force) - container xxxxxxx is using its referenced image xxxxxxx.

Steps to Reproduce:

Create two workspaces, both using the DevContainers Docker template.
Attempt to delete one workspace while the other is still running and using the same template.
Observe the conflict error during the deletion process.

Workaround:
Attempting to delete the workspace after stopping the other running workspace succeeds.
Additonal Info:

Similar issue on the Coder Discord:
Link to message on Discord

Environment:

Coder Version: v2.16.0+683a720
OS: Linux (installed using the setup script)

@techwithanirudh Can you reproduce this behaviour without Terraform (that is, by running two instances of Envbuilder in parallel)? I'm expecting that this is not the case, and this behaviour is related to the kreuzwerker/docker Terraform provider.

@johnstcn Yes, I ran two Envbuilder instances in parallel. I tried stopping one, and there were no issues at all.


Possibly invalid skill.json warning

Description:
skill.json manifest.apis.custom.endpoint validation might be incorrect. When pointing a skill at a lambda function, the entry is of the form:
"uri": "lambda-function-name",
"sourceDir": "lambda/py"

The linter shows this error String does not match the pattern of "^(arn|https://)".:
  "owner": "_generated_diagnostic_collection_name_#0",
  "severity": 4,
  "message": "String is not a URI: URI with a scheme is expected."

The arn does not seem to be required. The arn address is generated, stored, and managed in the .ask/config after a deployment.
The linter also shows the property sourceDir is not allowed. I am confused because all of the ask-skill samples use that form.
	"owner": "_generated_diagnostic_collection_name_#0",
	"severity": 4,
	"message": "Property sourceDir is not allowed.",

I have noticed that the skill manifest doesn't make mention of these values. Are they ask-cli specific?
Additional environment details (Ex: Windows, Mac, Amazon Linux etc)
osx 10.14.3
VS Code version:
Version 1.31.1

bump

Hi @steveoh ,
Sorry for responding so late and thanks for reporting this issue. We do find this problem exist, and we will have a look into it and try to solve it as soon as possible.
Best,
Shen

@steveoh The JSON validation has been updated and this problem has been fixed. Please check. If this problem still exists, you can try to reload the plugin or restart vscode. Thx.

looks good thanks!

Still, this issue is there when you build from AWS CodePipeline Alexa Skill Deploy provider.
Object instance at property path "$.manifest.apis.custom.endpoint" has unexpected property: "sourceDir".

Hey @dilunika , when you use AWS CodePipeline to deploy Alexa Skill, you might need to avoid deploying your skill.json with "sourceDir" field inside.
This field is an ask-cli v1.x ask deploy specific field (not quite related to VSCode's file linter) and thus failure happens when it's deployed using AWS CodePipeline. I'd suggest you follow https://docs.aws.amazon.com/codepipeline/latest/userguide/tutorials-alexa-skills-kit.html#tutorials-alexa-skills-kit-push 's steps to deploy through CodePipeline, especially use ask api get-skill -s skill-ID > skill.json to get a CodePipeline supported skill.json file.


can I append my character lora to the workflow?

Can I append my character lora to MooreAnimateAnyone_DDIM.json workflow to get a better result?

You can append your character lora, but I doubt you will get better result, since the model is trained to follow the reference image closely, meaning your reference defines the style of the output, so lora will mostly likely barely does anything or entirely nothing


⚠ Bofrost.es has degraded performance

In a3348ce, Bofrost.es (https://www.bofrost.es) experienced degraded performance:

HTTP code: 200
Response time: 1728 ms

Resolved: Bofrost.es performance has improved in b4894e8 after 6 minutes.


Daily update

Automated changes by create-pull-request GitHub action

Build failed because of:
no headquarter addresses for cribl at https://www.crunchbase.com/organization/cribl
No cached entry, and The Ritsumeikan Trust has issues with twitter: https://twitter.com/RitsARC, Request failed with status code 400
No cached entry, and Sollers College has issues with twitter: https://twitter.com/SollersEdu, Request failed with status code 400
No cached entry, and Research Institutes of Sweden has issues with twitter: https://twitter.com/RISEsweden, Request failed with status code 400
No cached entry, and Open Sourcing Mental Illness, LTD has issues with twitter: https://twitter.com/osmihelp, Request failed with status code 400
No cached entry, and Open Compute Project has issues with twitter: https://twitter.com/OpenComputePrj, Request failed with status code 400
No cached entry, and iRespond Global has issues with twitter: https://twitter.com/iRespond, Request failed with status code 400
No cached entry, and Galgotias University has issues with twitter: https://twitter.com/GalgotiasUni, Request failed with status code 400
No cached entry, and NIAB has issues with twitter: https://twitter.com/NIABEMR, Request failed with status code 400
No cached entry, and Yazaki Corporation has issues with twitter: https://twitter.com/@YazakiNA, Request failed with status code 400
No cached entry, and Uffizzi has issues with twitter: https://twitter.com/Uffizzi_, Request failed with status code 400
No cached entry, and Union.ai has issues with twitter: https://twitter.com/union_ai, Request failed with status code 400
No cached entry, and TietoEVRY has issues with twitter: https://twitter.com/Tietoevry, Request failed with status code 400
No cached entry, and Super Micro Computer, Inc. has issues with twitter: https://twitter.com/Supermicro_SMCI, Request failed with status code 400
No cached entry, and Sonatus, Inc. has issues with twitter: https://twitter.com/SonatusHQ, Request failed with status code 400
No cached entry, and Seekret has issues with twitter: https://twitter.com/SeekretSoftware, Request failed with status code 400
No cached entry, and SICPA SA has issues with twitter: https://twitter.com/SICPA_enEspanol, Request failed with status code 400
No cached entry, and Pionix GmbH has issues with twitter: https://twitter.com/PionixDe, Request failed with status code 400
No cached entry, and Optic has issues with twitter: https://twitter.com/useoptic, Request failed with status code 400
No cached entry, and OnGres has issues with twitter: https://twitter.com/ongresinc, Request failed with status code 400
No cached entry, and Okteto has issues with twitter: https://twitter.com/oktetohq, Request failed with status code 400
No cached entry, and Mondoo has issues with twitter: https://twitter.com/MondooLabs, Request failed with status code 400
No cached entry, and Lightspin has issues with twitter: https://twitter.com/LightspinTech, Request failed with status code 400
No cached entry, and KUKA Deutschland GmbH has issues with twitter: https://twitter.com/KUKA_Press, Request failed with status code 400
No cached entry, and JVC KENWOOD Corporation has issues with twitter: https://twitter.com/JVCKENWOOD_SR, Request failed with status code 400
No cached entry, and Honor Device Co. Ltd has issues with twitter: https://twitter.com/Honorglobal, Request failed with status code 400
No cached entry, and GotoAdmins has issues with twitter: https://twitter.com/gotoadmins, Request failed with status code 400
No cached entry, and GitLab Inc. has issues with twitter: https://twitter.com/gitlabhq, Request failed with status code 400
No cached entry, and Globant LLC has issues with twitter: https://twitter.com/Globant, Request failed with status code 400
No cached entry, and FlexiDAO has issues with twitter: https://twitter.com/flexidao, Request failed with status code 400
No cached entry, and DevSamurai has issues with twitter: https://twitter.com/devsamurai_com, Request failed with status code 400
No cached entry, and Datachain, Inc. has issues with twitter: https://twitter.com/datachain_en, Request failed with status code 400
No cached entry, and Cybeats has issues with twitter: https://twitter.com/cybeatstech, Request failed with status code 400
No cached entry, and Cribl Inc has issues with twitter: https://twitter.com/cribl_io, Request failed with status code 400
No cached entry, and CoolIT Systems Inc. has issues with twitter: https://twitter.com/CoolITSystems, Request failed with status code 400
No cached entry, and Comcast Cable Communications, LLC (Xfinity) has issues with twitter: https://twitter.com/Xfinity, Request failed with status code 400
No cached entry, and Clastix SRL has issues with twitter: https://twitter.com/clastix, Request failed with status code 400
No cached entry, and CodeWave has issues with twitter: https://twitter.com/Codewave_Inc, Request failed with status code 400
No cached entry, and Change Healthcare has issues with twitter: https://twitter.com/Change_HC, Request failed with status code 400
No cached entry, and Bonifii has issues with twitter: https://twitter.com/BonifiiOfficial, Request failed with status code 400
No cached entry, and Catalogic Software has issues with twitter: https://twitter.com/CatalogicSW, Request failed with status code 400
No cached entry, and BMW has issues with twitter: https://twitter.com/BMWGroup, Request failed with status code 400
No cached entry, and Block, Inc. has issues with twitter: https://twitter.com/blocks, Request failed with status code 400
No cached entry, and Beijing Kingsoft Cloud Internet Technology has issues with twitter: https://twitter.com/KINGSOFT_PR, Request failed with status code 400
No cached entry, and Beijing Fourth Paradigm Intelligent Technology Co., Ltd. has issues with twitter: https://twitter.com/paradigm4, Request failed with status code 400
No cached entry, and Baumer Management Services AG has issues with twitter: https://twitter.com/baumergroup, Request failed with status code 400
No cached entry, and Althea has issues with twitter: https://twitter.com/AltheaNetwork, Request failed with status code 400
No cached entry, and Absa Bank Limited has issues with twitter: https://twitter.com/AbsaSouthAfrica, Request failed with status code 400
No cached entry, and across.cloud has issues with twitter: https://twitter.com/AcrossCloud, Request failed with status code 400
Cribl Inc either has no crunchbase entry or it is invalid


EOFError: Ran out of input

This is autogenerated. Please review and update as needed.
Describe the bug
Command Name
az account get-access-token
Errors:
The command failed with an unexpected error. Here is the traceback:
Ran out of input
Traceback (most recent call last):
  File "/opt/az/lib/python3.6/site-packages/knack/cli.py", line 231, in invoke
    cmd_result = self.invocation.execute(args)
  File "/opt/az/lib/python3.6/site-packages/azure/cli/core/commands/__init__.py", line 658, in execute
    raise ex
  File "/opt/az/lib/python3.6/site-packages/azure/cli/core/commands/__init__.py", line 721, in _run_jobs_serially
    results.append(self._run_job(expanded_arg, cmd_copy))
  File "/opt/az/lib/python3.6/site-packages/azure/cli/core/commands/__init__.py", line 692, in _run_job
    result = cmd_copy(params)
  File "/opt/az/lib/python3.6/site-packages/azure/cli/core/commands/__init__.py", line 328, in __call__
    return self.handler(*args, **kwargs)
  File "/opt/az/lib/python3.6/site-packages/azure/cli/core/commands/command_operation.py", line 121, in handler
    return op(**command_args)
  File "/opt/az/lib/python3.6/site-packages/azure/cli/command_modules/profile/custom.py", line 77, in get_access_token
    tenant=tenant)
  File "/opt/az/lib/python3.6/site-packages/azure/cli/core/_profile.py", line 383, in get_raw_token
    credential = self._create_credential(account, tenant)
  File "/opt/az/lib/python3.6/site-packages/azure/cli/core/_profile.py", line 593, in _create_credential
    return identity.get_user_credential(username_or_sp_id)
  File "/opt/az/lib/python3.6/site-packages/azure/cli/core/auth/identity.py", line 209, in get_user_credential
    return UserCredential(self.client_id, username, **self._msal_app_kwargs)
  File "/opt/az/lib/python3.6/site-packages/azure/cli/core/auth/identity.py", line 84, in _msal_app_kwargs
    Identity._msal_http_cache = self._load_msal_http_cache()
  File "/opt/az/lib/python3.6/site-packages/azure/cli/core/auth/identity.py", line 113, in _load_msal_http_cache
    persisted_http_cache = pickle.load(f)
EOFError: Ran out of input

To Reproduce:
Steps to reproduce the behavior. Note that argument values have been redacted, as they may contain sensitive information.

Put any pre-requisite steps here...
az account get-access-token --resource {} --subscription {} -o={}

Expected Behavior
Environment Summary
Linux-4.4.0-19041-Microsoft-x86_64-with-debian-bullseye-sid, Ubuntu 20.04.3 LTS
Python 3.6.10
Installer: DEB

azure-cli 2.31.0 *

Extensions:
account 0.2.1
dataprotection 0.5.0
ssh 1.0.0
storage-preview 0.7.4

Additional Context

@jiasli for awareness

Could you please delete this file and try again? ~/.azure/msal_http_cache.bin
Related issue: https://github.com/Azure/azure-cli/issues/20707


Contributor access for Josh?

Given that you would like all PR's to be reviewed buy someone other then the author himself would you consider giving Josh assess as well to review PR's since we work together in the same timezone ?

Yes can get this sorted 👍

awesome

This is done now 👍


Repo sync working branch

:x: Organization membership check failed
Members of the MicrosoftDocs organization should use the private repo. Please move your changes to https://github.com/MicrosoftDocs/Dynamics-365-Operations, and close this pull request.


Bump PandocGUI to 1.1

[x] Have you signed the Contributor License Agreement?
[x] Have you checked that there aren't other open pull requests for the same manifest update/change?

[x] Does your manifest conform to the 1.0 schema?

Note: <path> is the name of the directory containing the manifest you're submitting.

Microsoft Reviewers: Open in CodeFlow

I don't understand, the manisfest validation passes :

As well as the installation :

It looks like you changed <IP_ADDRESS> and <IP_ADDRESS>


edb test: In verbose mode, print message when test starts

There's a more elaborate implementation in #7991


⚠ Adacta-fintech.com has degraded performance

In af6f200, Adacta-fintech.com (https://www.adacta-fintech.com) experienced degraded performance:

HTTP code: 200
Response time: 15681 ms

Resolved: Adacta-fintech.com performance has improved in 83116ee after 7 minutes.


ES-2162: Generate rest client from OpenAPI spec

https://r3-cev.atlassian.net/browse/ES-2162
Taking the OpenApi spec located in /processors/rest-processor/src/integrationTest/resources/ as the input, generate a rest client to use in the Corda SDK, Corda CLI, Corda Runtime Gradle Plugin
In terms of code style and duplication, anything under the net.corda.restclient.generated can be ignored.
There's a few things found during development that we need to take care of:

https://r3-cev.atlassian.net/browse/ES-2378
https://r3-cev.atlassian.net/browse/ES-2382
https://r3-cev.atlassian.net/browse/ES-2383
https://r3-cev.atlassian.net/browse/ES-2388

build e2e

build e2e

Re-based to pick up pipeline changes get the plugin smoke tests running.
All previous pipelines (not SonarCloud) were green, including the e2e tests

Re-based to pick up pipeline changes get the plugin smoke tests running. All previous pipelines (not SonarCloud) were green, including the e2e tests

Note that previously executed E2E test configurations were using CLI built from main branch. This is a known limitation of the builds triggered via PR comments or with custom arguments.
I have created a dedicated branch and a PR in E2E repo to test artefacts from this PR. The build are passing. Latest completed execution can be found here.

E2E test with commit 37ca9f8 passed -> https://ci02.dev.r3.com/job/Corda5/job/corda5-e2e-tests/job/PR-638/11/
Commit efbcdf8 doesn't contain meaningful code change


profile: tweak some paths

Tackling all the points summarized in the related ticket.
Closes https://github.com/coreos/torcx/issues/30

/cc @squeed


Get a font fallback for Mac

Somehow, Microsoft's favorite font isn't pre-installed on Mac/iOS.

It also doesn't show up in Firefox on Windows.


Optimize metadata support for OS X

Metadata functions in youtube-dl
youtube-dl comes with these metadata related arguments: --add-metadata and --xattrs.
--add-metadata writes into the metadata section of the container format where possible/supported whereas --xattrs into the filesystem's metadata section.
Metadata on OS X
Mac users' default search feature Spotlight (and its background process mds, the metadata server) to my research seems to index only xattr variables from the namespace com.apple.* whereas youtube-dl writes into user.dublincore.* (contributor | date | description | format | title) and user.xdg.referrer.url.
Therefore the --xattrs is completely inaccessible to Spotlight, and --add-metadata only accessible if youtube-dl can 1) write into the container format and 2) Spotlight supports parsing the container's metadata and 3) Spotlight maps the variables correctly (to a certain degree).
Example: kMDItemDescription got filled by Spotlight for a 3gp file with --add-metadata but not for a mp4 file with --add-metadata.
Feature request
It would be fine if there would be an option --spotlight which would write the metadata into the appropriate OS X specific metadata locations.
Implementation hints
I'm no savvy developer, but would like to provide some resources at least:

Apple Developer Documentation on Spotlight Metadata Attributes, i.e.:
kMDItemWhereFroms would be the ideal destination for the URL.
kMDItemDescription would be the ideal destination for the description.
…

Writing metadata seems to be done with:
xattr -w com.apple.metadata:<properVariable> "<MetadataValueHere>" <file>
But it seems to be a bit tricky, as some metadata exists in multiple places (legacy) and must thus be properly synchronized in order to show up in Spotlight as well as showing up in the Finder info windows, and it seems that the value cannot be written as plaintext, but must be encapsulated as PLIST (XML format for Apple property list) or binary PLIST.

This AppleScript successfully copies the xattr user.dublincore.description to the Finder/Spotlight comment.
Comment from xattr.txt

This AppleScript successfully copies the xattr user.dublincore.description to the Finder/Spotlight comment.
Comment from xattr.txt

This still hasn’t been changed. Can someone please get on this? It would make a world of difference when sorting through files.

Apparently mdls maps some Dublin Core attributes to com.apple.metadata ones, so not all attributes should be added.
By the way, files merged with ffmpeg doesn't lose their extended attributes. Are things broken for you? @Saklad5
Here are the result from the latest youtube-dl commit + ffmpeg from Homebrew:
$ youtube-dl -v QG_YH7jxVy0 --xattr-set-filesize --xattrs --keep-video
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'QG_YH7jxVy0', u'--xattr-set-filesize', u'--xattrs', u'--keep-video']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.09.27
[debug] Git HEAD: 53a7e3d
[debug] Python version 2.6.9 - Darwin-16.0.0-x86_64-i386-64bit
[debug] exe versions: ffmpeg 3.1.3, ffprobe 3.1.3
[debug] Proxy map: {}
[youtube] QG_YH7jxVy0: Downloading webpage
[youtube] QG_YH7jxVy0: Downloading video info webpage
[youtube] QG_YH7jxVy0: Extracting video information
[youtube] QG_YH7jxVy0: Downloading MPD manifest
WARNING: Requested formats are incompatible for merge and will be merged into mkv.
[debug] Invoking downloader on u'https://r8---sn-5njj-u2xl.googlevideo.com/videoplayback?id=406fd81fb8f1572d&itag=135&source=youtube&requiressl=yes&pl=17&mv=m&ms=au&mm=31&mn=sn-5njj-u2xl&gcr=tw&initcwndbps=6998750&ratebypass=yes&mime=video/mp4&gir=yes&clen=11720569&lmt=1385507366042723&dur=246.012&mt=1475325896&upn=afoBHizrrSM&key=dg_yt0&signature=955F701365E5EDE59E6728290D7CFCCACA2B8E07.88C8F5790456CA6ECBC9F53821DA535AC4E94D97&ip=<IP_ADDRESS>&ipbits=0&expire=1475348342&sparams=ip,ipbits,expire,id,itag,source,requiressl,pl,mv,ms,mm,mn,gcr,initcwndbps,ratebypass,mime,gir,clen,lmt,dur'
[download] Destination: 貓的報恩-幻化成風-QG_YH7jxVy0.f135.mp4
[download] 100% of 11.18MiB in 00:01
[debug] Invoking downloader on u'https://r8---sn-5njj-u2xl.googlevideo.com/videoplayback?id=406fd81fb8f1572d&itag=251&source=youtube&requiressl=yes&pl=17&mv=m&ms=au&mm=31&mn=sn-5njj-u2xl&gcr=tw&initcwndbps=6998750&ratebypass=yes&mime=audio/webm&gir=yes&clen=4313393&lmt=1449568659391520&dur=246.041&mt=1475325896&upn=afoBHizrrSM&key=dg_yt0&signature=4BF92C33C5DBB505F95138D29C653F3BAC994335.878CE0E0ADFDE6C81121C54E8E265B4ADF57ED6E&ip=<IP_ADDRESS>&ipbits=0&expire=1475348342&sparams=ip,ipbits,expire,id,itag,source,requiressl,pl,mv,ms,mm,mn,gcr,initcwndbps,ratebypass,mime,gir,clen,lmt,dur'
[download] Destination: 貓的報恩-幻化成風-QG_YH7jxVy0.f251.webm
[download] 100% of 4.11MiB in 00:00
[ffmpeg] Merging formats into "貓的報恩-幻化成風-QG_YH7jxVy0.mkv"
[debug] ffmpeg command line: ffmpeg -y -i 'file:貓的報恩-幻化成風-QG_YH7jxVy0.f135.mp4' -i 'file:貓的報恩-幻化成風-QG_YH7jxVy0.f251.webm' -c copy -map 0:v:0 -map 1:a:0 'file:貓的報恩-幻化成風-QG_YH7jxVy0.temp.mkv'
[metadata] Writing metadata to file's xattrs

$ xattr -l 貓的報恩-幻化成風-QG_YH7jxVy0.mkv
user.dublincore.contributor: rjmhwy
user.dublincore.date: 2013-01-28
user.dublincore.description: 幻化成風（烏克麗麗不插電演奏版/動畫《貓的報恩》採用版本）

作詞．作曲：過亞彌乃
編曲：根岸孝旨
user.dublincore.format: 135 - 854x480 (DASH video)+251 - audio only (DASH audio)
user.dublincore.title: 貓的報恩-幻化成風
user.xdg.referrer.url: https://www.youtube.com/watch?v=QG_YH7jxVy0

$ mdls 貓的報恩-幻化成風-QG_YH7jxVy0.mkv
kMDItemFSContentChangeDate = 2013-11-26 23:09:26 +0000
kMDItemFSCreationDate      = 2013-11-26 23:09:26 +0000
kMDItemFSCreatorCode       = ""
kMDItemFSFinderFlags       = 0
kMDItemFSHasCustomIcon     = 0
kMDItemFSInvisible         = 0
kMDItemFSIsExtensionHidden = 0
kMDItemFSIsStationery      = 0
kMDItemFSLabel             = 0
kMDItemFSName              = "貓的報恩-幻化成風-QG_YH7jxVy0.mkv"
kMDItemFSNodeCount         = 15988466
kMDItemFSOwnerGroupID      = 20
kMDItemFSOwnerUserID       = 501
kMDItemFSSize              = 15988466
kMDItemFSTypeCode          = ""

I finally figured it out. All of the metadata appears to be dropped when I use MP4, but when outputting to Matroska the metadata is preserved just fine.

Extended attributes should be independent of file types. @Saklad5 could you explain more about "use MP4"? For example the command you use and the environment (OS version, ffmpeg/avconv version, etc.)

output.txt
Hopefully that is a sufficient amount of information. I know the extended attributes are format-agnostic, which is why this behavior is so puzzling.

@Saklad5 The problem is that atomicparsley does not copy extended attributes. Fixed in b19e275.

I'm glad that my feature request got attention after some time. In my next spare time I'm going to test the implementation and will give some feedback probably.

By the way, there's a request for kMDItemWhereFroms at #2545 and an implementation at https://github.com/tewe/youtube-dl/commit/7f5c82729ba762344d4cd311920196cacc80c3dc. That approach looks roughly good. My question is: how to check whether kMDItemWhereFroms is corrected set or not? Not familiar with Spotlight and Finder.

mdls -name kMDItemWhereFroms /path/to/file will return (null) if not set or an URL string like http://domain.com/origin/of/file.

Any progress on this issue?

I downloaded http://yt-dl.org/downloads/latest/youtube-dl with Safari. There are some extended attributes associated with the downloaded file:
$ xattr -l ~/Downloads/youtube-dl
com.apple.metadata:kMDItemDownloadedDate:
00000000  62 70 6C 69 73 74 30 30 A1 01 33 41 BD C6 33 49  |bplist00..3A..3I|
00000010  0B AC A3 08 0A 00 00 00 00 00 00 01 01 00 00 00  |................|
00000020  00 00 00 00 02 00 00 00 00 00 00 00 00 00 00 00  |................|
00000030  00 00 00 00 13                                   |.....|
00000035
com.apple.metadata:kMDItemWhereFroms:
00000000  62 70 6C 69 73 74 30 30 A2 01 02 5F 11 01 E4 68  |bplist00..._...h|
00000010  74 74 70 73 3A 2F 2F 67 69 74 68 75 62 2D 63 6C  |ttps://github-cl|
00000020  6F 75 64 2E 73 33 2E 61 6D 61 7A 6F 6E 61 77 73  |oud.s3.amazonaws|
00000030  2E 63 6F 6D 2F 72 65 6C 65 61 73 65 73 2F 31 30  |.com/releases/10|
00000040  33 39 35 32 30 2F 35 62 32 38 63 37 33 34 2D 39  |39520/5b28c734-9|
00000050  62 62 36 2D 31 31 65 36 2D 39 30 34 37 2D 61 66  |bb6-11e6-9047-af|
00000060  31 64 39 62 31 32 32 32 64 34 3F 58 2D 41 6D 7A  |1d9b1222d4?X-Amz|
00000070  2D 41 6C 67 6F 72 69 74 68 6D 3D 41 57 53 34 2D  |-Algorithm=AWS4-|
00000080  48 4D 41 43 2D 53 48 41 32 35 36 26 58 2D 41 6D  |HMAC-SHA256&X-Am|
00000090  7A 2D 43 72 65 64 65 6E 74 69 61 6C 3D 41 4B 49  |z-Credential=AKI|
000000A0  41 49 53 54 4E 5A 46 4F 56 42 49 4A 4D 4B 33 54  |AISTNZFOVBIJMK3T|
000000B0  51 25 32 46 32 30 31 36 31 30 33 30 25 32 46 75  |Q%2F20161030%2Fu|
000000C0  73 2D 65 61 73 74 2D 31 25 32 46 73 33 25 32 46  |s-east-1%2Fs3%2F|
000000D0  61 77 73 34 5F 72 65 71 75 65 73 74 26 58 2D 41  |aws4_request&X-A|
000000E0  6D 7A 2D 44 61 74 65 3D 32 30 31 36 31 30 33 30  |mz-Date=20161030|
000000F0  54 31 33 35 35 31 37 5A 26 58 2D 41 6D 7A 2D 45  |T135517Z&X-Amz-E|
00000100  78 70 69 72 65 73 3D 33 30 30 26 58 2D 41 6D 7A  |xpires=300&X-Amz|
00000110  2D 53 69 67 6E 61 74 75 72 65 3D 37 37 32 63 30  |-Signature=772c0|
00000120  63 38 65 62 64 34 39 33 66 65 37 62 34 39 30 39  |c8ebd493fe7b4909|
00000130  61 63 65 39 30 32 35 34 37 34 66 31 62 65 63 34  |ace9025474f1bec4|
00000140  64 66 36 63 35 38 33 38 63 31 66 37 34 66 31 31  |df6c5838c1f74f11|
00000150  33 30 37 62 61 34 62 63 62 32 36 26 58 2D 41 6D  |307ba4bcb26&X-Am|
00000160  7A 2D 53 69 67 6E 65 64 48 65 61 64 65 72 73 3D  |z-SignedHeaders=|
00000170  68 6F 73 74 26 61 63 74 6F 72 5F 69 64 3D 30 26  |host&actor_id=0&|
00000180  72 65 73 70 6F 6E 73 65 2D 63 6F 6E 74 65 6E 74  |response-content|
00000190  2D 64 69 73 70 6F 73 69 74 69 6F 6E 3D 61 74 74  |-disposition=att|
000001A0  61 63 68 6D 65 6E 74 25 33 42 25 32 30 66 69 6C  |achment%3B%20fil|
000001B0  65 6E 61 6D 65 25 33 44 79 6F 75 74 75 62 65 2D  |ename%3Dyoutube-|
000001C0  64 6C 26 72 65 73 70 6F 6E 73 65 2D 63 6F 6E 74  |dl&response-cont|
000001D0  65 6E 74 2D 74 79 70 65 3D 61 70 70 6C 69 63 61  |ent-type=applica|
000001E0  74 69 6F 6E 25 32 46 6F 63 74 65 74 2D 73 74 72  |tion%2Foctet-str|
000001F0  65 61 6D 5F 10 11 68 74 74 70 3A 2F 2F 79 74 2D  |eam_..http://yt-|
00000200  64 6C 2E 6F 72 67 2F 00 08 00 0B 01 F3 00 00 00  |dl.org/.........|
00000210  00 00 00 02 01 00 00 00 00 00 00 00 03 00 00 00  |................|
00000220  00 00 00 00 00 00 00 00 00 00 00 02 07           |.............|
0000022d
com.apple.quarantine: 0083;5815fbc9;Safari;6DF70E85-6756-4590-94DF-8DB4D56EE703

However, mdls can't read it:
$ mdls -name kMDItemWhereFroms ~/Downloads/youtube-dl
kMDItemWhereFroms = (null)

Using Sierra 10.12.1. Is there other way to check whether com.apple.metadata:kMDItemWhereFroms is correctly set or not?

mdls worked fine for me. Granted, this was on Mojave 10.14.6.

Besides "where from" information, can we please have also the description of the video that comes with all Youtube videos, please?

Apparently mdls maps some Dublin Core attributes to com.apple.metadata ones, so not all attributes should be added. By the way, files merged with ffmpeg doesn't lose their extended attributes. Are things broken for you? @Saklad5 Here are the result from the latest youtube-dl commit + ffmpeg from Homebrew:
$ youtube-dl -v QG_YH7jxVy0 --xattr-set-filesize --xattrs --keep-video
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'QG_YH7jxVy0', u'--xattr-set-filesize', u'--xattrs', u'--keep-video']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.09.27
[debug] Git HEAD: 53a7e3d
[debug] Python version 2.6.9 - Darwin-16.0.0-x86_64-i386-64bit
[debug] exe versions: ffmpeg 3.1.3, ffprobe 3.1.3
[debug] Proxy map: {}
[youtube] QG_YH7jxVy0: Downloading webpage
[youtube] QG_YH7jxVy0: Downloading video info webpage
[youtube] QG_YH7jxVy0: Extracting video information
[youtube] QG_YH7jxVy0: Downloading MPD manifest
WARNING: Requested formats are incompatible for merge and will be merged into mkv.
[debug] Invoking downloader on u'https://r8---sn-5njj-u2xl.googlevideo.com/videoplayback?id=406fd81fb8f1572d&itag=135&source=youtube&requiressl=yes&pl=17&mv=m&ms=au&mm=31&mn=sn-5njj-u2xl&gcr=tw&initcwndbps=6998750&ratebypass=yes&mime=video/mp4&gir=yes&clen=11720569&lmt=1385507366042723&dur=246.012&mt=1475325896&upn=afoBHizrrSM&key=dg_yt0&signature=955F701365E5EDE59E6728290D7CFCCACA2B8E07.88C8F5790456CA6ECBC9F53821DA535AC4E94D97&ip=<IP_ADDRESS>&ipbits=0&expire=1475348342&sparams=ip,ipbits,expire,id,itag,source,requiressl,pl,mv,ms,mm,mn,gcr,initcwndbps,ratebypass,mime,gir,clen,lmt,dur'
[download] Destination: 貓的報恩-幻化成風-QG_YH7jxVy0.f135.mp4
[download] 100% of 11.18MiB in 00:01
[debug] Invoking downloader on u'https://r8---sn-5njj-u2xl.googlevideo.com/videoplayback?id=406fd81fb8f1572d&itag=251&source=youtube&requiressl=yes&pl=17&mv=m&ms=au&mm=31&mn=sn-5njj-u2xl&gcr=tw&initcwndbps=6998750&ratebypass=yes&mime=audio/webm&gir=yes&clen=4313393&lmt=1449568659391520&dur=246.041&mt=1475325896&upn=afoBHizrrSM&key=dg_yt0&signature=4BF92C33C5DBB505F95138D29C653F3BAC994335.878CE0E0ADFDE6C81121C54E8E265B4ADF57ED6E&ip=<IP_ADDRESS>&ipbits=0&expire=1475348342&sparams=ip,ipbits,expire,id,itag,source,requiressl,pl,mv,ms,mm,mn,gcr,initcwndbps,ratebypass,mime,gir,clen,lmt,dur'
[download] Destination: 貓的報恩-幻化成風-QG_YH7jxVy0.f251.webm
[download] 100% of 4.11MiB in 00:00
[ffmpeg] Merging formats into "貓的報恩-幻化成風-QG_YH7jxVy0.mkv"
[debug] ffmpeg command line: ffmpeg -y -i 'file:貓的報恩-幻化成風-QG_YH7jxVy0.f135.mp4' -i 'file:貓的報恩-幻化成風-QG_YH7jxVy0.f251.webm' -c copy -map 0:v:0 -map 1:a:0 'file:貓的報恩-幻化成風-QG_YH7jxVy0.temp.mkv'
[metadata] Writing metadata to file's xattrs

$ xattr -l 貓的報恩-幻化成風-QG_YH7jxVy0.mkv
user.dublincore.contributor: rjmhwy
user.dublincore.date: 2013-01-28
user.dublincore.description: 幻化成風（烏克麗麗不插電演奏版/動畫《貓的報恩》採用版本）

作詞．作曲：過亞彌乃
編曲：根岸孝旨
user.dublincore.format: 135 - 854x480 (DASH video)+251 - audio only (DASH audio)
user.dublincore.title: 貓的報恩-幻化成風
user.xdg.referrer.url: https://www.youtube.com/watch?v=QG_YH7jxVy0

$ mdls 貓的報恩-幻化成風-QG_YH7jxVy0.mkv
kMDItemFSContentChangeDate = 2013-11-26 23:09:26 +0000
kMDItemFSCreationDate      = 2013-11-26 23:09:26 +0000
kMDItemFSCreatorCode       = ""
kMDItemFSFinderFlags       = 0
kMDItemFSHasCustomIcon     = 0
kMDItemFSInvisible         = 0
kMDItemFSIsExtensionHidden = 0
kMDItemFSIsStationery      = 0
kMDItemFSLabel             = 0
kMDItemFSName              = "貓的報恩-幻化成風-QG_YH7jxVy0.mkv"
kMDItemFSNodeCount         = 15988466
kMDItemFSOwnerGroupID      = 20
kMDItemFSOwnerUserID       = 501
kMDItemFSSize              = 15988466
kMDItemFSTypeCode          = ""

apparently it doesn't


Merge release-1.8 into master

Docs Build status updates of commit a2718f6:
:white_check_mark: Validation status: partially passed

File
Status
Preview URL
Details

:x:Error

Details

TerminalDocs/command-line-arguments.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/actions.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/appearance.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/color-schemes.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/interaction.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/profile-advanced.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/profile-appearance.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/profile-general.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/rendering.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/startup.md
:white_check_mark:Succeeded
View

TerminalDocs/json-fragment-extensions.md
:white_check_mark:Succeeded
View

TerminalDocs/panes.md
:white_check_mark:Succeeded
View

[Error-RuningBuildFailed] Some unexpected errors happened when running build, please open a ticket in https://aka.ms/SiteHelp and include the error report for our team to troubleshoot

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

Docs Build status updates of commit b7766bb:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

TerminalDocs/command-line-arguments.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/actions.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/appearance.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/color-schemes.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/interaction.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/profile-advanced.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/profile-appearance.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/profile-general.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/rendering.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/startup.md
:white_check_mark:Succeeded
View

TerminalDocs/json-fragment-extensions.md
:white_check_mark:Succeeded
View

TerminalDocs/panes.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

Docs Build status updates of commit b0a263e:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

TerminalDocs/command-line-arguments.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/actions.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/appearance.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/color-schemes.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/interaction.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/profile-advanced.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/profile-appearance.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/profile-general.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/rendering.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/startup.md
:white_check_mark:Succeeded
View

TerminalDocs/json-fragment-extensions.md
:white_check_mark:Succeeded
View

TerminalDocs/panes.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

Docs Build status updates of commit 9c0a7d5:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

TerminalDocs/command-line-arguments.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/actions.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/appearance.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/color-schemes.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/interaction.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/profile-advanced.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/profile-appearance.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/profile-general.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/rendering.md
:white_check_mark:Succeeded
View

TerminalDocs/customize-settings/startup.md
:white_check_mark:Succeeded
View

TerminalDocs/json-fragment-extensions.md
:white_check_mark:Succeeded
View

TerminalDocs/panes.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel


Edit-Button in 'install: Build, setup and run' not working

The 'Edit this page' button for this page: https://inveniordm.docs.cern.ch/install/install/
Points to https://github.com/inveniosoftware/docs-invenio-rdm/edit/master/docs/install/install.md
But the file is here: https://github.com/inveniosoftware/docs-invenio-rdm/blob/master/docs/install/build-setup-run.md

Page and github-master seems to be in sync again. Button works again.


Known bug with parameter set links in the text

While links in the text about the visualization (i.e., where it says "this set of parameters") do update the plot appropriately, the links fail to update the slider values correctly.

Bug seems to be resolved.


Document BPL_JVM_CLASS_ADJUSTMENT

Summary
See https://github.com/paketo-buildpacks/libjvm/issues/377.
If we agree on the description, I'll copy it to other JVM buildpacks. I kept it rather generic and not mention specific settings like metaspace. The default provided in the description is not 100% correct, but does not require any additional explanation (I hope).
Use Cases
Checklist

[X] I have viewed, signed, and submitted the Contributor License Agreement.
[X] I have linked issue(s) that this PR should close using keywords or the Github UI (See docs)
[X] I have added an integration test, if necessary.
[X] I have reviewed the styleguide for guidance on my code quality.
[X] I'm happy with the commit history on this PR (I have rebased/squashed as needed).

Looks great to me. Thanks for submitting this PR!


MacBook Pro 2014 fails to render XCAA text (Firefox+Chrome)

I originally filed #2 for Pathfinder 1, but it appears that Pathfinder 2 is just as broken on my 2014 Macbook Pro.
I've tested under both Firefox and Chrome and neither can successfully render glyphs in XCAA mode, but work just fine in 4xSSAA.
System
Model Name:	MacBook Pro
Model Identifier:	MacBookPro11,3
Processor Name:	Intel Core i7
Processor Speed:	2.8 GHz
GPUs:
1
Chipset Model:	Intel Iris Pro
Type:	GPU
Bus:	Built-In
VRAM (Dynamic, Max):	1536 MB
Vendor:	Intel
Device ID:	0x0d26
Revision ID:	0x0008
Automatic Graphics Switching:	Supported
gMux Version:	4.0.8 [3.2.8]
Metal:	Supported, feature set macOS GPUFamily1 v3
2
Chipset Model:	NVIDIA GeForce GT 750M
Type:	GPU
Bus:	PCIe
PCIe Lane Width:	x8
VRAM (Total):	2 GB
Vendor:	NVIDIA (0x10de)
Device ID:	0x0fe9
Revision ID:	0x00a2
ROM Revision:	3776
Automatic Graphics Switching:	Supported
gMux Version:	4.0.8 [3.2.8]
Metal:	Supported, feature set macOS GPUFamily1 v3

I took some screenshots of larger busted glyphs to illustrate the problem (and hopefully suggest what the failure mode might be):

Example of transition from font size 72 to font size 73, using Open Sans:
O

B

1

X

I also have a 2014 rMBP. I've experienced artifacts, although I don't remember if they were like these, at varying times. I would try to replicate but I actually can't build Pathfinder right now because fontsan depends on an old miniz-sys that doesn't compile on my machine with the error could not find native static library 'miniz', perhaps an -L flag is missing?.

I fiddled with some of the shaders to no avail but I strongly suspect a driver bug in computeCoverage. I tried rearranging some of the code to remove conditionals, but nothing really helped.
Changing a2x to p0X.x + dPX.x when slopeIsNegative is false moves the artifacts in an interesting way that suggests that this method could be the the culprit:
     } else {
-        a2x = p0X.x;
+        a2x = p0X.x + dPX.x;
         a0 = p1;
         a1 = p0;
     }

Before that change:

After that change:

If anyone can bisect this change down, that would be very helpful. (I can't reproduce, obviously…)

I bisected it and found 7bd3a481105fa9f20bafbcfba6b9ed1cc1e7f573 is the first bad commit for the new artifact. It's parent 6d85cb338243a5f637aa829c45ef9a83927979b1 works. There also was an old artifact that I ended up bisecting in order to find a good commit for the new bisect, so that info is in the log below as well.
8897145f54f6ca5c88983cd362f429c2ae29460b old artifact
77fa297380799e467f293d36ad8208334dbc159a old artifact
092b46e056dd17360078d52c7d60e28bc42cd4d2 good
81787f4750031976056b44819c0cdf0cd4e4e8ef old artifact
6a7c013e617cc0287f17630a6c30aeeccb0f9192 good
314185684cb5995c26bb0b4a33878ee50e9e648c old artifact
c2368bb71edcc9f806ed7b2002841f4737c5c5fb good
3352f869f0a921e1c3e942a8dae2cf5cd39a3e43 good
314185684cb5995c26bb0b4a33878ee50e9e648c is the first bad commit for the old artifact

2e90b3bce8db697052a1f17da670ebe76f34f874 no text at all
86df78f939c944df9da1f8c282dd8d3679947f4f good
5a1e4d4e606a2ec6617bdcfc0735133d966856d9 good
99c7e685e785b0a38ad2d30bd0650f3a76bbc943 good
7bd3a481105fa9f20bafbcfba6b9ed1cc1e7f573 is the first bad commit for the new artifact

d65bfb7fb20fffba15aa5203c26caa6d3794cd2e old artifact
86df78f939c944df9da1f8c282dd8d3679947f4f good
5a1e4d4e606a2ec6617bdcfc0735133d966856d9 good
99c7e685e785b0a38ad2d30bd0650f3a76bbc943 good
6d85cb338243a5f637aa829c45ef9a83927979b1 good

I did some debugging and the artifacts are the exact same as if I remove the early return in computeCoverage (here https://github.com/pcwalton/pathfinder/blob/7bd3a481105fa9f20bafbcfba6b9ed1cc1e7f573/shaders/gles2/common.inc.glsl#L263) and run it on my Iris Pro, which usually works. So it seems somehow the Apple Nvidia GPU shader compiler isn't compiling that early return properly.

Confirmed fixed. Looks beautiful.
For posterity, the GPU/CUDA version on my machine:


Uncaught Error: EACCES - Atom should handle the failure more gracefully

Steps to reproduce:

Open a file in atom with the package vim-mode enabled.
Change the file permissions.
Esc i (switch to insert mode).

Atom Version: 0.165.0
System: Mac OS X 10.10.2
Thrown From: Atom Core
Stack Trace
Uncaught Error: EACCES, open '/Users/Yvan/Downloads/test.css'
At /Applications/Atom.app/Contents/Resources/app/node_modules/pathwatcher/node_modules/q/q.js:126

Error: EACCES, open '/Users/Yvan/Downloads/test.css'
  at Error (native)

Commands
     -0:00.0 vim-mode:activate-insert-mode (input.hidden-input)

Config
{
  "editor": {
    "fontSize": 12,
    "tabLength": 4,
    "showInvisibles": true,
    "softWrap": true,
    "autoIndentOnPaste": false
  }
}

Installed Packages
# User
ascii-codes, v0.3.3
autocomplete-plus, v1.0.0
color-picker, v1.2.6
editor-stats, v0.16.0
file-icons, v1.4.3
html-entities, v0.2.0
language-haskell, v1.0.0
language-latex, v0.4.1
language-rust, v0.3.2
language-viml, v0.2.0
linter, v0.9.0
linter-coffeelint, v0.1.7
linter-javac, v0.1.3
linter-jshint, v0.1.0
linter-php, v0.0.11
linter-pylint, v0.2.0
linter-rubocop, v0.2.1
linter-scalac, v0.3.3
linter-scss-lint, v0.0.11
linter-shellcheck, v0.0.6
linter-xmllint, v0.0.5
minimap, v3.4.9
project-manager, v1.14.1
tabs-to-spaces, v0.8.0
travis-ci-status, v0.11.1
vim-mode, v0.22.0
visual-bell, v0.9.0

# Dev
No dev packages

$ chmod 000 test.css, then atom asks for my password and I have the bug.
The stack trace may change, for example, this time I got this:
Stack Trace
Uncaught Error: EACCES, open '/Users/Yvan/Desktop/test.css'
At /Applications/Atom.app/Contents/Resources/app/node_modules/pathwatcher/node_modules/q/q.js:126

Error: EACCES, open '/Users/Yvan/Desktop/test.css'
  at Error (native)
  at Ipc.sendSync (/Applications/Atom.app/Contents/Resources/atom/renderer/api/lib/ipc.js:39:29)
  at Ipc.sendChannelSync (/Applications/Atom.app/Contents/Resources/atom/renderer/api/lib/ipc.js:47:28)
  at BrowserWindow.RemoteMemberFunction [as getSize] (/Applications/Atom.app/Contents/Resources/atom/renderer/api/lib/remote.js:110:29)
  at Atom.module.exports.Atom.getWindowDimensions (/Applications/Atom.app/Contents/Resources/app/src/atom.js:501:29)
  at Atom.module.exports.Atom.storeDefaultWindowDimensions (/Applications/Atom.app/Contents/Resources/app/src/atom.js:533:25)
  at /Applications/Atom.app/Contents/Resources/app/src/window-event-handler.js:95:21
  at handler (/Applications/Atom.app/Contents/Resources/app/src/space-pen-extensions.js:115:32)
  at jQuery.event.dispatch (/Applications/Atom.app/Contents/Resources/app/node_modules/space-pen/vendor/jquery.js:4681:9)
  at elemData.handle (/Applications/Atom.app/Contents/Resources/app/node_modules/space-pen/vendor/jquery.js:4359:46)

Commands
     -1:09.7 vim-mode:move-right (input.hidden-input)
     -0:30.3 vim-mode:activate-insert-mode (input.hidden-input)
     -0:21.4 vim-mode:activate-command-mode (input.hidden-input)
     -0:20.4 vim-mode:activate-insert-mode (input.hidden-input)
     -0:15.6 core:save (input)
     -0:14.4 core:backspace (input.hidden-input)
     -0:12.2 core:save (input.hidden-input)
     -0:03.1 vim-mode:activate-command-mode (input.hidden-input)
     -0:02.7 vim-mode:activate-insert-mode (input.hidden-input)
     -0:00.0 core:save (input.hidden-input)

Ok, so you're denying yourself read or write access to the file? So Atom should be unable to open the file. Do you just mean that Atom should handle the failure more gracefully?

Yes, that's what I meant. Of course, I understand that atom could not open my file, but not why he told me that with an Uncaught Error.

I agree; we should be handling this error better. Thanks!

If I understood the request correctly, this might be a duplicate of https://github.com/atom/atom/issues/1405

Yeah, you're right. Closing in favor of that issue. Thanks, @izuzak!


Ensure that we have timeouts in place when reading/writing nodes in IPFS

From: https://github.com/ipfs/dynamic-data-and-capabilities/issues/50
Ensure that we have timeouts in place when reading/writing nodes in IPFS

cc @satazor

Removing my assignment as I'm not currently working on this.

Resolved by #258


brew info [TAB] completion in ZSH prints errors but suggests nothing

brew doctor output
Warning: Your Cellar and TEMP directories are on different volumes.
macOS won't move relative symlinks across volumes unless the target file already
exists. Brews known to be affected by this are Git and Narwhal.

You should set the "HOMEBREW_TEMP" environment variable to a suitable
directory on the same volume as your Cellar.

Verification

[X] My "brew doctor output" above says Your system is ready to brew. and am still able to reproduce my issue.
[X] I ran brew update twice and am still able to reproduce my issue.
[X] This issue's title and/or description do not reference a single formula e.g. brew install wget. If they do, open an issue at https://github.com/Homebrew/homebrew-core/issues/new/choose instead.

brew config output
HOMEBREW_VERSION: 3.6.15
ORIGIN: https://github.com/Homebrew/brew
HEAD: 11cdffb4fef84828a7e02860212b30ce4fac85f5
Last commit: 7 days ago
Core tap: N/A
HOMEBREW_PREFIX: /opt/homebrew
HOMEBREW_AUTOREMOVE: set
HOMEBREW_CACHE: /Users/brew/.cache/Homebrew
HOMEBREW_CASK_OPTS: ["--appdir=/Applications", "--colorpickerdir=/Users/kentzo/Library/ColorPickers", "--prefpanedir=/Users/kentzo/Library/PreferencePanes", "--qlplugindir=/Users/kentzo/Library/QuickLook", "--mdimporterdir=/Users/kentzo/Library/Spotlight", "--dictionarydir=/Users/kentzo/Library/Dictionaries", "--fontdir=/Users/kentzo/Library/Fonts", "--servicedir=/Users/kentzo/Library/Services", "--input-methoddir=/Users/kentzo/Library/Input Methods", "--internet-plugindir=/Users/kentzo/Library/Internet Plug-Ins", "--audio-unit-plugindir=/Users/kentzo/Library/Audio/Plug-Ins/Components", "--vst-plugindir=/Users/kentzo/Library/Audio/Plug-Ins/VST", "--vst3-plugindir=/Users/kentzo/Library/Audio/Plug-Ins/VST3", "--screen-saverdir=/Users/kentzo/Library/Screen Savers"]
HOMEBREW_INSTALL_FROM_API: set
HOMEBREW_LOGS: /Users/brew/.cache/Homebrew/Logs
HOMEBREW_MAKE_JOBS: 10
HOMEBREW_NO_ANALYTICS: set
HOMEBREW_NO_AUTO_UPDATE: set
Homebrew Ruby: 2.6.10 => /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/bin/ruby
CPU: 10-core 64-bit arm_firestorm_icestorm
Clang: 14.0.0 build 1400
Git: 2.39.0 => /opt/homebrew/bin/git
Curl: 7.79.1 => /usr/bin/curl
macOS: 12.6.1-arm64
CLT: <IP_ADDRESS>.1.1666437224
Xcode: 14.2
Rosetta 2: false

What were you trying to do (and why)?
Trying to auto-complete brew info [TAB] in ZSH 5.8.1
What happened (include all command output)?
$ brew info find: /opt/homebrew/Library/Taps: No such file or directory
find: /opt/homebrew/Library/Taps: No such file or directory
find: /opt/homebrew/Library/Taps: No such file or directory
find: /opt/homebrew/Library/Taps: No such file or directory
find: /opt/homebrew/Library/Taps: No such file or directory
find: /opt/homebrew/Library/Taps: No such file or directory
What did you expect to happen?
Suggest a formula for completion or do nothing without printing errors.
It seems like current autocompletion function requires the "Taps" directory to exist, but it was not created by Homebrew installation. I did not delete this directory manually. Adding this directory removes the errors but there is still no completion.
Step-by-step reproduction instructions (by running brew commands)
`brew info [TAB]` in ZSH 5.8.1

brew's ZSH completion probably isn't able to handle HOMEBREW_INSTALL_FROM_API yet.
I think the find usage is from:
https://github.com/Homebrew/brew/blob/884c4bec14073314ac6e8e9a6a64bc3b26161ab6/Library/Homebrew/items.sh#L21
Which is used by:
https://github.com/Homebrew/brew/blob/884c4bec14073314ac6e8e9a6a64bc3b26161ab6/completions/zsh/_brew#L60
Easiest way would be to just output nothing when Taps directory doesn't exist. For actual completion with HOMEBREW_INSTALL_FROM_API, may need to query API and cache.


Has no method 'fetchToken'

If other aciton, a error will happen.
TypeError: Object #<Object> has no method 'fetchToken'
Line 46, replace this to self can solve it :)

Thanks! :-) I'm will push v0.1.5 on NPM with this fix in a few minutes.


Update 002-stake-off-attestation-maven.md - add syncnode

Description
A few sentences describing the overall effects and goals of the pull request's commits.
Adding syncnode group address for master validator badge
Other changes
Describe any minor or "drive-by" changes here.
Tested
More than 100 points received during the stake off security audits
Related issues
-N/A
Backwards compatibility
N/A

Hey @gbunea,
The requirement for attestation maven was 95%, but you received a 87.5% score. Sorry!


Update organisation - logic not clear

Hi, I have a doubt about the logic to update the organisations. In the part that is updating the partOF part, there is something I cannot understand. See line 251.
PART_OF existingpart_of = getPartOfIfAlreadyStored(obj, rel.getOrganisation_mother());
if (existingpart_of != null) {

    statement2 = connect.prepareStatement(UPDATE_PART_OF, Statement.RETURN_GENERATED_KEYS);
    if (rel.getFromDate().before(existingpart_of.getFromDate())) {
        existingpart_of.setFromDate(rel.getFromDate());
    } else if (rel.getUntilDate().after(existingpart_of.getUntilDate())) {
        existingpart_of.setUntilDate(rel.getUntilDate());
    }
    statement2.setDate(1, new java.sql.Date(existingpart_of.getFromDate().getTime()));

    statement2.setDate(2, new java.sql.Date(existingpart_of.getUntilDate().getTime()));
    statement2.setLong(3, obj.getOrganisationId());
    statement2.setLong(4, rel.getOrganisation_mother().getOrganisationId());
    int code = statement2.executeUpdate();
    result = true;
    statement2.close();
} else {

    PART_OF existingInversepart_of = getPartOfIfAlreadyStored(rel.getOrganisation_mother(), obj);
    if (existingInversepart_of == null) {
        statement2 = connect.prepareStatement(SQL_INSERT_MOTHERS);

        statement2.setFetchSize(Integer.MIN_VALUE);
        statement2.setLong(1, rel.getOrganisation_mother().getOrganisationId());
        statement2.setLong(2, obj.getOrganisationId());
        if (rel.getFromDate() == null) {
            statement2.setDate(3, new java.sql.Date(00000000L));
        } else {
            statement2.setDate(3, new java.sql.Date(rel.getFromDate().getTime()));
        }
        if (rel.getUntilDate() == null) {
            statement2.setDate(4, new java.sql.Date(00000000L));
        } else {
            statement2.setDate(4, new java.sql.Date(rel.getUntilDate().getTime()));
        }

        int code2 = statement2.executeUpdate();
        statement2.close();
    }
}

The first IF check whether the PART_OF exists, if it exists, then is updating it. No problem with that.
The second part of the if it's weird. If the PART_OF doesn't exists, is checking whether the inverted relationship exists, and if it doesn't it's adding it (the inverted relationship).
if on the database I have only the organisation ALPAGE without relationships, and I get an update to the same organisation with motherOrganisation INRIA. In this case the code will result in adding a relationship PART_OF with motherOrganisation = ALPAGE and organisationID = Inria, as it won't find the relationships motherOrganisation = INRIA and organisationID = ALPAGE
What do you think?

Actually the checking was made to ensure that there is no inverted relationship when the organisations were deduplicated based on their names (which was reverted here 1e335ab)

It was too long ago that I have opened this issue. Did you test your change to see whether it can work for all the cases? Maybe it's worth it before closing it. ;-)

it should be part of this commit actually 1e335ab , but since deduplicating using names is not a reliable thing, this check is not needed and following a certain logic an organisation should be either a mother or a child for a given part_of relation


HARP-6118: Implement whole GeoJson management in FeaturesDataSource.

Needs https://github.com/heremaps/harp.gl/pull/611

@heremaps-bot retest this please


Add "We're Hiring" page

Migrated from GitLab: https://gitlab.com/meltano/meltano/-/issues/2739
Originally created by @DouweM on 2021-05-03 16:42:03

View 9 previous comments from the original issue on GitLab


[Feature Request] if fail to install, show download link

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

i use potable version. (2.3.4)
when i click update button,  window installer show error message box.
(i guess ... because potable version)
I suggest to ....
if fail to install like me,  show download url .

I cannot add any information to that error message as it's part of the Microsoft Installer UI.
Your version is failing to install because the app had some substantial changes between v.2.34 and 2.35 and newer versions.


Can not push images into the harbor's registry

I cann't push images into the harbor's registry, always retrying.
Drive me crazy, how to solve it ???
[root@KZJHZ1H009230P harbor]# dcc ps
       Name                     Command               State                                Ports
------------------------------------------------------------------------------------------------------------------------------
harbor-adminserver   /harbor/harbor_adminserver       Up
harbor-db            docker-entrypoint.sh mysqld      Up      3306/tcp
harbor-jobservice    /harbor/harbor_jobservice        Up
harbor-log           /bin/sh -c crond && rm -f  ...   Up      <IP_ADDRESS>:1514->514/tcp
harbor-ui            /harbor/harbor_ui                Up
nginx                nginx -g daemon off;             Up      <IP_ADDRESS>:443->443/tcp, <IP_ADDRESS>:4443->4443/tcp, <IP_ADDRESS>:80->80/tcp
registry             /entrypoint.sh serve /etc/ ...   Up      <IP_ADDRESS>:5000->5000/tcp
[root@KZJHZ1H009230P harbor]# docker login hub3.yfcloud.com
Username (admin): admin
Password:
Login Succeeded
[root@KZJHZ1H009230P harbor]# docker push hub3.yfcloud.com/hello-world:latest
The push refers to a repository [hub3.yfcloud.com/hello-world]
45761469c965: Retrying in 9 seconds
^C761469c965: Preparing

Provide the logs under directory /var/log/harbor/.

@ywk253100
/var/log/harbor/2017-09-06/registry.log
this one?

/var/log/harbor/2017-09-06/registry.log
Sep  6 16:49:28 <IP_ADDRESS> registry[9168]: time="2017-09-06T08:49:28.671784927Z" level=debug msg="authorizing request" go.version=go1.7.3 http.request.host=<IP_ADDRESS> http.request.id=5803f436-7ba5-40ef-85df-d249d7378796 http.request.method=GET http.request.remoteaddr=<IP_ADDRESS> http.request.uri="/v2/" http.request.useragent="docker/1.12.6 go/go1.7.4 kernel/3.10.0-123.el7.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/1.12.6 \\(linux\\))" instance.id=6fed05cd-a059-4ad4-9311-9961c5f734cc service=registry version=v2.6.2
Sep  6 16:49:28 <IP_ADDRESS> registry[9168]: time="2017-09-06T08:49:28.671881804Z" level=warning msg="error authorizing context: authorization token required" go.version=go1.7.3 http.request.host=<IP_ADDRESS> http.request.id=5803f436-7ba5-40ef-85df-d249d7378796 http.request.method=GET http.request.remoteaddr=<IP_ADDRESS> http.request.uri="/v2/" http.request.useragent="docker/1.12.6 go/go1.7.4 kernel/3.10.0-123.el7.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/1.12.6 \\(linux\\))" instance.id=6fed05cd-a059-4ad4-9311-9961c5f734cc service=registry version=v2.6.2
Sep  6 16:49:28 <IP_ADDRESS> registry[9168]: <IP_ADDRESS> - - [06/Sep/2017:08:49:28 +0000] "GET /v2/ HTTP/1.1" 401 87 "" "docker/1.12.6 go/go1.7.4 kernel/3.10.0-123.el7.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/1.12.6 \\(linux\\))"

@ywk253100
** msg="error authorizing context: authorization token required"**
this err?

@ywk253100
I logined to harbor registry by the admin account configured in the harbor.cfg, then push,
why the registry prints "error authorizing" ?

Package all logs under /var/log/harbor/2017-09-06/ and upload it.

harbor_log.zip
@ywk253100  thanks a lot

You need to create a project on the web page first, refer to the user guide about the detail.

@ywk253100 I created the project already, I tried many times in different severs.
I followed the user guide.
OMG

At least two namespaces are needed for repository name in Harbor. So tag your image hub3.yfcloud.com/hello-world:latest as hub3.yfcloud.com/your_project/hello-world:latest.

@ywk253100 you're right, closed