Download all files from a Dataverse dataset based on launching Whole Tale from one of the files.

I have a replication dataset at https://github.com/pdurbin/dataverse-irc-metrics that I have working with MyBinder and I sometimes import into Dataverse (just dev servers for now). It looks like this:

From Dataverse I'd like to click "Explore" and then "Whole Tale" on a Jupyter Notebook like this...

... and execute that Jupyter Notebook in Whole Tale.
Right now in Whole Tale I only see the one file that I clicked:

In Whole Tale Slack I suggested to @Xarthisius that perhaps as a workaround until Dataverse external tools (like Whole Tale) are supported at the dataset level (see https://github.com/IQSS/dataverse/issues/5028 ), Whole Tale could download all the files for that dataset based on a single file. He said to go ahead and create this issue and I'm very happy to help explain what needs to be done. In short it should be something like this:

Based on the ID of the file in Dataverse, figure out the DOI or Handle (collectively called Persistent ID or PID) of the parent dataset.
Download a JSON or XML representation of the dataset that has all the file database IDs.
Put all the file IDs together separated by commas and feed it into the Dataverse "Data Access" API like this: https://demo.dataverse.org/api/access/datafiles/307909,307910,307908?gbrecs=true . Docs at http://guides.dataverse.org/en/4.14/api/dataaccess.html#multiple-file-bundle-download

I believe the concept of downloading all files based on the DOI of a dataset has already been implemented. There are docs at https://wholetale.readthedocs.io/en/stable/users_guide/manage.html that we link to from http://guides.dataverse.org/en/4.14/admin/integrations.html#whole-tale and that look like this:

So it might be that the only thing you need is how to find the parent DOI of the dataset based on the file.
Given 3371438 from https://dataverse.harvard.edu/file.xhtml?fileId=3371438 one way to discover the DOI of the parent dataset is like this:
curl -s https://dataverse.harvard.edu/api/search?q=identifier:3371438 | jq -r '.data.items[0].dataset_persistent_id'
doi:10.7910/DVN/TJCLKP
Here's a screenshot of the same idea in a browser:

Thanks, @pdurbin. I'm excite to see progress on this.
In addition to your request to downloading all files based on one of the files, there is another finer point we're going to need to work out.
Every "tale" in Whole Tale has two primary folders: one for external data and the other we call the tale "workspace". A fundamental part of our design is that data imported from external sources, such as Dataverse, is immutable and therefore read-only. This ends up in the "data" folder with the expectation that your code that operates on that data is in the "workspace" and produces derived datasets or analytical results in the workspace. The case you're describing here seems to be better suited by the data package being brought into the "workspace", where the user has read/write capabilities in the notebook.  In our latest version, repo2docker runs on the "workspace".
If we implement the suggested change, the data package would end up in the "data" directory (readonly) with the workspace empty. This isn't likely what you were expecting.
In the future, if a "tale" were published to Dataverse, we would want to import it as such. One option might be for us to detect that this is a repo2docker compatible data package and treat it as a "tale" on import bringing the files into the workspace, which would require additional changes and would merit further discussion.

@craig-willis ok. I think I understand. At a high level there is a lot of interest in the Dataverse community in a workflow like this:

I'm looking at a dataset in an installation of Dataverse.
I click a button called "Compute"  or "Exectute Code" or similar.
I am brought into an environment such as Whole Tale where I can run the code I was looking at in Dataverse and perhaps make some modifications to that code.

It sounds like we're not quite there yet. I wonder if describing the Whole Tale external tool with "Dataverse users can launch Jupyter and RStudio environments to analyze published datasets" at http://guides.dataverse.org/en/4.14/installation/external-tools.html is a bit too optimistic. Maybe it was just wishful thinking on my part. 😄  Like you said, it sounds like there are still some details to work out. I still think Whole Tale needs all the files in the dataset though, especially if you want to run repo2docker on them. So maybe this issue represents the next step? And then we can think more about data vs. workspace later? Or as part of this issue? Whatever you prefer. 😄

Thanks, @pdurbin.

I wonder if describing the Whole Tale external tool with "Dataverse users can launch Jupyter and RStudio environments to analyze published datasets" at http://guides.dataverse.org/en/4.14/installation/external-tools.html is a bit too optimistic.

There is a distinction between launching Jupyter and Rstudio environments to analyze published datasets, which we do support, and launching a customized environment with repo2docker configuration files to run a Jupyter notebook or R script included in the package.  The first we support (don't we?) but the second not yet.
I wanted to elaborate a bit on the "external data" capability in Whole Tale, as it's one that may be of interest to Dataverse and we'd welcome your feedback on. I'd also like to bring your attention to our nascent Tale format specification.
Consider the following example:
The replication package Replication Data for: The Hostile Audience: The Effect of Access to Broadband Internet on Partisan Affect contains a file called bbindex.csv used to create Figure 1 in the paper. According to a footnote, the file was downloaded from the FCC website http://transition.fcc.gov/wcb/iatd/comp.html. Browsing to the FCC site, you can see multiple versions of that dataset. Which version was used?  Has it been modified in any way? What if this was part of another dataset published in Dataverse or ICSPR, how do we encourage proper citation and attribution?  Had the researcher created the replication package in Whole Tale and registered the source dataset, we would have an explicit reference to the original version and, since we treat it as read only, have some confidence that it wasn't modified in any way before use.  If they created a "tale" and published it back to Dataverse, we can also ensure that the source dataset is properly cited and credited.
With our current "external tools" integration, we treat Dataverse datasets as external data, which means they are considered immutable and brought into the "data" directory instead of the "workspace" (which contains code, repo2docker configuration etc).
However, as you've noted the expectation changes when the published dataset contains code and data as above -- is a published "tale" or "binder". Now the expectation is that the "dataset" be treated not as input data, but as an executable environment where the user would need read-write access to run code/notebooks and generate outputs.
In our current integration with DataONE, we publish using our tale format  -- based on BagIt-RO work -- which includes a manifest.json file that allows us to determine that this is indeed a tale, keeps track if cited datasets,  and, among other things, allows us to reconstruct a filesystem hierarchy from a system that requires a flat organization. You can see a very basic example here: doi:10.5063/F1VD6WSP.  But this is a tale, not a binder or non-binder AJPS replication package. We've also created a demonstration video that shows how this works for both export and publishing to DataONE.
Admittedly, the average researcher may not fully understand the value of our external data approach, but I would hope that data repositories do.  The "tale format" is something we're starting putting forward, but is obviously not part of the Binder/repo2docker framework. And finally, we're certainly interested in supporting the case you've described: running non-tale binder/replication package/research compendium/capsules, but we don't (yet) have a way of detecting that these should be treated differently than other Dataverse datasets.

@craig-willis hi! I popped in here to say that for the "find a dataset based on its file ID" method I mentioned above that instead of...
curl https://dataverse.harvard.edu/api/search?q=identifier:3371438
... the following might be slightly better or more future proof:
curl https://dataverse.harvard.edu/api/search?q=entityId:3371438
But either one is fine.
@Xarthisius mentioned some work going on in https://github.com/whole-tale/girder_wholetale/pull/317 which is great! Thank you!!

Thanks, @pdurbin.   Sorry for the long comment yesterday, but I do think it's important that we're on the same page about some of the design assumptions in Whole Tale w.r.t. Dataverse integration. It may seem out of scope for this issue, but what you're really asking for in the description is the ability to run a Binder-compatible replication-package published to Dataverse in Whole Tale (hence https://github.com/whole-tale/girder_wholetale/pull/317).

@pdurbin We've deployed a preliminary version (proof-of-concept) of this to https://dashboard.stage.wholetale.org (thank you @Xarthisius).
This includes the following:

Downloads all files from dataset based on launching WT on one file
Adds the "Import as Tale" toggle to bring the dataset contents into the workspace (needed for repo2docker to build the image)
Adds a "Jupyter with R" base environment

Using the external tools integration, you should be brought to the "Compose" page to select the desired base environment (in your case "Jupyter with R"). Selecting "Import as Tale" will pull things into the workspace and repo2docker will run during launch:

Clicking "Launch Tale" will build the image and take you to the Run page with the built environment:

Note that this doesn't yet include https://github.com/whole-tale/girder_wholetale/pull/319, so there is no data directory for irclog.tsv. I added a dir.create("data") prior to the download in your notebook and it seems to work.
Feedback welcome.

@pdurbin Follow-on question when you have a minute.   In https://github.com/whole-tale/girder_wholetale/pull/319 we're retrieving the full folder hierarchy when present.
In your example https://dev2.dataverse.org/dataset.xhtml?persistentId=doi:10.5072/FK2/NYNHAM, the path starts with dataverse-irc-metrics-8f0b5b505de7730ebd9d57439952542a66a6bae0/ because you apparently downloaded the zipfile for a particular Github commit and uploaded to Dataverse. The repo2docker configuration is in this subdirectory.  In this case we'd like to strip that first path element when importing.
In the repo2docker Zenodo provider,  they use a heuristic to try to determine whether to ignore the first path element when building the image. If the downloaded dataset as "upload_type=software" and there's only one file (i.e., a zipfile), then strip that first path element after unzipping.
Do you have any thoughts how we should handle this with Dataverse?  The user could upload a zipped Github repo as you did; manually upload repo2docker config files into a dataset; or even upload a zipped zipfile.

@craig-willis @Xarthisius @matthewturk thanks for all the help this morning.
I guess I'm a little confused why there's a "data" directory in Dataverse with the "irclog.tsv" I want...

... but on the Whole Tale side there is no "data" directory and no "irclog.tsv" file...

I'm excited that most of the files have been brought over and I have a line in my Jupyter notebook to download the irclog.tsv from my server but am I missing something? Why is there no "data" folder with the "irclog.tsv" file in it.
It's almost lunch time here at #dataverse2019 and no worries about replying right away. We can talk this out next week or whenever. If I do try to demo this stuff instead of giving my planned talk, I'll just use my workaround of downloading "irclog.tsv" from my server by executing the appropriate line in my Jupyter Notebook.
@craig-willis I don't think I answered any of your questions above. When I catch my breath, I will. 😄
Thank you to all! 🎉

@pdurbin it's because https://github.com/whole-tale/girder_wholetale/pull/319 was not merge there when dataset was first imported, but notice that there's irclog.tsv in there, just not in the data/

but notice that there's irclog.tsv in there, just not in the data/

Oh! Duh! Thanks, @Xarthisius! I was blind to it. 🎉

This is done, right? I mean, I demo'ed this half a year ago in my crazy ideas talk: https://scholar.harvard.edu/pdurbin/blog/2019/jupyter-notebooks-and-crazy-ideas-for-dataverse
Besides, these days Dataverse supports launching Whole Tale from a dataset page. In fact, we just enabled it on our demo site: https://github.com/IQSS/dataverse/issues/6446
Closing.


Reflex sometimes misses changes

@dmac noticed this one. He's on a Mavericks OS X laptop. From watching the debug logs, it looks like a single change can arrive that batches a write and a chmod; right now we're ignoring all attribute change events so it gets ignored.
This may be a recent fsnotify change.

Cannot reproduce on my Yosemite machine because it won't produce the WRITE|CHMOD events. But I think I have the fix.


add credential-rotation guide

Description

Related Issue

Motivation and Context

How Has This Been Tested?

Screenshots (if appropriate):
Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

[x] I have signed the Adobe Open Source CLA.
[x] My code follows the code style of this project.
[ ] My change requires a change to the documentation.
[x] I have updated the documentation accordingly.
[x] I have read the CONTRIBUTING document.
[ ] I have added tests to cover my changes.
[x] All new and existing tests passed.

Maybe this should be stated twice? Before and after the command?
"You must pass ALL parameters in a single update call. Any parameters not specified will disappear."

Yeah, I kinda wanted to see how it looked before I tweak it, we want it to be super clear.


bonds in colab renderer

Its possible I'm not setting this up right, but I'm not able to get renderer.Bond to work. Here is a minimal example: https://colab.research.google.com/drive/1nPn6N-kEBTmv0UQWK1djgX5hvP-bCqon?usp=sharing
I based this a bit on the Neural Network Potentials notebook, but I couldn't test that because the supplementary.zip file isn't loading (perhaps that should be filed in a separate issue!).
Am I missing something?

Great question! Although undocumented, the bonds only work in 3d at the moment. For right now, maybe try drawing in 3d with spheres instead of disks. I'll make a note to add 2d bonds soon though.


getting the formatted source back into the vscode editing buffer

okay, with vscode factory reset, I go in and start the uiua extension, open my .ua file and vscode's terminal, start uiua there, make some changes to my .ua file, they save, the uiua interpreter shows the stack effects, then when I go to make more changes, vscode tells me there's a file conflict (apparently since uiua has overwritten the original file textual commands with glyphs).  I go into the settings on the "Files: Save Conflicts Resolution" and there doesn't seem to be an option for vscode to just use the modified file without prompting me.  Is there an extension or setting which would allow vscode to revert that file so the glyphs come back in automatically?
Also, is this the proper procedure?   Am I supposed to open vscode's terminal and start uiua in the directory containing the *.ua file or is this extension supposed to do that automatically (and give me the stack traces somewhere else)?
It seems like I've seen the formatted code sometimes show back up in the source buffer but it doesn't seem consistent and I don't know what I'm doing that does it.  It seems like maybe it shows up after a fairly long delay.
Maybe the former issue is popping up because I'm trying to type in the buffer at the same time uiua is re-writing the *.ua file and that's where the conflict arises?

The intended use is to have the uiua process running in the vscode terminal with format-on-save enabled.
Saving the buffer should show outputs in the terminal.


zsh-git-prompt: Init at 0.5

Motivation for this change
This is a plugin of sorts for your .zshrc that can add status information about the current git repository to your prompt. By default it uses a python script and is thus easy on the dependencies and not really worth packaging. But there's also a Haskell implementation. I set it up sometime back, but then it died when the libgmp version it was compiled with disappeared in a garbage collection. So I decided that the Haskell version of zsh-git-prompt might be worth packaging after all.
Things done

[ ] Tested using sandboxing
(nix.useSandbox on NixOS,
or option build-use-sandbox in nix.conf
on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] Linux

[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[x] Fits CONTRIBUTING.md.

@Mic92 Good suggestion, incorporated that into an improved usage doc.


port: fix file transcript logger

https://github.com/microsoft/botbuilder-dotnet/pull/5047/files

Actually handled via https://www.npmjs.com/package/filenamify


Hue 3.11.0  Metastore Manager refresh button

Hi,

No matter where I click the refresh button, the button will be triggered.
Can we separate the two functions?

Are you talking about the refresh metadata option for Impala? What is the other function you are referring too?


 On my way home from a trip, I'll fix it tonight or tomorrow.
I think I added a chat limit when I was making them, but lost it when I reverted to an earlier commit.


Adding module causes realpath to be resolved in config file

When adding a new api through the ui the config/application.config.php file is written with the new Module added. The default config line
'config_glob_paths' => array(realpath(__DIR__) . '/autoload/{,*.}{global,local}.php'),
is then written with the output of
realpath(__DIR__)
e.g.
'config_glob_paths' =>  '/vagrant/config/autoload/{,*.}{global,local}.php'),
which causes problems when the application is served from a different location.

:+1:

oof; I can't believe this hasn't been reported earlier!
The only way I can see fixing this is to do the following:

Alter the config/application.config.php in zf-apigility-skeleton to import the list of modules from another file.
Alter zf-apigility-admin to write modules to that other file.

For BC purposes, we'd write to config/application.config.php if the new file is missing; that's the only way to keep things working. I'll see if I can get a working PoC in the next few days.

For those who are affected by this issue, you can do the following:

composer require zfcampus/zf-apigility-admin:dev-master@dev --dev
Modify your config/application.config.php file as follows:

Create a new file, config/modules.config.php, with the following contents:return array(
    // copy and paste the contents of the 'modules' array from application.config.php here
);

Update config/application.config.php to read:'modules' => include __DIR__ . '/modules.config.php',

If necessary, update any lines that previously had PHP directives or constants in them.

At that point, your application configuration will be safe from changes going forward.


grpc codec support proto v1 message

Signed-off-by: Shi Ben<EMAIL_ADDRESS>Description
grpc codec support proto v1 message("github.com/golang/protobuf/proto".Message)
Issue reference
#4865

@BenLocal please run go mod tidy and push the changes.

@BenLocal did you test this fix locally with v1 proto messages?

@yaron2, yes，but only use the debug test，I will add the test code in codec_test.go later

I meant, did you build daprd and test this end to end with proxying v1 messages.


Support case expression

http://jira.nebula-graph.io:8081/projects/NG/issues/NG-281?filter=allissues
Based on:
https://github.com/vesoft-inc/nebula-common/pull/269
https://github.com/vesoft-inc/nebula-storage/pull/183

@jievince @randomJoe211 Docs required.

CI failed due to https://github.com/vesoft-inc/nebula-graph/pull/316

@randomJoe211 need documents about  case expression


zookeeper vs libkv

Hey, quick question,
have you considered abstracting to docker's libkv
https://github.com/docker/libkv/blob/master/store/zookeeper/zookeeper.go#L157
removing a direct dependence on zookeeper?
I liked the REST interface on vamp-router

Definitely we can use libkv and probably we will. Reason why we use right now only ZooKeeper is because Mesos/Marathon use it. We even thought to support also Consul and/or etcd in the first release (Vamp 0.8.0) but since we are not going to use it now we didn't want to spend additional time on testing different setups.
Main reasons why we don't use Vamp Router now is because agent allows us faster Vamp iterations, e.g. changing how we use HAProxy fe/be/filters, to avoid often updates of Router in production due to new Vamp features (Vamp will generate HAProxy configuration) etc.
So, this agent is very Vamp centric while Vamp Router is more complete and independent of Vamp. I guess that in the future we could start using Router again for Vamp (better than to start adding higher level features to the agent).

Implemented using libkv for ZooKeeper.


DHpanel creates databases not in UTF8 format

CREATE DATABASE `foo` DEFAULT CHARSET utf8 COLLATE utf8_general_ci;

CREATE TABLE `bar` (
  `baz` int NOT NULL AUTO_INCREMENT
  PRIMARY KEY (`id`)
) DEFAULT CHARSET utf8 COLLATE utf8_general_ci;

DH won't let me run the first statement.

Need to change the database according to this.
Need to document this (wiki and possibly /docs).

You are correct, databases can be created in the DreamHost panel only.
Databases cannot be created via SSH or phpMyAdmin. View the following
article for further details:
https://help.dreamhost.com/hc/en-us/articles/221621388-Managing-existing-MySQL-databases
You can change the database collations using phpMyadmin. You will need to
select the database name and then you can set you MySQL connection
collation via a "pull down" menu in the left most column of the right
frame of the default page that is displayed. You can connect using
phpMyadmin by following these steps:
https://help.dreamhost.com/hc/en-us/articles/214395638
This article can also be useful:
https://dev.mysql.com/doc/refman/8.0/en/charset-connection.html


fix: examples incorrectly nested for POST /leaf

Root cause of https://github.com/madpah/transparency-exchange-api/actions/runs/11933709569/job/33261312468

Reviewed by @vpetersson (not yet maintainer).


Some more features for the masters local wrapper and a new user command

The user command should facilitate the administration of the internal cloudnet users easier.

@GiantTreeLP anything you would change? Looks fine in my opinion. But the conflicts have to be resolved

LGTM. Fix the conflicts and this can be merged.
Make sure to test this though.


Missing template account/snippets/already_logged_in.html

From the password reset form the already logged in template looks to be missing.  Was this just omitted in error from django allauth or is there another reason?

It's not included because there's no reason for us to override what django-allauth provides via https://github.com/pennersr/django-allauth/blob/master/allauth/templates/account/snippets/already_logged_in.html. Bootstrap won't break on paragraph or strong tags.
If an error is being thrown, or formatting is off, please reopen.

Good point! Thanks..


Required git version bump to 2.7.0 since v1.8.0

Gitea version (or commit ref): 1.8.1
Git version: <IP_ADDRESS>
Operating system: Centos 7
Database (use [x]):

[X] PostgreSQL
[ ] MySQL
[ ] MSSQL
[ ] SQLite

Can you reproduce the bug at https://try.gitea.io:

[ ] Yes (provide example URL)
[ ] No
[X] Not relevant

Log gist:

Description
Since v1.8.0 the mirror repos did not show the remote url anymore. The log file gaves the answer.
Gitea try to use the command "git remote get-url origin", but this was not supported by the installed version.
The change comes with following commit: b3e757a06c2cfc554c7db0e2da170b123404f058
(See changed file https://github.com/go-gitea/gitea/commits/master/models/repo_mirror.go)
The min required version of git is: GitVersionRequired = "1.7.2" - so there is no error about this incompatibility.
(See https://github.com/go-gitea/gitea/blob/master/modules/git/git.go)
Is it possible to use "git config --get remote.origin.url" instead of the current behavior? Temporary I use an current version of git from the scl repo (SoftwareCollections) for gitea, but I think it's a problem for most enterprise distros like centos and debian (which is very restrictive the most time, too).

https://github.com/go-gitea/gitea/blob/master/modules/git/git.go is not right, but I think we may need to downgrade the git version requirement.

Sorry about this. This was part of a bug fix for an extremely serious security issue.
I will take a look - but could you also take a look to ensure that they're functionality equivalent too.

I suspect this is the same issue as #6896

Maybe we need a docker with old git to run the tests.

Well we should probably ensure that the git in our docker matches our minimum required git.

OK git config --get remote.<name>.url is not equivalent to git remote get-url <name> although it is if you don't have an insteadOf set.  As this technically incorrect result is not a downgrade from the situation prior to my bug-fix rather than spending time reimplementing git remote get-url - those people using old gits and insteadOf will just have to suffer it being wrong. I'll write a PR that checks the git version and uses get-url if it is available otherwise will use the old thing.


Setup Travis for skip whitelist

Follows up on #1069
Waiting on @travis-ci:

[x] python-xlwt
[x] python-zsi
[x] python-zmq
[ ] python-qgis

Travis seems to be giving up on approving PRs for the whitelist, we should either not use qgis or switch to a sudo: true build.


Placeholder on select2 highlight won't go away

When you have a placeholder (either select2's attrb or html5 attrb) on your select2 control, and you double click, a highlight goes on top of it. When you try to lose focus, the highlight still doesn't go away.
I tested this on google chrome on my own site and the demo site:
http://ivaynberg.github.io/select2/
Go to placeholders
double click the dropbox repeatedly until a blue box highlights the text. Click out. Highlighted text is still there.

Closing this off because of the lack of activity. If this is not fixed in 4.0, and you are interested in seeing it fixed, add a :+1: to the ticket to bring it to our attention.
If you can add additional details, that would also be useful.


feat(facts): add a fact about life

Description
This does. I helped add a string into you're Java code.
This is a Unlogic Change

[x] Changes have been untested.

This is a UI Change

[x] This has been not previewed and does not looks as intended

incorerct


Caption under images

I'm often inserting images into my slides using html to easily control their size:

However, I am struggling to easily put a caption below them. E.g. let's say I have 3 pictures in my slide with a width of 30%. Any tips on how to put a small caption below that is centered wrt each image?

@jdumas, have you tried with flexbox?

I'm a bit of a css noob. Could you provide an example of what you suggest?

Could you provide an example of what you suggest?

Apart from the spec linked above: a tutorial, some visual examples to interact with.

Thanks for the resources. I'll try to see if it can solve my caption problem.

@jdumas, this was my suggestion. Nothing to do with remark specifically though; it's vanilla HTML & CSS. I'm not sure whether/how Markdown will swallow this piece of HTML, but in theory it should be okay to embed this in any Markdown source document.

Yes we can mix html with markdown. But with remark we can also define our own css class in the html header, and use them in the markdown source (e.g. .foo[My text]). So I was hoping we could define some magic bongo to avoid having to layout everything in pure html (since once I open a
 in the markdown source, I cannot put markdown inside, I have to do it in pure html, which is a pain).

@jdumas, like this?

Yes! Nice example =).
Also, I think we can get rid of the hardcoded 33.3% width by using justify-content: space-around; in .special-list ul

I think we can get rid of the hardcoded 33.3% width by using justify-content: space-around; in .special-list ul.

You're right. I updated the pen with justify-content: space-between;.

Actually I do notice something a bit weird when I try on my presentation. Starting from the boilerplate html code and running this MWE:
<!DOCTYPE html>

    <title>Title</title>
    <meta charset="utf-8">

    <textarea id="source">

class: center, middle

# Title

---

# Agenda

1. Introduction
2. Deep-dive
3. ...

---
# with flexbox layout

.special-list[
* ![Mizaru](https://upload.wikimedia.org/wikipedia/commons/6/6e/Emoji_u1f648.svg) .caption[*Mizaru* (see no evil)]
* ![Kikazaru](https://upload.wikimedia.org/wikipedia/commons/5/56/Emoji_u1f649.svg) .caption[*Kikazaru* (hear no evil)]
* ![Iwazaru](https://upload.wikimedia.org/wikipedia/commons/2/2c/Emoji_u1f64a.svg) .caption[*Iwazaru* (speak no evil)]
]

---

# Introduction

    </textarea>

I get a weird padding of 40 pixels created by the ul tag. Any idea what's causing this discrepancy? Different version of remark.js?

Also, if you have any tips on how to control vertical alignment nicely through markdown, using this special-list, that would be nice! I am struggling with the align-self: flex-end; or align-items: properties, to no avail =/

Any idea what's causing this discrepancy?

@jdumas: it's difficult to tell without looking at the actual document.
Your browser's default style sheets might be setting those margins/paddings (in which case, you can use a tool like Normalize.css to get consistent results across all browsers). Or you could have other style sheets of yours interfering.
Feel free to fork my original pen to show us the issue.

if you have any tips on how to control vertical alignment nicely through markdown, using this special-list, that would be nice!

@jdumas: I have modified my pen to show how to align items vertically. I've added these two properties:
.special-list ul {
  ⋮
  align-items: center;
}

.special-list li {
  ⋮
  flex-basis: 33.33%;
}

Thanks for the baseline tip!
As for the padding, I have the same issue on both firefox & chromium. I cannot reproduce in the codepen since the only thing I have done is copy you example into the boilerplate code. Could it be an update in remark.js that introduces this padding? How do I see which version of remarkjs is used in your codepen?

My pen is linking to remarkjs.com/downloads/remark-latest.min.js (click on the gears icon in the JS panel).
You can use your browsers' “developer tools” to inspect those margins and paddings, and find out where exactly they come from.

Yes you are right. Sorry for the inconvenience. I had a -webkit-padding-start: 40px; laying around somewhere. Wtf. Normalize.css did not reset this attribute, but Meyer's CSS Reset did (well, they are different after all). I am still unsure which one I should go for.

You can try this:

 some caption here

Caption is left-aligned. However, it should be easy to center the caption searching the web

I made a template for remarkjs that contains some themes, layouts, and components. I hope it works for you.
demo | source


Fix unclipped tab container in the editor about dialog

Fix glitches when you scrolling the tab container content:

See #36164 - does it "fix" that issue for the About dialog? If so it can likely be merged as a stopgap solution, but #36164 should be kept open as it's a generic problem reproducible in any ScrollContainer apparently (though it could use a MRP which is not the editor about dialog).

Ah, if so, I think it may be closed since it fixes only the particular case of this bug.

Well it's still the most prominent demonstration of this bug, so if the fix doesn't have drawbacks, I think it's still worth merging. #36164 has been opened for years and we're not closer to a resolution AFAIK.

though it could use a MRP which is not the editor about dialog

Done! Though that said, in my example it's also in a tab container, so a similar solution can probably be applied there. (Maybe the bug itself is related to both ScrollContainer and TabContainer being used together?)


Images

Hi All,
Here some relative images. I took it from our slack notes. please check. Thanks!
/Radhika

Yes! I know! But, this images we haven't finalized yet. So they are only for reference purpose.

I understand. I stand by my point that even if these are reference images, they are still not really usable since you can't include them in the actual code. Quite a simple fix really, just unpack the 7z-file and its fine. :)


Group Link Invite Button Not Responsive

Is there an existing issue for this?

[X] I have searched the existing issues

Describe the bug
When attempting to add new members to a newly created group via the group link invite button in the user profile, the functionality appears to be unresponsive, preventing users from successfully adding members to the group.
Steps To Reproduce

Navigate to the profile.
Create a new group.
Attempt to use the group link invite button to add a new member.

Expected Behavior
The group link invite button should be responsive and allow the user to add new members successfully.
Screenshots

Device Information [optional]
- OS: Windows
- Browser: Google Chrome
- version: 120.0.6099.130

Additional context
No response
Are you working on this issue?
Yes

Hi @deepak05kr18 can you verify if this issue exists in local development environmentt ?

Hi @deepak05kr18 can you verify if this issue exists in local development environmentt ?

@tanmoysrt yes it exist also in local environment

Hi @deepak05kr18 can you verify if this issue exists in local development environmentt ?

@tanmoysrt yes it exist also in local environment

Ok go ahead !

Hey @deepak05kr18 , are you working on this issue.

Hey @deepak05kr18 , are you working on this issue.

Yes!!


mesh, hare: fallback to sync if we don't have data to process the layer

Motivation
when blocks are applied to the state node needs to have all transactions that are referenced by those blocks. blocks are applied to the state only after tortoise validates them. so if at the time of validation we are missing transactions from blocks that are valid according to the tortoise node needs to fall back to sync and loop until it fetches all transactions referenced by valid blocks.
why not to enforce data availability when blocks are received from the network (e.g. in handler)?
any node can propose a block and reference non-existing transactions. because of that, we can't loop in sync indefinitely until we download transactions for all blocks that are sent to us from peers. at some point, sync has to give up on fetching transactions from any random block, and if the node misses some transactions it should vote against the block. however if according to the tortoise block is valid then it means that majority of the smeshers have transactions and node should continue trying to download transactions from that block, as it doesn't have any other choice.
closes: https://github.com/spacemeshos/go-spacemesh/issues/3039
Changes

if valid blocks or transactions from valid blocks are missing terminate layer verification
allow sync to pick up layer immediately without waiting additional time
removed fetcher from mesh, so if hare terminates with unknown blocks we will fallback to sync instead of trying to fetch blocks in mesh

bors try

btw behavior in this pr is also consistent with a behavior that will be required for pruned blocks. since pruned block might be unavailable we shouldn't try to download every block that we know about. only after the tortoise decided that the block is valid we can be sure that the block is not pruned.

btw behavior in this pr is also consistent with a behavior that will be required for pruned blocks. since pruned block might be unavailable we shouldn't try to download every block that we know about. only after the tortoise decided that the block is valid we can be sure that the block is not pruned.

i agree. but again, we can do that in this PR without having to revert processedLayer

@countvonzero please take a look, i reworked change according to the last discussion.
@noamnelke if we want to fix fetcher.GetTXs let's do it in a separate change. i am not confident if that's would be a future proof solution after a reply from Iddo and Tal

@noamnelke if we want to fix fetcher.GetTXs let's do it in a separate change. i am not confident if that's would be a future proof solution after a reply from Iddo and Tal

i agree with doing this in a separate PR. but i also don't think it's necessary to make it future proof.
research seems to think there is no difference in terms of security.
the trade-off i saw was to download extra data when the network tells us that some previously invalid data is now valid.
the code will be simpler, and easier to reason about if the data availability is guaranteed at data reception time.
if, in the future, some major inefficiency or ddos attack vector arise, it's also pretty straightforward to relax it.
i.e. the cost of making the wrong decision is low, but the immediate benefit is that it's easier to reason about the code logic

thats not how i interpreted the reply

ballots should not be invalidated if they vote for an invalid block, only if they use an invalid base ballot (since we want to allow block pruning).

so even if we cannot fetch referenced block (vote) - ballot should be saved to the database

thats not how i interpreted the reply

ballots should not be invalidated if they vote for an invalid block, only if they use an invalid base ballot (since we want to allow block pruning).

so even if we cannot fetch referenced block (vote) - ballot should be saved to the database

oh! i thought Tal was talking abt contextual validity. when we receive a ballot, we can determine the syntactic validity of the blocks it references to, not contextual validity. so we should only reject a ballot if it references to syntactic ally invalid blocks

i thought that (since we want to allow block pruning) implies that blocks won't be available, so it won't possible to determine syntactic validity of the block, e.g block will be pruned

bors merge


Call php artisan cache:clear made sidebar menu disappear

Version information

Laravel: v#.#.#
Voyager: v#.#.#
PHP: #.#
Database: [type] [version] (e.g. MySQL 8.0)

Description

A clear and concise description of what the bug is.
Steps To Reproduce
Steps to reproduce the behavior:

Go to login page after running php artisan cache:clear command in terminal
Login with admin user
See error

Expected behavior
A clear and concise description of what you expected to happen.
Sidebar has completely gone, while my intent was just to clear cache.
Screenshots
If applicable, add screenshots to help explain your problem.

Additional context
Add any other context about the problem here.

Please fix the APP_URL in .env file. By default APP_URL will be http://localhost. In voyager APP_URL must match with running port on default port 8000. Hence APP_URL will be http://localhost:8000.


fix: trouble navigating between pages

Thank you for your contribution to the KodaDot NFT gallery.
👇 _ Let's make a quick check before the contribution.
PR type

[x] Bugfix
[ ] Feature
[ ] Refactoring

What's new?

[x] PR closes #3094
[ ] Requires deployment <rubick/magick_issue>
[ ] <brief_description_of_what_I've_added>

Before submitting Pull Request, please make sure:

[x] My contribution builds clean without any errors or warnings
[x] I've merged recent default branch -- main and I've no conflicts
[x] I've tried to respect high code quality standards
[x] I've didn't break any original functionality
[ ] I've posted a screenshot of demonstrated change in this PR

Optional

[ ] I've tested it at </rmrk/collection/26902bc2f7c20c546a-1FVG7>
[ ] I've tested PR on mobile and everything seems works
[ ] I found edge cases
[ ] I've written some unit tests 🧪

Had issue bounty label?

[x] Fill up your KSM address: Payout

Community participation

[x] Are you at KodaDot Discord?

Screenshot

[ ] My fix has changed something on UI; a screenshot is best to understand changes for others.

pay 75

Looks to be working correctly again, though I couldn't reproduce it a 100% on beta...

yes, It is an occasional problems.


Deprecation warnings from newer stdlib

Puppet: 4.x
Ruby: Any
Distribution: Any
Module version: 1.4.0

STDLIB version: >= 4.13.0

How to reproduce (e.g Puppet code you use)
Any invocation of logrotate::rule or logrotate::conf, if the stdlib version is greater than 4.12.0
What are you seeing
$ puppet apply -t --noop -e 'logrotate::rule { "mcelog": path => "/var/log/mcelog" }'
Info: Loading facts
Warning: This method is deprecated, please use the stdlib validate_legacy function, with Pattern[]. There is further documentation for validate_legacy function in the README.
   (at /export/home/johnson.earls/.puppetlabs/etc/code/modules/stdlib/lib/puppet/functions/deprecation.rb:25:in `deprecation')

What behaviour did you expect instead
Lack of warnings
Output log
See above
Any additional information you'd like to impart
Work-around is to restrict stdlib to <= 4.12.0 in metadata.json.

I'll probably address this by releasing a new version that requires Puppet 4 or above.
I'll create a new ticket for that, and review how best to do that.
R.

Completed as part of #68


Client Allocation Request for: asd

Client Allocation Questions
Core Information

Name: asd
Website / Social Media: asd, (asd, asd)
Region: Africa
DataCap Requested: 224 GiB
Addresses to be Notarized: asd
Notary Requested: Claudia Richoux

Application created via filplus.storage

This user’s identity has has been verified through filplus.storage


Window.width inconcistency

On iOS and OS X with Retina displays Lib.application.window.width reports DPI scaled value, e.g. if window was requested with value 800 it will report 800 on Retina display too, while stage.stageWidth will be 1600 (real size in pixels). Another example is iPad (landscape), where window.width is 1024 and stage.stageWidth is 2048.
However, Android behaves differently here and reports window.width in device pixels, e.g. on device with 1280 width,  both window.width and stage.stageWidth have 1280 size.
I think Android also should report window.width as stage.stageWidth / DPIDensity. This is particularly useful when you need to get window/screen DPI in app code to property scale, hm, everything.

This is currently based on what we receive from SDL. When they modified the support for "high DPI" display on iOS, it (effectively) broke window resize as well as mouse event coordinates, based on logical "points" rather than pixels. This is not the behavior on Android, though I believe SDL may include the high DPI behavior on Windows or OS X.
In the future, the way SDL handles Android may look more like iOS, but its hard to say. In the meantime, I recommend handling window.width * window.scale if you use Lime directly :smile:

Thanks for the info @jgranick! I didn't know about window.scale property.
Just tried and it seems to work fine and as I want, except that on Android CyanogenMod it still reports scale = 1, while on device it's about 3. It seems like a this issue https://github.com/openfl/lime/issues/369, but as I understand scale is calculate like this outerWidth / width, so it should be correct if SDL has correct width.


Add Dockerbuild for image containing only cloud-sdk

What is the context of this PR?
Introduces a 2nd Docker build for this repo, we now have one with k8s (for our benchmark job) and one without k8s for Runner Cloud Run deployments.
How to review
Test alongside eq-pipelines build-images/deploy pipeline

 Review eq-app-deploy-image and update versions (2 SP)


[Snyk] Fix for 39 vulnerabilities

This PR was automatically created by Snyk using the credentials of a real user.Snyk has created this PR to fix one or more vulnerable packages in the `maven` dependencies of this project.
Changes included in this PR

Changes to the following files to upgrade the vulnerable dependencies to a fixed version:

shipping/pom.xml

Vulnerabilities that will be fixed
With an upgrade:

Severity
Priority Score (*)
Issue
Upgrade
Breaking Change
Exploit Maturity

454/1000  Why? Has a fix available, CVSS 4.8
Insufficient Hostname Verification SNYK-JAVA-CHQOSLOGBACK-1726923

No
No Known Exploit

509/1000  Why? Has a fix available, CVSS 5.9
Denial of Service (DoS) SNYK-JAVA-COMFASTERXMLJACKSONCORE-2326698

No
No Known Exploit

589/1000  Why? Has a fix available, CVSS 7.5
Denial of Service (DoS) SNYK-JAVA-COMFASTERXMLJACKSONCORE-2421244

No
No Known Exploit

616/1000  Why? Proof of Concept exploit, Has a fix available, CVSS 5.9
Denial of Service (DoS) SNYK-JAVA-COMFASTERXMLJACKSONCORE-3038424

No
Proof of Concept

616/1000  Why? Proof of Concept exploit, Has a fix available, CVSS 5.9
Denial of Service (DoS) SNYK-JAVA-COMFASTERXMLJACKSONCORE-3038426

No
Proof of Concept

616/1000  Why? Proof of Concept exploit, Has a fix available, CVSS 5.9
XML External Entity (XXE) Injection SNYK-JAVA-MYSQL-1766958

No
Proof of Concept

544/1000  Why? Has a fix available, CVSS 6.6
Improper Authorization SNYK-JAVA-MYSQL-2386864

No
No Known Exploit

479/1000  Why? Has a fix available, CVSS 5.3
Improper Input Validation SNYK-JAVA-ORGAPACHEHTTPCOMPONENTS-1048058
org.apache.httpcomponents:httpclient:  4.5.12 -> 4.5.13
No
No Known Exploit

494/1000  Why? Has a fix available, CVSS 5.6
HTTP Request Smuggling SNYK-JAVA-ORGAPACHETOMCATEMBED-1017119

No
No Known Exploit

586/1000  Why? Proof of Concept exploit, Has a fix available, CVSS 5.3
Information Exposure SNYK-JAVA-ORGAPACHETOMCATEMBED-1048292

No
Proof of Concept

479/1000  Why? Has a fix available, CVSS 5.3
Information Disclosure SNYK-JAVA-ORGAPACHETOMCATEMBED-1061939

No
No Known Exploit

564/1000  Why? Has a fix available, CVSS 7
Remote Code Execution (RCE) SNYK-JAVA-ORGAPACHETOMCATEMBED-1080637

No
No Known Exploit

509/1000  Why? Has a fix available, CVSS 5.9
HTTP Request Smuggling SNYK-JAVA-ORGAPACHETOMCATEMBED-1080638

No
No Known Exploit

589/1000  Why? Has a fix available, CVSS 7.5
Denial of Service (DoS) SNYK-JAVA-ORGAPACHETOMCATEMBED-1728264

No
No Known Exploit

454/1000  Why? Has a fix available, CVSS 4.8
Improper Input Validation SNYK-JAVA-ORGAPACHETOMCATEMBED-1728265

No
No Known Exploit

479/1000  Why? Has a fix available, CVSS 5.3
HTTP Request Smuggling SNYK-JAVA-ORGAPACHETOMCATEMBED-1728266

No
No Known Exploit

564/1000  Why? Has a fix available, CVSS 7
Privilege Escalation SNYK-JAVA-ORGAPACHETOMCATEMBED-2414084

No
No Known Exploit

399/1000  Why? Has a fix available, CVSS 3.7
Information Exposure SNYK-JAVA-ORGAPACHETOMCATEMBED-3035793

No
No Known Exploit

399/1000  Why? Has a fix available, CVSS 3.7
HTTP Request Smuggling SNYK-JAVA-ORGAPACHETOMCATEMBED-3097829

No
No Known Exploit

539/1000  Why? Has a fix available, CVSS 6.5
Denial of Service (DoS) SNYK-JAVA-ORGAPACHETOMCATEMBED-3326459

No
No Known Exploit

479/1000  Why? Has a fix available, CVSS 5.3
Unprotected Transport of Credentials SNYK-JAVA-ORGAPACHETOMCATEMBED-3369687

No
No Known Exploit

579/1000  Why? Has a fix available, CVSS 7.3
Improper Input Validation SNYK-JAVA-ORGGLASSFISH-1297098

No
No Known Exploit

635/1000  Why? Has a fix available, CVSS 8.2
SQL Injection SNYK-JAVA-ORGHIBERNATE-1041788

No
No Known Exploit

644/1000  Why? Has a fix available, CVSS 8.6
Improper Input Validation SNYK-JAVA-ORGSPRINGFRAMEWORK-1009832

No
No Known Exploit

434/1000  Why? Has a fix available, CVSS 4.4
Privilege Escalation SNYK-JAVA-ORGSPRINGFRAMEWORK-1296829

No
No Known Exploit

429/1000  Why? Has a fix available, CVSS 4.3
Improper Output Neutralization for Logs SNYK-JAVA-ORGSPRINGFRAMEWORK-2329097

No
No Known Exploit

429/1000  Why? Has a fix available, CVSS 4.3
Improper Input Validation SNYK-JAVA-ORGSPRINGFRAMEWORK-2330878

No
No Known Exploit

479/1000  Why? Has a fix available, CVSS 5.3
Denial of Service (DoS) SNYK-JAVA-ORGSPRINGFRAMEWORK-2434828

No
No Known Exploit

919/1000  Why? Mature exploit, Has a fix available, CVSS 9.8
Remote Code Execution SNYK-JAVA-ORGSPRINGFRAMEWORK-2436751

No
Mature

506/1000  Why? Proof of Concept exploit, Has a fix available, CVSS 3.7
Improper Handling of Case Sensitivity SNYK-JAVA-ORGSPRINGFRAMEWORK-2689634

No
Proof of Concept

479/1000  Why? Has a fix available, CVSS 5.3
Denial of Service (DoS) SNYK-JAVA-ORGSPRINGFRAMEWORK-2823313

No
No Known Exploit

479/1000  Why? Has a fix available, CVSS 5.3
Allocation of Resources Without Limits or Throttling SNYK-JAVA-ORGSPRINGFRAMEWORK-3369749

No
No Known Exploit

539/1000  Why? Has a fix available, CVSS 6.5
Allocation of Resources Without Limits or Throttling SNYK-JAVA-ORGSPRINGFRAMEWORK-5422217

No
No Known Exploit

619/1000  Why? Has a fix available, CVSS 8.1
Access Restriction Bypass SNYK-JAVA-ORGSPRINGFRAMEWORKBOOT-5441321

No
No Known Exploit

589/1000  Why? Has a fix available, CVSS 7.5
Denial of Service (DoS) SNYK-JAVA-ORGYAML-2806360

Yes
No Known Exploit

506/1000  Why? Proof of Concept exploit, Has a fix available, CVSS 3.7
Stack-based Buffer Overflow SNYK-JAVA-ORGYAML-3016888

Yes
Proof of Concept

399/1000  Why? Has a fix available, CVSS 3.7
Stack-based Buffer Overflow SNYK-JAVA-ORGYAML-3016889

Yes
No Known Exploit

536/1000  Why? Proof of Concept exploit, Has a fix available, CVSS 4.3
Stack-based Buffer Overflow SNYK-JAVA-ORGYAML-3016891

Yes
Proof of Concept

399/1000  Why? Has a fix available, CVSS 3.7
Stack-based Buffer Overflow SNYK-JAVA-ORGYAML-3113851

Yes
No Known Exploit

(*) Note that the real score may have changed since the PR was raised.
Vulnerabilities that could not be fixed

Upgrade:

Could not upgrade<EMAIL_ADDRESS>to<EMAIL_ADDRESS>Reason could not apply upgrade, dependency is managed externally ; Location: https://maven-central.storage-download.googleapis.com/maven2/org/springframework/boot/spring-boot-dependencies/2.3.3.RELEASE/spring-boot-dependencies-2.3.3.RELEASE.pom
Could not upgrade<EMAIL_ADDRESS>to<EMAIL_ADDRESS>Reason could not apply upgrade, dependency is managed externally ; Location: https://maven-central.storage-download.googleapis.com/maven2/org/springframework/boot/spring-boot-dependencies/2.3.3.RELEASE/spring-boot-dependencies-2.3.3.RELEASE.pom
Could not upgrade<EMAIL_ADDRESS>to<EMAIL_ADDRESS>Reason could not apply upgrade, dependency is managed externally ; Location: https://maven-central.storage-download.googleapis.com/maven2/org/springframework/boot/spring-boot-dependencies/2.3.3.RELEASE/spring-boot-dependencies-2.3.3.RELEASE.pom
Could not upgrade<EMAIL_ADDRESS>to<EMAIL_ADDRESS>Reason could not apply upgrade, dependency is managed externally ; Location: https://maven-central.storage-download.googleapis.com/maven2/org/springframework/boot/spring-boot-dependencies/2.3.3.RELEASE/spring-boot-dependencies-2.3.3.RELEASE.pom
Could not upgrade<EMAIL_ADDRESS>to<EMAIL_ADDRESS>Reason could not apply upgrade, dependency is managed externally ; Location: https://maven-central.storage-download.googleapis.com/maven2/org/springframework/boot/spring-boot-dependencies/2.3.3.RELEASE/spring-boot-dependencies-2.3.3.RELEASE.pom

Check the changes in this PR to ensure they won't cause issues with your project.

Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open fix PRs.
For more information:
🧐 View latest project report
🛠 Adjust project settings
📚 Read more about Snyk's upgrade and patch logic

Learn how to fix vulnerabilities with free interactive lessons:
🦉 Insufficient Hostname Verification
🦉 Denial of Service (DoS)
🦉 XML External Entity (XXE) Injection
🦉 More lessons are available in Snyk Learn

This looks good, let's fix all the pom.xml issues


Add python module black

Ansible lint supports the python module black.
It should be added to the image.

This will be included in build b3 of version 6.6.0.
Going to provide the system package black.


Keyboard Maestro

Hi, there used to be a km folder for keyboard maestro stuff. has that vanished completely?
i'm on the prowl to find new ideas about keyboard maestro, as i'm slowly getting accustomed to it.
Would really appreciate seeing what kinds of macros you had going, @nikitavoloboev

https://wiki.nikitavoloboev.xyz/macos/macos-apps/keyboard-maestro/km-macros

will update it with new macros this week


Add additional test for legacy TriggeredV2 events

This PR was successfully deployed to production by CircleCI build 317 at 2017-08-21 16:34 BST.


The command npm run build fails to copy resources in spring-boot-angular-ecommerce

By following this great tutorial it was noticed that the step 4. Merging Spring Boot and Angular Applications does not perform as expected at the script deploy, leaving the directory ../resources/static empty, thus compromising the application's frontend. Bellow is the line referred:
https://github.com/eugenp/tutorials/blob/ccc39861fe55965ed7096bb5f00a423c7abc96b6/spring-boot-angular-ecommerce/src/main/frontend/package.json#L10
It seems that the source folder dist/ doesnt contain any files apart from the directory frontend/, and this is actually the directory that contains all resources, so it needs to be considered in this command.

Thanks!


java.lang.NumberFormatException: For input string: "lolpatch_7"

Hi guys, first of all thanks for this brilliant library!
I've been trying to add serialization to my matches so I don't have to make huge quantities of calls with my limited API key. (While I'm here - my method was to essentially recreate the data classes with the values I needed and use the constructor to convert them from Orianna classes into my data-store classes, if there's an easier way e.g. using the sources for these classes and adding Serializable please let me know I'm fairly new to this!)
Anyway, upon trying to load one of my less recent matches (number 157) I get the following error:
java.lang.reflect.InvocationTargetException 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 	at java.base/java.lang.reflect.Method.invoke(Method.java:564) 	at javafx.graphics/com.sun.javafx.application.LauncherImpl.launchApplicationWithArgs(LauncherImpl.java:473) 	at javafx.graphics/com.sun.javafx.application.LauncherImpl.launchApplication(LauncherImpl.java:372) 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 	at java.base/java.lang.reflect.Method.invoke(Method.java:564) 	at java.base/sun.launcher.LauncherHelper$FXHelper.main(LauncherHelper.java:941) Caused by: java.lang.NumberFormatException: For input string: "lolpatch_7" 	at java.base/java.lang.NumberFormatException.forInputString(NumberFormatException.java:65) 	at java.base/java.lang.Integer.parseInt(Integer.java:652) 	at java.base/java.lang.Integer.parseInt(Integer.java:770) 	at com.merakianalytics.orianna.types.core.staticdata.Versions.truncate(Versions.java:101) 	at com.merakianalytics.orianna.types.core.match.Match$Team$1.get(Match.java:343) 	at com.merakianalytics.orianna.types.core.match.Match$Team$1.get(Match.java:337) 	at com.google.common.base.Suppliers$MemoizingSupplier.get(Suppliers.java:120) 	at com.merakianalytics.orianna.types.core.match.Match$Team.getBans(Match.java:371) 	at project.companion.data.Match.<init>(Match.java:39) 	at project.companion.data.MatchData.<init>(MatchData.java:28) 	at project.companion.Main.main(Main.java:147) 	... 11 more
It looks like the truncate function in Versions on line 79 is getting a value "lolpatch_7" and trying to parseInt on that String, I've tried to breakpoint and look through the debug variables for any mention of "lolpatch_7" but haven't found anything.
Any help or comments on this would be greatly appreciated!
Cheers
Billy

Hey,
It sounds like you're trying to serialize the data for caching purposes? Ori has built in caching that it will do automatically for you. There are currently implementations for MongoDB and Xodus (which will just store data on your local disk in files without the need for external DB software) here. Additionally, Ori caches in-memory inside the Java process by default.
We try to avoid using the default Java serialization for storage (via Serializable) because it isn't very robust to class definition changes and future Java versions may choose to serialize differently. Additionally, there's been a few proposals lately to remove it entirely from the language.
Anyway, getting back on topic, if all you're looking for is caching the data - that's built in already. Let me know and I can give some examples on using the built in capabilities.
To address the lolpatch_7 issue - I thought I'd taken care of that in this commit. Basically it's caused because orianna is trying to automatically match the static-data versions you see when you call something like match.getParticipants().get(0).getChampion() with the version the match is played on (so you're looking at data that was correct at the time of playing). Unfortunately, the patches reported by the match DTO are a lot more specific than the versions that the static-data endpoints take as parameters, so we have to try to resolve which static-data version the game was played on. We were doing it assuming all reported versions would be numerical, but it turns out really old games are on stuff like lolpatch_7. Upshot is that if you're using the latest SNAPSHOT version, this should hopefully already be fixed. It hasn't been in a release yet and will be in the next one.
Let me know if you're on the latest SNAPSHOT and still seeing this and I can look into it.

Silly me! The lolpatch issue is indeed remedied by the latest SNAPSHOT version and local caching works fine when the config is changed to use Xodus. Thanks Rob :)


Added a configuration popup to enable performance collection for a storage device

What type of PR is this?
/kind new feature
What this PR does / why we need it:
This PR enables the user to configure the performance metrics collection settings for a storage device.
The user will be able to :

Enable performance collection
Set the scrape interval
Enable history

Which issue(s) this PR fixes:
Fixes #404
Test Report Added?:
/kind TESTED
Test Report:

Special notes for your reviewer:

@skdwriting Please review and merge


Epoch 500 and LJSpeech is not sure of "r" sound- cause for concern?

Hi all,
I've been using Piper to train a few voices and I had good success with a UK voice using about 20 hours of data at 16 kHz.
For my next experiment I wanted to build a model based on LJSpeech, sampled at 16kHz. Of course I had to change the phone set to espeak en-US to match the LJ accent.
My other voices converged around 800k steps which is where I'm at now for LJSpeech, but currently my model seems to have learned decent phones for everything except the word final "r" sounds. It's totally unpredictable whether they'll be said or not. At first I thought it might have something to do with using single r-colored vowel symbols instead of a separate vowel and r phone symbol, but I can't really see why this would be the case, if everything is consistent in the training data (and it is).
Is this normal? Will the voice continue to learn the r-sounds if I let it continue to train? I just worry because I didn't have this issue with the UK voices (maybe because they are non-rhotic, so I didn't have the chance to observe this phenomenon).
Thanks.

Nevermind, I am so very silly and was phonemizing my test set using en-GB espeak. :)

Glad you got it resolved! I've had this exact problem: espeak phonemizes "r" in very different ways for U.S. and British English, it seems.


[INTEL MKL] Added  bf16 support for Sparse_Xent_op.

Added bf16 support for Sparse_Xent_op.

@penpornk Hello Penporn, Can you please provide review on this PR? Please let me know, if there is any concern.

@vishakha-nervana  Can you please resolve conflicts? Thanks!


resolve -Wmissing-field-initializers warnings

fixes:
src/codecs/music_mpg123.c:66:1: warning: missing field 'mpg123_close' initializer [-Wmissing-field-initializers]
src/codecs/music_ogg.c:66:1: warning: missing field 'ov_clear' initializer [-Wmissing-field-initializers]

I guess you are running with -pedantic: Don't, it is overkill.
We don't need this one.

Missing field initializers are undefined. In this case since the object is static, the entire object is initialized to zero, so we probably don't need any initializers, but if we have some, we should have them all. If this object were on the stack, this would be a trap waiting to spring on someone in the future.

the object is static, the entire object is initialized to zero, so we probably don't need any initializers,

Exactly: What we had here is very common practice. If one is really
worried, then the structure can be zeroed during init. I really don't see
why we need this patch.


Autoptimize plugin compatibility

Hello! There is conflict with Autoptimize plugin JS optimize option. Make them compatible please!

Hi Alexander,
please provide more details whats going wrong
best regards, Andi


inaccurate conversion from YCbCr Narrow range to RGB Full range

Hi, I've been advised to raise a ticket here rather than on the ffmpeg trac system. Original issue description, source and output files can be found here: https://trac.ffmpeg.org/ticket/8034
The problem is that when I convert from a v210 YCbCr BT.2020 NCL narrow-range file to an RGB TIFF full-range, some code values are incorrect. For simplicity of reproduction I've focused on just three colours, but it doesn't mean that there are other value errors present.
Here's a copy of the ffmpeg bug text:
Summary of the bug: inaccurate conversion from BT.2020 NCL YCbCr Narrow range to BT.2020 RGB Full range using zscale filter
How to reproduce (on the latest github windows build ffmpeg-20190722-3883c9d-win64-static):

ffmpeg started on 2019-07-24 at 11:10:42
Report written to "ffmpeg-20190724-111042.log"
Command line:
"C:\tools\ffmpeg-20190722-3883c9d-win64-static\bin\ffmpeg.exe" -loglevel debug -report -s 3840x2160 -vcodec v210 -i YUV_pattern-2fr.v210 -vf "zscale=dither=none:matrix=bt2020nc:matrixin=bt2020nc:in_range=limited:out_range=full" -vframes 1 ffmpeg_3883c9d_zscale.TIFF -y
ffmpeg version N-94383-g3883c9d147 Copyright (c) 2000-2019 the FFmpeg developers
built with gcc 9.1.1 (GCC) 20190716
configuration: --enable-gpl --enable-version3 --enable-sdl2 --enable-fontconfig --enable-gnutls --enable-iconv --enable-libass --enable-libdav1d --enable-libbluray --enable-libfreetype --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libtheora --enable-libtwolame --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libzimg --enable-lzma --enable-zlib --enable-gmp --enable-libvidstab --enable-libvorbis --enable-libvo-amrwbenc --enable-libmysofa --enable-libspeex --enable-libxvid --enable-libaom --enable-libmfx --enable-amf --enable-ffnvcodec --enable-cuvid --enable-d3d11va --enable-nvenc --enable-nvdec --enable-dxva2 --enable-avisynth --enable-libopenmpt
libavutil      56. 32.100 / 56. 32.100
libavcodec     58. 55.100 / 58. 55.100
libavformat    58. 30.100 / 58. 30.100
libavdevice    58.  9.100 / 58.  9.100
libavfilter     7. 58.100 /  7. 58.100
libswscale      5.  6.100 /  5.  6.100
libswresample   3.  6.100 /  3.  6.100
libpostproc    55.  6.100 / 55.  6.100
Splitting the commandline.
Reading option '-loglevel' ... matched as option 'loglevel' (set logging level) with argument 'debug'.
Reading option '-report' ... matched as option 'report' (generate a report) with argument '1'.
Reading option '-s' ... matched as option 's' (set frame size (WxH or abbreviation)) with argument '3840x2160'.
Reading option '-vcodec' ... matched as option 'vcodec' (force video codec ('copy' to copy stream)) with argument 'v210'.
Reading option '-i' ... matched as input url with argument 'YUV_pattern-2fr.v210'.
Reading option '-vf' ... matched as option 'vf' (set video filters) with argument 'zscale=dither=none:matrix=bt2020nc:matrixin=bt2020nc:in_range=limited:out_range=full'.
Reading option '-vframes' ... matched as option 'vframes' (set the number of video frames to output) with argument '1'.
Reading option 'ffmpeg_3883c9d_zscale.TIFF' ... matched as output url.
Reading option '-y' ... matched as option 'y' (overwrite output files) with argument '1'.
Finished splitting the commandline.
Parsing a group of options: global .
Applying option loglevel (set logging level) with argument debug.
Applying option report (generate a report) with argument 1.
Applying option y (overwrite output files) with argument 1.
Successfully parsed a group of options.
Parsing a group of options: input url YUV_pattern-2fr.v210.
Applying option s (set frame size (WxH or abbreviation)) with argument 3840x2160.
Applying option vcodec (force video codec ('copy' to copy stream)) with argument v210.
Successfully parsed a group of options.
Opening an input file: YUV_pattern-2fr.v210.
[NULL @ 000001ed6f27c780] Opening 'YUV_pattern-2fr.v210' for reading
[file @ 000001ed6f27cfc0] Setting default whitelist 'file,crypto'
[v210 @ 000001ed6f27c780] Format v210 probed with size=2048 and score=50
[v210 @ 000001ed6f27c780] Before avformat_find_stream_info() pos: 0 bytes read:32768 seeks:0 nb_streams:1
[v210 @ 000001ed6f27c780] All info found
[v210 @ 000001ed6f27c780] Estimating duration from bitrate, this may be inaccurate
[v210 @ 000001ed6f27c780] After avformat_find_stream_info() pos: 22118400 bytes read:22118400 seeks:0 frames:1
Input #0, v210, from 'YUV_pattern-2fr.v210':
Duration: 00:00:00.08, start: 0.000000, bitrate: 4423680 kb/s
Stream #0:0, 1, 1/25: Video: v210, 1 reference frame, yuv422p10le, 3840x2160, 0/1, 4423680 kb/s, 25 tbr, 25 tbn, 25 tbc
Successfully opened the file.
Parsing a group of options: output url ffmpeg_3883c9d_zscale.TIFF.
Applying option vf (set video filters) with argument zscale=dither=none:matrix=bt2020nc:matrixin=bt2020nc:in_range=limited:out_range=full.
Applying option vframes (set the number of video frames to output) with argument 1.
Successfully parsed a group of options.
Opening an output file: ffmpeg_3883c9d_zscale.TIFF.
Successfully opened the file.
Stream mapping:
Stream #0:0 -> #0:0 (v210 (native) -> tiff (native))
Press [q] to stop, [?] for help
cur_dts is invalid st:0 (0) [init:0 i_done:0 finish:0] (this is harmless if it occurs once at the start per stream)
detected 32 logical cores
[Parsed_zscale_0 @ 000001ed6f284f80] Setting 'dither' to value 'none'
[Parsed_zscale_0 @ 000001ed6f284f80] Setting 'matrix' to value 'bt2020nc'
[Parsed_zscale_0 @ 000001ed6f284f80] Setting 'matrixin' to value 'bt2020nc'
[Parsed_zscale_0 @ 000001ed6f284f80] Setting 'in_range' to value 'limited'
[Parsed_zscale_0 @ 000001ed6f284f80] Setting 'out_range' to value 'full'
[graph 0 input from stream 0:0 @ 000001ed6f285100] Setting 'video_size' to value '3840x2160'
[graph 0 input from stream 0:0 @ 000001ed6f285100] Setting 'pix_fmt' to value '66'
[graph 0 input from stream 0:0 @ 000001ed6f285100] Setting 'time_base' to value '1/25'
[graph 0 input from stream 0:0 @ 000001ed6f285100] Setting 'pixel_aspect' to value '0/1'
[graph 0 input from stream 0:0 @ 000001ed6f285100] Setting 'sws_param' to value 'flags=2'
[graph 0 input from stream 0:0 @ 000001ed6f285100] Setting 'frame_rate' to value '25/1'
[graph 0 input from stream 0:0 @ 000001ed6f285100] w:3840 h:2160 pixfmt:yuv422p10le tb:1/25 fr:25/1 sar:0/1 sws_param:flags=2
[format @ 000001ed6f2973c0] Setting 'pix_fmts' to value 'rgb24|rgb48le|pal8|rgba|rgba64le|gray|ya8|gray16le|ya16le|monob|monow|yuv420p|yuv422p|yuv440p|yuv444p|yuv410p|yuv411p'
[auto_scaler_0 @ 000001ed6f297980] Setting 'flags' to value 'bicubic'
[auto_scaler_0 @ 000001ed6f297980] w:iw h:ih flags:'bicubic' interl:0
[format @ 000001ed6f2973c0] auto-inserting filter 'auto_scaler_0' between the filter 'Parsed_zscale_0' and the filter 'format'
[AVFilterGraph @ 000001ed6f2825c0] query_formats: 4 queried, 2 merged, 1 already done, 0 delayed
[auto_scaler_0 @ 000001ed6f297980] picking rgb48le out of 17 ref:yuv422p10le alpha:0
[Parsed_zscale_0 @ 000001ed6f284f80] w:3840 h:2160 fmt:yuv422p10le sar:0/1 -> w:3840 h:2160 fmt:yuv422p10le sar:0/1
[auto_scaler_0 @ 000001ed6f297980] w:3840 h:2160 fmt:yuv422p10le sar:0/1 -> w:3840 h:2160 fmt:rgb48le sar:0/1 flags:0x4
[Parsed_zscale_0 @ 000001ed6f284f80] w:3840 h:2160 fmt:yuv422p10le sar:0/1 -> w:3840 h:2160 fmt:yuv422p10le sar:0/1
Output #0, image2, to 'ffmpeg_3883c9d_zscale.TIFF':
Metadata:
encoder         : Lavf58.30.100
Stream #0:0, 0, 1/25: Video: tiff, 1 reference frame, rgb48le, 3840x2160, 0/1, q=2-31, 200 kb/s, 25 fps, 25 tbn, 25 tbc
Metadata:
encoder         : Lavc58.55.100 tiff
Clipping frame in rate conversion by 0.000008
No more output streams to write to, finishing.
[image2 @ 000001ed6f28eb40] Opening 'ffmpeg_3883c9d_zscale.TIFF' for writing
[file @ 000001ed6f2d4e80] Setting default whitelist 'file,crypto'
[AVIOContext @ 000001ed6f2d4f80] Statistics: 0 seeks, 13 writeouts
frame=    1 fps=0.0 q=-0.0 Lsize=N/A time=00:00:00.04 bitrate=N/A speed=0.0883x
video:3195kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
Input file #0 (YUV_pattern-2fr.v210):
Input stream #0:0 (video): 1 packets read (22118400 bytes); 1 frames decoded;
Total: 1 packets (22118400 bytes) demuxed
Output file #0 (ffmpeg_3883c9d_zscale.TIFF):
Output stream #0:0 (video): 1 frames encoded; 1 packets muxed (3271738 bytes);
Total: 1 packets (3271738 bytes) muxed
1 frames successfully decoded, 0 decoding errors
[AVIOContext @ 000001ed6f285200] Statistics: 22118400 bytes read, 0 seeks

100% White - CORRECT
Source YCbCr value = 0x03ac, 0x0200, 0x0200 (940, 512, 512)
Observed RGB value = 65535, 65535, 65535
Expected RGB value = 65535, 65535, 65535
58% White - INCORRECT
Source YCbCr value = 0x023c, 0x0200, 0x0200 (572, 512, 512)
Observed RGB value = 39423, 39423, 39423
Expected RGB value = 38004, 38004, 38004
100% Magenta - ALMOST CORRECT
Source YCbCr value = 0x015a, 0x343, 0x039c
Observed RGB value = 65535, 0, 65535
Expected RGB value = 65533, 0, 65535

I can not reproduce this issue:
import vapoursynth as vs
core = vs.get_core()
c = core.std.BlankClip(format=vs.YUV444P10, color=[572, 512, 512])
c = core.resize.Bicubic(c, format=vs.RGB48, matrix_in_s='2020ncl')
c = core.std.PlaneStats(c)
c = core.text.FrameProps(c)
c = core.resize.Bicubic(c, format=vs.COMPATBGR32)
c.set_output()

This prints 38004. For your 100% magenta question, your 10-bit inputs are already quantized, so why would you expect it to produce an exact result? The input vector (16-bit) [22149, 53433, 59134] produces bit-exact 16-bit output.

Thank you for looking into this so promptly. Unfortunately, I've not worked with vapoursynth before and I can't yet reproduce your reproduction steps myself. But assuming zimg itself is working correctly, would it be too much to ask you to see if you can reproduce the issue using the ffmpeg command I am using?

For your 100% magenta question, your 10-bit inputs are already quantized, so why would you expect it to produce an exact result?
I am expecting an exact result because there is no good reason to not have an exact result and the fact my input is quantised already shouldn't matter that much.
The input vector (16-bit) [22149, 53433, 59134] produces bit-exact 16-bit output.
Can you please clarify what this input vector represents and what output does it produce?

Thanks!

Pwrhaps error came from fact that zscale override matrix to rgb one for rgb output pixel formats?

For your 100% magenta question, your 10-bit inputs are already quantized, so why would you expect it to produce an exact result?

I am expecting an exact result because there is no good reason to not have an exact result and the fact my input is quantised already shouldn't matter that much.
Of course it matters. If your input is inexact, the correct result is for the output to be inexact. You can work the math out yourself.

The input vector (16-bit) [22149, 53433, 59134] produces bit-exact 16-bit output.

Can you please clarify what this input vector represents and what output does it produce?
Thanks!
I used the Rec.2020 matrix to compute the real-valued YUV corresponding to R=1, G=0, B=1, and then I rounded it to 16-bit. From ITU-R BT.2020-2:

Y' = 0.2627R + 0.6780G + 0.0593*B = 0.322
C'b = (B' - Y') / 1.8814 = 0.36036993728074834
C'r = (R' - Y') / 1.4746 = 0.459785704597857
Quantizing it to 16-bit values:
Y'' = Y' * (60160-4096) + 4096 = 22148.6 = 22149
C''b = (C'b + 0.5) * (61440-4096) + 4096 = 53433.05368342723 = 53433
C''r = (C'r + 0.5) * (61440-4096) + 4096 = 59133.95144445951 = 59134
Your 10-bit input (346, 835, 924) maps to:
Y' = (346-64) / (940-64) = 0.3219178082191781
C'b = (835-64) / (960-64) - 0.5 = 0.3604910714285714
C'r = (924-64) / (960-64) - 0.5 = 0.4598214285714286
Which is correct only to the 3rd decimal point, whereas a 16-bit number requires around 5 decimal points of precision. It is therefore not surprising that your input is off by 2/65535, which is on the order of the 5th decimal place.

If your input is inexact, the correct result is for the output to be inexact. You can work the math out yourself.

Here you are second guessing what the original intent behind the input code value was. When I supply cove value 346 on input to the matrix conversion I expect it to be treated as 346.000 rather than 346.078125. I don't really want to focus on the magenta situation, as you say it's only 2/65535 off and there is a bigger issue that would be good to get to the bottom of:
Have you got a view regarding this comment above?
https://github.com/sekrit-twc/zimg/issues/109#issuecomment-514738053

Pwrhaps error came from fact that zscale override matrix to rgb one for rgb output pixel formats?

Here you are second guessing what the original intent behind the input code value was.

Getting offended by maths is a new one. Different strokes, different folks perhaps...
Y' = (346-64) / (940-64) = 0.3219178082191781
C'b = (835-64) / (960-64) - 0.5 = 0.3604910714285714
C'r = (924-64) / (960-64) - 0.5 = 0.4598214285714286

B' = C'b * 1.8814+ Y' = 1.0001457100048923
R' = C'r * 1.4746 + Y' = 0.9999704867906067
G' = (Y' - 0.2627*R' - 0.0593*B')/0.6780 = -0.00012253578761713176

R'' = R'*65535 = 65533.065851822415 = 65533
G'' = G'*65535 = -8.030382841488729 = -8
B'' = B'*65535 = 65544.54910517062 = 65544

So we see that your "original intent" is to produce the color (65533, -8, 65544), and it is only clipping that is allowing you to have the delusion that you are close to (65535, 0, 65535).

Trust me, I had done my maths on these colour chips before submitting the original ffmpeg bug report. I know there is clipping required for the YCbCr triplet (0x015a, 0x343, 0x039c).
I don't think we are in a mathematical disagreement here and I hope you are not offended.
Sorry for repeating myself, but have you got a view on the more serious discrepancy 58% White when ffmpeg zscale is used?

I have not been able to set up a FFmpeg debug environment, as I have no involvement w/ vf_zscale. It will probably take a few more days to investigate.

I looked at the log output in the first post, which appears to indicate that z.lib is not involved in converting to RGB.

[Parsed_zscale_0 @ 000001ed6f284f80] w:3840 h:2160 fmt:yuv422p10le sar:0/1 -> w:3840 h:2160 fmt:yuv422p10le sar:0/1
[auto_scaler_0 @ 000001ed6f297980] w:3840 h:2160 fmt:yuv422p10le sar:0/1 -> w:3840 h:2160 fmt:rgb48le sar:0/1 flags:0x4
[Parsed_zscale_0 @ 000001ed6f284f80] w:3840 h:2160 fmt:yuv422p10le sar:0/1 -> w:3840 h:2160 fmt:yuv422p10le sar:0/1

I tried to reproduce this with an FFmpeg build that I compiled myself, but I could not determine how to convert to RGB by reading the documentation (https://ffmpeg.org/ffmpeg-filters.html#zscale-1).

There is user supplied command above...

@cepesh Could you use zscale=other parameters us usual,format=rgb48le instead of what are you using currently?

@cepesh I did some Googling and found that you must add 'format=gbrp16le' after 'zscale'. Otherwise, FFmpeg instructs z.lib to perform a no-op conversion from YUV to YUV, and instead uses its internal code to convert to RGB.


Loglevel setting not working

Describe the bug
I am starting the image updater pod such:
      containers:
        - name: argocd-image-updater
          image: argoprojlabs/argocd-image-updater:v0.11.0
          command:
            - /usr/local/bin/argocd-image-updater
            - run
            - --loglevel
            - warn

Problem
the update still outputs info messages, instead of just warning (or higher).
Note: while the help for the --loglevel flag mentions warn as the correct log level name, the level name as show in log is warning (though using warning as flag value results in error)
Expected behavior
log messages should be warn and higher only.
Additional context
Add any other context about the problem here.
Version
v0.11.0

I suspect the log messages you see may come from some dependency component, and not from the image updater itself.
Do you have examples of what is logged in info level despite setting log level to warn?

Note: while the help for the --loglevel flag mentions warn as the correct log level name, the level name as show in log is warning (though using warning as flag value results in error)

Hum. This sounds wrong, and we should fix it :)

Hi,
Thanks for the quick reply!
This is an example
time="2021-12-17T09:52:50Z" level=info msg=Trace args="[rm -rf /tmp/git-comp-dev602057691]" dir= operation_name="exec rm" time_ms=0.845043

Now that you mention it, looks like the vast majority of infos that the image updater container outputs are related to git.

another example:
argocd-image-updater-7bf4cb7d55-dhcwk argocd-image-updater time="2022-12-12T16:39:21Z" level=warning msg="temporarily disabling strict host key checking (i.e. '-o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null'), please don't use in production"

when logLevel set to "error"


Cross worksheet updates, a start

This is a mostly working first cut of cross worksheet updates. One of the contrived example under test is
worksheet parent {
	1:child_amount number[2] computed_by {
		return child.amount
	}
	2:child child
}

worksheet child {
	5:amount number[2]
}

Implementation Notes

Expressions such as foo or foo.bar are now selectors, and we replace the tVar type by a tSelector type.
Selectors can either be paths to select a specific field, as in the above example where child.amount points to the amount field of child worksheet, or selectors can be more complex as in children.amount where children is a []child would be a []number[2] essentially selecting a specific field on a slice level.
Dependents handling is expanded to cross worksheet dependents. Minor change, instead of having a map[int]... on a worksheet definition, we now place the data directly on the field.
When updating a child field which depends on a parent, we need a way to get to the parent worksheet in order to call its computed_by. To this end, we now track all reverse pointers in a parents map.
These reverse pointers, or parents, are essentially tracking all the parents who know about a worksheet, and the path through which they know this worksheet.
Using the above example, an instance of the child worksheet being attached to an instance of a parent would have a reverse path of "parent" -> 2 -> "<uuid>" -> parent. This reverse path is first the name of the type of worksheet ("parent"), the field index through which it is being referenced (2), then the UUID, then the reference itself.
When setting, appending, or deleting, we update and track those reverse pointers.
And with all this scaffolding, we can finally trigger computed_by properly and update all parents appropriately.

Looking now! Might be a little while... 😄


sample-app failes to create SNS listener

Trying to get localstack and cdklocal working together on WSL Ubuntu.
Following the instructions with the sample-app from your github, I get an error when creating the SNS subscription:
cdklocal bootstrap is successful:
 ⏳  Bootstrapping environment aws://000000000000/ap-southeast-2...
Trusted accounts for deployment: (none)
Trusted accounts for lookup: (none)
Using default execution policy of 'arn:aws:iam::aws:policy/AdministratorAccess'. Pass '--cloudformation-execution-policies' to customize.
CDKToolkit: creating CloudFormation changeset...
 ✅  Environment aws://000000000000/ap-southeast-2 bootstrapped.

cdklocal deploy fails:
➜  test git:(master) ✗ cdklocal deploy

✨  Synthesis time: 1.1s

TestStack: building assets...

[0%] start: Building 88ad49c71a87e84166ac6e961b1dc01a3a6998e920348b10c0d4c04a8e49b0db:current_account-current_region
[100%] success: Built 88ad49c71a87e84166ac6e961b1dc01a3a6998e920348b10c0d4c04a8e49b0db:current_account-current_region

TestStack: assets built

This deployment will make potentially sensitive changes according to your current security approval level (--require-approval broadening).
Please confirm you intend to make the following modifications:

IAM Statement Changes
┌───┬──────────────────┬────────┬─────────────────┬───────────────────────────┬──────────────────────────────────────────────────┐
│   │ Resource         │ Effect │ Action          │ Principal                 │ Condition                                        │
├───┼──────────────────┼────────┼─────────────────┼───────────────────────────┼──────────────────────────────────────────────────┤
│ + │ ${TestQueue.Arn} │ Allow  │ sqs:SendMessage │ Service:sns.amazonaws.com │ "ArnEquals": {                                   │
│   │                  │        │                 │                           │   "aws:SourceArn": "${TestTopic}"                │
│   │                  │        │                 │                           │ }                                                │
└───┴──────────────────┴────────┴─────────────────┴───────────────────────────┴──────────────────────────────────────────────────┘
(NOTE: There may be security-related changes not in this list. See https://github.com/aws/aws-cdk/issues/1299)

Do you wish to deploy these changes (y/n)? y
TestStack: deploying...
[0%] start: Publishing 88ad49c71a87e84166ac6e961b1dc01a3a6998e920348b10c0d4c04a8e49b0db:current_account-current_region
[100%] success: Published 88ad49c71a87e84166ac6e961b1dc01a3a6998e920348b10c0d4c04a8e49b0db:current_account-current_region
TestStack: creating CloudFormation changeset...

 ❌  TestStack failed: Error: The stack named TestStack failed to deploy: CREATE_FAILED (Deployment failed)
    at FullCloudFormationDeployment.monitorDeployment (/home/dean/.nvm/versions/node/v16.14.2/lib/node_modules/aws-cdk/lib/api/deploy-stack.ts:505:13)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
    at deployStack2 (/home/dean/.nvm/versions/node/v16.14.2/lib/node_modules/aws-cdk/lib/cdk-toolkit.ts:241:24)
    at /home/dean/.nvm/versions/node/v16.14.2/lib/node_modules/aws-cdk/lib/deploy.ts:39:11
    at run (/home/dean/.nvm/versions/node/v16.14.2/lib/node_modules/p-queue/dist/index.js:163:29)

 ❌ Deployment failed: Error: Stack Deployments Failed: Error: The stack named TestStack failed to deploy: CREATE_FAILED (Deployment failed)
    at deployStacks (/home/dean/.nvm/versions/node/v16.14.2/lib/node_modules/aws-cdk/lib/deploy.ts:61:11)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
    at CdkToolkit.deploy (/home/dean/.nvm/versions/node/v16.14.2/lib/node_modules/aws-cdk/lib/cdk-toolkit.ts:315:7)
    at initCommandLine (/home/dean/.nvm/versions/node/v16.14.2/lib/node_modules/aws-cdk/lib/cli.ts:358:12)

Stack Deployments Failed: Error: The stack named TestStack failed to deploy: CREATE_FAILED (Deployment failed)

When I remove the subscription from the stack by commenting out this line  topic.addSubscription(new subs.SqsSubscription(queue)); I can see the stack has been created successfully -  both sqs and sns have been created when I run awslocal sns list-topics and so on.
I can use awslocal to manually create a subscription, so I don't believe it is a problem there

Hi @deanbaker , thanks for reporting, and apologies for the very long delay. We haven't been able to replicate this issue - seems like the deployment of the CDK JavaScript sample app succeeds with the latest version:
$ cdklocal init sample-app --language=javascript
...
$ cdklocal bootstrap
...
$ cdklocal deploy
...
┌───┬──────────────────┬────────┬─────────────────┬───────────────────────────┬──────────────────────────────────────────────────┐
│   │ Resource         │ Effect │ Action          │ Principal                 │ Condition                                        │
├───┼──────────────────┼────────┼─────────────────┼───────────────────────────┼──────────────────────────────────────────────────┤
│ + │ ${TestQueue.Arn} │ Allow  │ sqs:SendMessage │ Service:sns.amazonaws.com │ "ArnEquals": {                                   │
│   │                  │        │                 │                           │   "aws:SourceArn": "${TestTopic}"                │
│   │                  │        │                 │                           │ }                                                │
└───┴──────────────────┴────────┴─────────────────┴───────────────────────────┴──────────────────────────────────────────────────┘
(NOTE: There may be security-related changes not in this list. See https://github.com/aws/aws-cdk/issues/1299)

Do you wish to deploy these changes (y/n)? y
TestStack: deploying... [1/1]
[0%] start: Publishing 5add20c85c5bcda32aaf9a438a244060ddaf872f9525711b9c7f67f8a61e8195:current_account-current_region
[100%] success: Published 5add20c85c5bcda32aaf9a438a244060ddaf872f9525711b9c7f67f8a61e8195:current_account-current_region
TestStack: creating CloudFormation changeset...

 ✅  TestStack

✨  Deployment time: 5.16s

Stack ARN:
arn:aws:cloudformation:eu-central-1:000000000000:stack/TestStack/ba3e4010

✨  Total time: 5.36s

Can you please pull the latest LocalStack Docker image, install the latest version of cdklocal, and give it another try? Thanks for your help!

Closing as resolved - please do let us know if the problem persists.. Thanks!


add missing support for contextAttributes in ProduceEvent

Many thanks for submitting your Pull Request :heart:!
What this PR does / why we need it:
The ProduceEvent Definition here has this concept of contextAttributes but in the SDK, the POJO does not have it (ref). Which causes exception at the time of converting String to Workflow POJO.
This PR attempts to fix that.
Special notes for reviewers:
N/A
Additional information (if needed):
N/A

Hi @tsurdilo could you please take a look at this? Thanks.


MediatR issue

Hi,
I updated MediatR to its latest version and I am receiving this error below if anyone has also received this error please could you assist me on a fix.

First Q ; Why needed to update version ???
Right Way ;
As you know , Error clearly says that Interface is not implemented,
Just click to yellow bulb then select Implement interface then fix not implemented yet exception part in newly created method ..
Best Solution For Your Situation ;
you can find in git and copy paste implemented source of same versions ;) i guess ..
Suggest;
If you dont know, what are you doing;
just return back to old versions on dependicies.. no shame on that.

Thanks @kanpinar

The v4 of MediatR have a break change.
I will update the project to use this version and you can check the new implementation.

Thank you @EduardoPires much appreciated!

@EduardoPires sorry to ask this but when can we expect the next release?

public Task Handle(DomainNotification message, CancellationToken cancellationToken)
        {
            cancellationToken.ThrowIfCancellationRequested();

            _notifications.Add(message);

            return Task.CompletedTask;
        }


LoopRotate: Fix avoiding copy_value hoisted to the pre-header

copy_value is marked as having no side effects.
Teach LoopRotate to avoid moving it to the pre header and instead duplicate it while rotating the loop.

@swift-ci test

LoopRotate looks for mayHaveSideEffects - https://github.com/apple/swift/blob/5b9aef91f8e96dcc82ac3828c18fa26473d17fe6/lib/SILOptimizer/LoopTransforms/LoopRotate.cpp#L116
copy_value is marked as having no side effects

@eeckstein Here's the issue:
In OSSA copy_value does not have any side-effects for the purpose of deleting the instruction or moving code around the instructions. As long as the OSSA constraints still hold-up, those transformations are legal. So, in that sense "may-retain" is false. But for the purpose of hoisting/sinking the copy_value itself, it does perform a retain. So in that sense, "may-retain" is true. Any idea how we want to model this kind of side-effect going forward?


Is it possible to fix audio output bug via mod?

I'm still getting that awful audio output bug on both Steam Deck and under WINE (Crossover) on Mac...basically the audio cuts out entirely, sometimes as often as every 60 seconds or so, until you manually re-select the sound output device in settings and press OK. The worst part is that this often triggers during cutscenes or long dialogue exchanges, meaning that you're required to pass through those parts of the game with no sound (because you can't access the menu to re-select sound output) and then can't go back. Kinda ruins the game! Let me know if audio output device re-selection at a regular interval might be possible to mod in...thanks for all your work on this! Fantastic stuff

Is this an issue with the game or your deck. Haven't seen many reports of audio stopping.

Is this an issue with the game or your deck. Haven't seen many reports of audio stopping.

Give it a google if you’re interested? The audio issues with this game to date are widely documented, both the one I describe (which re-selecting output fixes) and the even more common one where volume is too low (even referenced here on this GitHub issues site), especially for spoken dialogue. And the fact that it occurs on multiple WINE platforms (at least for some users) means it’s certainly not unique to the Deck – not mine, and not the Deck as a platform

I get the low volume one myself and am not fond of the current "solution" being a third party audio management app. I've had to basically ditch my 5.1 setup and get it to output from the display, otherwise I'd never hear a single thing.

Is this an issue with the game or your deck. Haven't seen many reports of audio stopping.

Give it a google if you’re interested? The audio issues with this game to date are widely documented, both the one I describe (which re-selecting output fixes) and the even more common one where volume is too low (even referenced here on this GitHub issues site), especially for spoken dialogue. And the fact that it occurs on multiple WINE platforms (at least for some users) means it’s certainly not unique to the Deck – not mine, and not the Deck as a platform

Merely asked because its a well known issue that after using another output device on the deck that output issues can arise just like you mentioned, altho I'm sure you've googled that and tried those fixes. Just was asking cause it fixed it for me.

Many people faced this audio cuts out bug. It's really a awful bug, don't know what's the root cause or how to fix it.

https://steamcommunity.com/app/2679460/discussions/0/4842023333108648537/

https://steamcommunity.com/app/2679460/discussions/0/4842023530177167998/

https://steamcommunity.com/app/2679460/discussions/0/6781949392680073916/

https://steamcommunity.com/app/2679460/discussions/0/4695658043402205666/

https://steamcommunity.com/app/2679460/discussions/0/4695658272798103918/

https://steamcommunity.com/app/2679460/discussions/0/4695658043402139899/

https://steamcommunity.com/app/2679460/discussions/0/4695657408659512127/


use batoto v3 instead of v2

Source name
Bato.to
Source language
Multi
Describe your suggested feature
There are two types of UI on batoto
v3 is the most recent one
the url bato.to still works on v3
Other details
No response
Acknowledgements

[X] I have searched the existing issues and this is a new ticket, NOT a duplicate or related to another open or closed issue.
[X] I have written a short but informative title.
[X] If this is an issue with the app itself, I should be opening an issue in the app repository.
[X] I have updated the app to version 0.15.3.
[X] I will fill out all of the requested information in this form.

Add a :+1: reaction to issues you find important.

Eventually when they switch their main site over


VS Code not displaying error highlighting

Type: Bug
errors are not producing any highlighting (red squiggles), or filename highlighting (red filenames), at all in my VS Code when working in Javascript and several other languages.
I un-installed all extensions. Nothing changed. I reinstalled the app, nothing changed. I deleted all referenced to the app, re-installed, and then it worked. Temporarily. Just happened again though, no error highlighting again.
I am writing typeScript currently, but also not working on js, html so far. Error highlighting is still currently working with JSON and Python
I am currently not running any extension at all, as I uninstalled all for testing purposes. I was using the ES7+ React/Redux/React-Native snippets and a few others.
Any code that would normally produce an error highlight is not.
const someConst = 1;
const someConst = 2;
the above will produce no error highlight in vscode, but obviously not run or compile.
I am running on a Mac with Apple Silicon.
VS Code about: Version: 1.79.2 (Universal) Commit: 695af097c7bd098fbf017ce3ac85e09bbc5dda06 Date: 2023-06-14T08:58:52.392Z (2 wks ago) Electron: 22.5.7 Chromium: 108.0.5359.215 Node.js: 16.17.1 V8: <IP_ADDRESS>-electron.0 OS: Darwin arm64 22.5.0
VS Code version: Code 1.79.2 (Universal) (695af097c7bd098fbf017ce3ac85e09bbc5dda06, 2023-06-14T08:58:52.392Z)
OS version: Darwin arm64 22.5.0
Modes:

System Info

Item
Value

CPUs
Apple M1 (8 x 24)

GPU Status
2d_canvas: enabledcanvas_oop_rasterization: disabled_offdirect_rendering_display_compositor: disabled_off_okgpu_compositing: enabledmetal: disabled_offmultiple_raster_threads: enabled_onopengl: enabled_onrasterization: enabledraw_draw: disabled_off_okvideo_decode: enabledvideo_encode: enabledvulkan: disabled_offwebgl: enabledwebgl2: enabledwebgpu: enabled

Load (avg)
1, 1, 1

Memory (System)
8.00GB (0.05GB free)

Process Argv
--crash-reporter-id 4c602a60-ee36-49ec-a042-ffa715e8038a

Screen Reader
no

VM
0%

Extensions: none
A/B Experiments
vsliv368:30146709
vsreu685:30147344
python383:30185418
vspor879:30202332
vspor708:30202333
vspor363:30204092
vslsvsres303:30308271
vserr242:30382549
pythontb:30283811
vsjup518:30340749
pythonptprofiler:30281270
vshan820:30294714
vstes263:30335439
vscod805cf:30301675
binariesv615:30325510
bridge0708:30335490
bridge0723:30353136
vsaa593:30376534
pythonvs932:30410667
py29gd2263:30776702
vsclangdf:30486550
c4g48928:30535728
dsvsc012cf:30540253
pynewext54:30695312
azure-dev_surveyone:30548225
3biah626:30602489
pyind779:30671433
89544117:30613380
pythonsymbol12:30671437
showlangstatbar:30737416
vsctsb:30748421
pythonms35:30701012
03d35959:30757346
pythonfmttext:30731395
pythoncmvfstrcf:30756944
fixshowwlkth:30771522
showindicator:30766890
pythongtdpath:30769146
e440d664:30776459
pythonidxpt:30772539
pythondjangotscf:30772537
pythonnocebcf:30776496

The solution was:
Open the Extensions View, and type @builtin into the search bar. Look for extensions that are disabled (they will be displayed dimmer than those that are enabled). For example, check for the "TypeScript and JavaScript Language Features" extension, the "HTML Language Features" extension, and the "CSS Language Features" extension.
TypeScript and JavaScript Language Features was disabled.


feat(module:select): support custom option template

close #227
PR Checklist
Please check if your PR fulfills the following requirements:

[x] The commit message follows our guidelines: https://github.com/NG-ZORRO/ng-zorro-antd/blob/master/CONTRIBUTING.md#commit
[ ] Tests for the changes have been added (for bug fixes / features)
[x] Docs have been added / updated (for bug fixes / features)

PR Type
What kind of change does this PR introduce?

[ ] Bugfix
[x] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Build related changes
[ ] CI related changes
[ ] Documentation content changes
[ ] Application (the showcase website) / infrastructure changes
[ ] Other... Please describe:

What is the current behavior?

Issue Number: N/A
What is the new behavior?
Does this PR introduce a breaking change?
[ ] Yes
[x] No

Other information

Coverage increased (+0.007%) to 41.048% when pulling fb328633cce156379c361d18a8c76b1c8fe444d1 on vthinkxie:support-option-template into b7cc148c594fd106c9b0599d715e38a0355c3e17 on NG-ZORRO:master.