Support include for libraries, to "merge" several libraries into one single namespace

Consider a series of libraries pertaining to a data structure, e.g. FStar.Seq and FStar.SeqProperties for finite sequences. Then, to use finite sequences in their programs, end users would have to explicitly import all libraries through:
open FStar.Seq
open FStar.SeqProperties
Ideally, we would like to provide the user with a single library which would be enough for them to import, regardless of how and why the other underlying libraries are organized.
In our example, we would rename FStar.Seq into FStar.SeqBase, and we would like to provide the user with a single FStar.Seq library so that open FStar.Seq would automatically import FStar.SeqBase and FStar.SeqProperties. The contents of FStar.Seq would be something like:
module FStar.Seq
include FStar.SeqBase
include FStar.SeqProperties
This solution would be enough for the user to import all definitions of FStar.SeqBase and FStar.SeqProperties into the unqualified namespace.
(It would be actually similar to Export in Coq, to this respect, see for instance ZArith in the Coq standard library for mathematical integers.)
However, what if the user wants to use both finite sequences and lists in their programs? In particular, what if the user wants to use length and append from both FStar.Seq and FStar.List.Tot, and their associated lemmas? Then, the user will need to explicitly qualify their uses of append with correct namespaces.
In this case, the user will need to figure out that the append related to lists is actually defined in FStar.List.Tot, which is vulnerable to any refactoring of the underlying list libraries.
Ideally we would like to define FStar.List so that the user can access the list-related append using FStar.List.append, regardless of which underlying library it is actually defined in.
BEGIN DIGRESSION
In Coq, this is possible thanks to nested modules. For instance, for mathematical integers, one can do Import ZArith which provides the user with a Z namespace giving access to all operators and lemmas related to mathematical integers, such as Z.add (addition) and Z.add_0_r (the fact that x+0=x.)
In fact, this Z namespace is made of two modules called Z, one defined  in BinIntDef and providing Z.add, and another defined in BinInt and providing Z.add_0_r. BinIntDef and BinInt are both exported by ZArith.
Now, if the user only wants to use mathematical integers, they can Import ZArith and Import Z once and get add and add_0_r both in the unqualified namespace, since BinInt.Z has Include BinIntDef.Z.
END DIGRESSION
Of course this is not currently possible in F*. So, we would like to have the proposed include mechanism take care of this namespace issue as well, so that, renaming FStar.List into Fstar.ListBase
and defining FStar.List as:
module FStar.List
include FStar.List.Tot
include FStar.ListBase
include FStar.ListProperties

The following question may need to be spun off as a separate issue at some point: should we shift the focus of the F* standard list library from effectful to total functions? In other words, instead of having FStar.List for effectful functions and FStar.List.Tot for total functions:

should we instead have FStar.List for total functions and FStar.List.Effectful for effectful functions?
with the above namespace proposal, should we still have FStar.List.Tot exported by FStar.List, but not have effectful functions exported by FStar.List at all?
or, on the contrary, should we have both effectful and total functions exported by FStar.List, and if so, which ones should we allow to shadow the others in the FStar.List namespace?

Isn't it just a matter of having an include directive, where module FStar.List is just the inclusion of several other modules? This scenario may be supported by the "cheap functor" proposal I had a while ago... but maybe a proper export directive would be more appropriate, indeed.

 If we have module A export B, then resolving A.f while would transitively search in the namespace of B.

'export' renamed into 'include'

In fact, the new branch taramana_include that I just pushed deprecates the old branch taramana_export, thanks to the name resolution improvements merged in pull request #772 .

The branch taramana_include_seq, descending from taramana_include, illustrates the use of include with FStar.Seq, exactly as mentioned in this issue:
module FStar.Seq
include FStar.Seq.Base
include FStar.Seq.Properties

and all client code only uses FStar.Seq, no longer explicitly mentioning the former FStar.SeqProperties module.

@tahina-pro  So can this be closed now?

Done for sequences (see above) and also for lists (FStar.List.Tot includes FStar.List.Tot.Base and FStar.List.Tot.Properties)
Are there any further instances in the standard library where include might be desirable?

Closing this as suggested by @catalin-hritcu and now follow-up on @tahina-pro's question for further instances.


Default handler for TALKREQ

What was wrong?
The protocol specifies that upon receiving a TALKREQ message for a protocol that does not have a handler, that an empty TALKRESP should be sent.
How can it be fixed?
We can do this quick by simply adding a static listener to the NetworkAPI similar to how ping messages are answered.   However, very soon we'll need a way to indicate what protocols are supported and to register handlers for them.

fixed in #108


Remember device for 30 days - Part 1

I am breaking this feature up into 2 PRs to make reviewing easier. This PR adds the new db table and user_service functions for saving devices. Part 2 of this feature can be found in https://github.com/ristomcgehee/warehouse/pull/2 in case you want to see how this code is used, but you shouldn't need to review Part 2 to review this PR. This PR can be merged to main independently of Part 2.
Part of https://github.com/pypi/warehouse/issues/5867

Closing to rework this to use a signed token as ewdurbin suggested.


Preprocess2 non-dita files not copied correctly to output dir

Description
For target copy-html2 I followed the same change that was made to copy-image and copy-image2 for preprocess2.
Motivation and Context

In preprocess2, non dita/ditamap/ditaval/image/coderef resources are not being copied to output directory.
Fixes #3966
@raducoravu , does this help with #3242 since you mentioned #3966 may be a duplicate.
I am not exactly sure how to submit this as a patch to v3.7.x but I would like to. Does someone need to create a hotfix/3.7.5 and I would create a PR against that branch?
How Has This Been Tested?
I have tested this change with v4.0.2, v3.7.4 and the develop branch using these sample files preprocess2_test.zip

Type of Changes
Bug fix (non-breaking change which fixes an issue)
Documentation and Compatibility
no doc change necessary
Checklist

My code follows the code style of this project.

https://github.com/dita-ot/dita-ot/wiki/Java-Coding-Conventions
https://github.com/dita-ot/dita-ot/wiki/XSLT-Coding-Conventions
https://github.com/dita-ot/docs/wiki/coding-guidelines

I have updated the unit tests to reflect the changes in my code.
I am not sure what if any unit tests need to be updated. Please let me know if I need to do this as it is my first PR to dita-ot.

@jomjohn - I do not know how to update unit tests, as they are written in Java (see #4009 for more information). Before I submit a PR, I run the following commands to confirm the existing tests still pass:
./gradlew
./gradlew dist
./gradlew test
./gradlew e2etest

So far, I am usually lucky that they do. :)
@jelovirt - are test and e2etest the only targets needed to test a PR? If so, I will contribute a PR to add a fifth testing step in the developer's README.md here:
https://github.com/dita-ot/dita-ot/blob/develop/README.markdown?plain=1#L81

@jomjohn yes it also helps with #3242, the resource gets correctly copied to the output folder instead a folder named "${_dita.map.output.dir}".

@ chrispy-snps  also gradle integrationtest is needed. Basically, all test categories.

I submitted PR #4150 to better capture the testing required for DITA-OT contributions.

Testing this and I think this doesn't solve the problem. Investigating.


React native version

Is there a version for react native?

Hi @frankieb93,
Currently there is NOT a supported RN plugin available. But, we are investigating solutions.
We would love to know more about what you are doing and assist you as possible.
Please sign up for our free Developer Program here:
https://developerprogram.brother-usa.com
If you are outside the US, please send email to<EMAIL_ADDRESS>to provide details about your project, and we can try to connect you to the appropriate resources.
-Rob

Hello @frankieb93
As @robr2112 said above, this plugin is only for cordova/capacitor/ionic related projects.
Google would be your best friend.
BTW, Google brought up this one
https://github.com/Avery246813579/react-native-brother-printers
Give it a go and see if it works for you


Songs don't have length and bitrate

It is annoying issue because if you double click the song windows media player lags, saving music thru audacity fixes that but for 200+ songs it would take too much time. I think it is because of absence length and bitrate

interesting. I'll look into it.


⚠ Processors has degraded performance

In abca92f, Processors ($STATUS_URL) experienced degraded performance:

HTTP code: 200
Response time: 43 ms

Resolved: Processors performance has improved in 027179e.


⚠ SceneTime has degraded performance

In d719074, SceneTime ($ST) experienced degraded performance:

HTTP code: 200
Response time: 1748 ms

Resolved: SceneTime performance has improved in 9e1e3ae after 6 minutes.


Language Support still refers to pipeline templates

Description of Problem:
The Language Support doc page still references the pipeline templates. As the pipeline templates are deprecated, we should update the page and refer to concrete pipelines.
See also this forum post.

Should be fixed on master! https://github.com/RasaHQ/rasa/blob/master/docs/docs/tuning-your-model.mdx

No longer referenced on the Language support page


Text-selection error in double-column PDF

Link to PDF file (or attach file here):
Nat Struct Mol Biol 2008 Zenklusen.pdf
Configuration:

Web browser and its version: Chrome 58.0.3029.96
Operating system and its version: Windows 15063.250
PDF.js version: 1.7.225
Is an extension: No

Steps to reproduce the problem:

double click any word at the end of a line

What is the expected behavior? (add screenshot)

What went wrong? (add screenshot)

What is the expected behavior? (add screenshot)

What went wrong? (add screenshot)

I have the same issue.

This problem is likely to be caused by different selection policy of Chrome on adjacent position: absolute containers. Injecting a <br> after every text element seems to fix this.

Closing since this is a duplicate of #6678.


Add Flickr api function

add Flickr api function

Coverage remained the same at 93.698% when pulling 58c69a15a02948e5c6bdcc0a0b8a622efd88d2d9 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

@takfukuda917 Tip on how-to edit a commit message in SourceTree Windows (already pushed to remote)

Coverage remained the same at 93.698% when pulling 5b09ba1c10a8e9174660068583ea1dc46f655de4 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling 489c34167188af70c62d5f23a3ed1d1bda3e2577 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling 489c34167188af70c62d5f23a3ed1d1bda3e2577 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling d9591a2473e04da32349b93e472fbc7d29b3acf2 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling d9591a2473e04da32349b93e472fbc7d29b3acf2 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling fb713e37fc201f525762ec7e183e1fa9346ceac6 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling d025fd6e028eeeeddea9c3798ba93529074b47f0 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

@danactive Please check the pull request #124

Coverage remained the same at 93.698% when pulling c59b49e2933559f50a58d24d927d6a25a4bb6019 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling cc6218d900e37e7edca63ec1af1464ba76fa63d7 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling cc5d906850be4bbd58f913301b3cb6a9a717933f on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling cc5d906850be4bbd58f913301b3cb6a9a717933f on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling cc5d906850be4bbd58f913301b3cb6a9a717933f on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling cc5d906850be4bbd58f913301b3cb6a9a717933f on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling 4ac8b42efd97d46ca73855ca763a9a1431d4b2e4 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling 5c1a477dfd4dd24a5edab1d3fd1ebfc057b202d5 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling b580de98351a93f614ec9aefae410a3141d44ed9 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling b580de98351a93f614ec9aefae410a3141d44ed9 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling b580de98351a93f614ec9aefae410a3141d44ed9 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling b580de98351a93f614ec9aefae410a3141d44ed9 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling b580de98351a93f614ec9aefae410a3141d44ed9 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling 7ed1480905a820fffd784331f5819b043898eede on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling bfedd0bf614d17179f15199a3a8bde9fc8617937 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling bfedd0bf614d17179f15199a3a8bde9fc8617937 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling 5fe7fb9ea25d69d0f21c6e81cc64e941bca17e27 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling 5fe7fb9ea25d69d0f21c6e81cc64e941bca17e27 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling 5fe7fb9ea25d69d0f21c6e81cc64e941bca17e27 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling c0cc33740b0b65639a77172aa012997b16b33438 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling c0cc33740b0b65639a77172aa012997b16b33438 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling c0cc33740b0b65639a77172aa012997b16b33438 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling 54523c5fb72864f3d28a6dbd51c4ff6489159c11 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling 54523c5fb72864f3d28a6dbd51c4ff6489159c11 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling 54523c5fb72864f3d28a6dbd51c4ff6489159c11 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling 2444fda7fc5f8e38ed291e55a83c1c9d235db607 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling e467a4ca47d13234967ea1470995dae28da4766f on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling e467a4ca47d13234967ea1470995dae28da4766f on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling e467a4ca47d13234967ea1470995dae28da4766f on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling c7303d4fb974cac5ea8011c9a3bdc57c8157e465 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling c7303d4fb974cac5ea8011c9a3bdc57c8157e465 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling c7303d4fb974cac5ea8011c9a3bdc57c8157e465 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling 3ec37f4221f8e9916be1f1e45b6e22db6141a7d7 on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

@takfukuda917 I cloned your branch and I'm not seeing any Flickr gallery. Please provide steps on how to view your feature you are delivering

@takfukuda917

@takfukuda917 Oops closed the PR too soon.
I found where the JavaScript is failing

@takfukuda917 Further investigation the AJAX call has invalid geocode
https://api.flickr.com/services/rest?method=flickr.photos.search&api_key=671aab1520e2cb69e08dd36a5f40213b&has_geo=1&lat=undefined&lon=undefined&radius=1&radius_units=km&extras=geo

Coverage remained the same at 93.698% when pulling 00c8c4153d75b9f95422c9b1dce784004dfecbbc on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling 00c8c4153d75b9f95422c9b1dce784004dfecbbc on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

Coverage remained the same at 93.698% when pulling 00c8c4153d75b9f95422c9b1dce784004dfecbbc on takfukuda917:master into 03236ab5017b2d50dd194627c19f9861a4dbfeb8 on danactive:master.

@danactive Fixed bug! Please check


pdf can't be generated

hi, everything works well, but when I operate the python main.py --all, nothing was generated in the file 'out'. You know the reason?

Without additional details, it's hard to tell.
First, I would have a look at the files data/lastActiveTimes.json and data/lastScrapeTime.txt after scraping to check they have the expected content.

Without additional details, it's hard to tell.
First, I would have a look at the files data/lastActiveTimes.json and data/lastScrapeTime.txt after scraping to check they have the expected content.

hey, sorry, i didnt say it clearly.
Today i tried to operate the code again, it was same as yesterday.
After 'python scrape.py', it showed that 'missing cookie. Have you run init.py?', did it mean that it was the issue of the chromedriver?
There were only data/lastActiveTimes.json and data/shortProfiles.json and they were empty, i didnt find data/lastActiveTime.json.
Best regards.

hey, sorry, i didnt say it clearly.
Today i tried to operate the code again, it was same as yesterday.
After 'python scrape.py', it showed that 'missing cookie. Have you run init.py?', did it mean that it was the issue of the chromedriver?
There were only data/lastActiveTimes.json and data/shortProfiles.json and they were empty, i didnt find data/lastActiveTime.json.
Best regards.


Crawling a SharePoint online site

we are currently using the Norconex collector-http to crawl our internal SharePoint on-premise sites without any problems using NTLM authentication.
would it be possible to crawl SharePoint online sites with the same crawler?
has anyone had any success in doing this? - the authentication scheme appears totally different.
thanks
MRC-westat

Can you elaborate on the authentication scheme used for the online version?

thanks for replying to my question,
yes - I have the specs here on the authentication used in SP online.
from Microsoft - specifications are here:
https://docs.microsoft.com/en-us/sharepoint/authentication
MRC-westat

My understanding is this type of authentication is for user login and is browser-based.  It requires human interaction that is hard to simulate (understandably).  You can try to simulate it using the PhantomJSDocumentFetcher but PhantomJS is no longer supported (FYI version 3 of HTTP Collector will offer the use of popular browsers).
Ideally, for this purpose, you would grant access to SharePoint online to an application instead of a web user. I believe looking at "server-to-server" authentication may be getting you a step closer.
Not sure if the HTTP Collector has all the configurable options required to pass what would be required (like secret tokens).   You may need to extend GenericHttpClientFactory or create your own.
I suggest you ask the SharePoint community to confirm, but I suspect the easiest approach would be to set up a SharePoint location-based solution.  You can grant access to specific network locations/IPs that you trust.  Relevant info: https://docs.microsoft.com/en-us/sharepoint/control-access-based-on-network-location


avalanchego: 1.11.8 -> 1.11.9

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://github.com/ava-labs/avalanchego/releases.
meta.description for avalanchego is: Go implementation of an Avalanche node
meta.homepage for avalanchego is: https://github.com/ava-labs/avalanchego
meta.changelog for avalanchego is: https://github.com/ava-labs/avalanchego/releases/tag/v1.11.9
Updates performed

Golang update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact
Checks done

built on NixOS
The tests defined in passthru.tests, if any, passed
found 1.11.9 with grep in /nix/store/94gb1vkk4pl5fyrr2g0wg7a6axp89sik-avalanchego-1.11.9
found 1.11.9 in filename of file in /nix/store/94gb1vkk4pl5fyrr2g0wg7a6axp89sik-avalanchego-1.11.9

Rebuild report (if merged into master) (click to expand)

2 total rebuild path(s)

2 package rebuild(s)

First fifty rebuilds by attrpath

avalanchego

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/94gb1vkk4pl5fyrr2g0wg7a6axp89sik-avalanchego-1.11.9 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A avalanchego https://github.com/r-ryantm/nixpkgs/archive/8c682a2b5a301d8bd9163dd83159b6cc690cddb3.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/8c682a2b5a301d8bd9163dd83159b6cc690cddb3#avalanchego

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/94gb1vkk4pl5fyrr2g0wg7a6axp89sik-avalanchego-1.11.9
ls -la /nix/store/94gb1vkk4pl5fyrr2g0wg7a6axp89sik-avalanchego-1.11.9/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

avalanchego

Maintainer pings
cc @urandom2 @qjoly for testing.

Result of nixpkgs-review pr 324487 run on aarch64-darwin 1

1 package built:

avalanchego


Fix typo in TensorFlow Linear Model Tutorial

Hi team!
Fixed a small typo in the TensorFlow Linear Model tutorial.

Can one of the admins verify this patch?

Test this please


Questions about alignment

Hi, MGTANet is an excellent work, but I don't  understand the specific operation of its alignment. As far as I know, NuScenes provides the internal and external parameters of the point cloud (Intrinsic and Extrinsic Parameters), which can be used to align multiple frames The BEV features of the point cloud are aligned (align), but MGTANet predicts the offset and weight of the BEV through a network, why not directly use the internal and external parameters to align(like BEVDet4D) , isn't it better?

Hello. In BEVDet4D, they only use internal and external parameters for ego-motion compensation. This method is able to align static objects to their current frame position, but dynamic objects remain misaligned. To tackle this issue, we developed a robust alignment method with deformable convolution under motion guidance, allowing for both static and dynamic objects to be aligned.


Missing collections from Provenance Research Project

Any idea why there is no data for "Provenance Research Project" and "Brooklyn Museum Costume Collection"?

Hi @andreitr -
Provenance Research Project and Brooklyn Museum Costume Collection are not listed as departments in the .csv file because they are not curatorial departments. You must have noticed that they are both listed in the departments filter on the website, which was intended to allow quick and easy access to those subsets of objects.
For reference, all objects associated with The Brooklyn Museum Costume Collection can be found under the department Costume Institute in the csv. The subset of objects that appear when you filter on the site fro Provenance Research Project are from a range of departments, which you can see by further browsing the department filter options on the site.
Hope that helps!

Liz


Building alto on Emscripten

I recently tried to build a dummy project listing alto as one of its dependencies, targeting Emscripten with --target asmjs-unknown-emscripten, and it failed because libloading does not (yet) support Emscripten.
I had reported this, but in the meantime, al-sys actually does not need the libloading dependency when target Emscripten, because there, "out-of-the-box" support for OpenAL is claimed (see this issue).
My suggestion : When the target is Emscripten, fall back to simply declaring the FFI bindings, and disable the libloading dependency so that it builds successfully.

Yeah, this is a problem I've been meaning to tackle for a while now, but haven't gotten around to it yet. When I'm done with the redesign of rental I'm going to take another pass at alto/al-sys to update them, and I'll add support for this then, unless someone PRs it first.

Ok, I've added support for the emscripten target to al-sys 0.4, it will now use static symbols. I don't have the environment set up to test it, though. If you try it in your app and it works, then I'll close this.

Alright, I've come up with a basic test for this, and it turns out that it works, with some caveats.
The thing is that Emscripten's OpenAL implementation appears to be slightly incomplete, (e.g alcGetEnumValue() isn't defined) and as a result, normal use of al-sys and alto may cause linker errors.
Otherwise, stuff appears to work. Running said test (after commenting out the lines that cause linker errors) using
cargo build --target asmjs-unknown-emscripten -v
node target/asmjs-unknown-emscripten/debug/alto-emscripten-example.js

gave me :
ALC Version: 1.1
Default device : emsc
OpenAL version : 1.1
OpenAL vendor : Emscripten
OpenAL renderer: WebAudio

Which looks pretty good. Didn't dig any further (e.g testing playback) because I don't have much time (embedding+loading files on Emscripten is a bit tedious even in C, etc).
Since the problem doesn't come from alto anymore, I think you can indeed close this, and I'll proceed to report an issue on Emscripten's repo.

Yeah, it's reasonable to leave this open until the issue is resolved, whatever the cause. I plan to explore emscripten more in the future, so perhaps I'll look into an upstream contribution at that point, unless someone beats me to it.

I think at long last we can close this.
Thanks for your help with the implementation!

Thanks, but I wonder, was the pull request all there is to it ? I mean, does Alto have tests or examples for Emscripten which would prove that this issue is resolved for good ?

I have a few emscripten specific tests, but they require a bunch of boilerplate to set up, so I don't really want to distribute them with alto itself. As far as alto is concerned emscripten is just another OpenAL impl like any other (now, at least). The only code specific to it is the special case for symbol lookup in al-sys.

Sorry to rehash this one, but what is the recommended current fix for:
          error: unresolved symbol: alcGetEnumValue

I'm hitting this one now and am scratching my head. Tried adding -lopenal to my linker arguments but it makes no difference, and I don't even know if I'm doing it correctly.
https://gitlab.com/ndarilek/rust-wasm-gamedev Trying to build with cargo-web 0.4.
Thanks.

Hi,
(I'm setting up my environment to try to reproduce this. It's taking quite a while. In the meantime...)
alcGetEnumValue() should not cause linker errors since our pull request to Emscripten was merged; if it does, it's likely to be the same for all other OpenAL functions, so the problem is at a lower level.
I think the following could help (perhaps I'm asking for too many irrelevant details, but it doesn't hurt):

Which Rustc version are you using ? Also, is it Stable or Nightly ?
What is the Emscripten version ?
What is the target ? I've read that asmjs-unknown-emscripten is the default one for cargo-web and it should be fine, but I wouldn't be sure about any other;
Have you read the 1st post of this forum thread ? (I'm pretty sure the answer is yes, but it doesn't hurt to ask :) )

Also, on our side, I see no #[link="openal"] (or something) whatsoever (the relevant part would be here).
It used to be that linking OpenAL was implicit in Emscripten, but not anymore as of the latest versions.  Therefore, perhaps we do miss something. I'll try and dig further.

Thanks for the quick response!

rustc 1.22.1 (05e2e1c41 2017-11-22) Stable.
emcc (Emscripten gcc/clang-like replacement) 1.37.21 ()
I've tried every target.
Yes, though I think cargo-web may obsolete much of it as it
downloads/sets up emscripten for you. Either way, I've tried with emsdk
and cargo-web's own emscripten download, same results. I'm currently
using the cargo-web implementation since it sets up in seconds, though
if that doesn't work for whatever reason then I can switch back to
emsdk. cargo-web's own setup seems complete and is much easier to maintain.

So I'm using rustc 1.24.0 Nightly, emcc is 1.37.21 and target asmjs-unknown-emscripten (and cargo-web 0.4) and the issue does indeed show up.
This Emscripten version is quite recent (circa December 2017) so as a user I'd expect stuff to work fine; Therefore, I'd be in favor or re-opening this issue until we find a fix.
I'm not very up-to-date myself with what happened besides our PR, but it was merged by the end of September; I wonder if it "made it" to a public release (probably yes, but in all cases, using the upstream Emscripten is worth considering).
Still digging...

Emscripten 1.37.21 was cut on August 31, so it's not surprising that our PR isn't in that release.

Then that should be it - also, my bad, I actually inferred the version's release date by looking at v1.37.23 in the changelog, wrongly thinking that a difference of 2 in the patch version meant they ought to be close in time.
(I'll still try to see if I can get the project to compile using the latest Emscripten or something, for my own sake)

Hey, thanks for catching that! I wasn't sure when these changes had
merged relative to the Emscripten release cycle.
Looks like cargo-web master supports the latest emscripten as of a few
hours ago. I'll give that a shot.

Confirming that this works with cargo-web via git, as it installs the
newest Emscripten. Thanks for catching my silly oversight! :)


Program and project dropdowns not appearing on Post AN OPPORTUNITY form

If I initiate the POST AN OPPORTUNITY form from the Opportunities list page, I'm not seeing the Program and Project dropdowns to select from...

Cool - seeing this now.


"[IDAS ERROR]  IDAGetDky   Illegal value for k." with event callbacks

When solving the "Robertson model" with event callbacks the following error occurs:

[IDAS ERROR]  IDAGetDky
Illegal value for k.
┌ Warning: IDAGetDky failed with error code =
│   flag = -25
└ @ Sundials ~/.julia/dev/Sundials/src/simple.jl:20

The event defitions are from Octave ode15i function tests. The events should occur nearly simultaneously, but with the error the second event is not detected.
The error happens when "save_everystep=true" option is given to "solve".
If "save_everystep=false" the error does not happen and the both events are correctly detected.
Also without events the problem is solved successfully.
Julia 1.5.3 and DifferentialEquations 6.15 with Sundials  v4.3.0
Below is test code.
import DifferentialEquations
const DiffEq = DifferentialEquations

function rob(out, du, u, p, t)
    out[:] .= [-(du[1] + 0.04*u[1] - 1e4*u[2]*u[3]),
          -(du[2] - 0.04*u[1] + 1e4*u[2]*u[3] + 3e7*u[2]^2),
          u[1] + u[2] + u[3] - 1]

    return out
end

function cond1(u, t, integrator)
    if (t < 1e1)
        val = -1
    else
        val = 1
    end
    return val
end

function cond2(u, t, integrator)
    if (t < 1e1)
        val = -2
    else
        val = 3
    end
    return val
end

dae_f = DiffEq.DAEFunction(rob)

tspan = (0.0, 100.0)
u0 = [1.0, 0.0, 0.0]
du0 = [-1e-4, 1e-4, 0.0]
differential_vars = [true, true, false]

dae_prob = DiffEq.DAEProblem(dae_f, du0, u0, tspan; differential_vars)

affect1 = (integrator)-> (println("Event 1 at time: $(integrator.t)"); integrator)
affect2 = (integrator)-> (println("Event 2 at time: $(integrator.t)"); DiffEq.terminate!(integrator))

cb1 = DiffEq.ContinuousCallback(cond1, affect1, nothing)
cb2 = DiffEq.ContinuousCallback(cond2, affect2)

cb_set = DiffEq.CallbackSet(cb1, cb2)

println("Sol 1")
sol1 = DiffEq.solve(dae_prob, DiffEq.IDA(); save_everystep=false,callback=cb_set)

println("\nSol 2")
sol2 = DiffEq.solve(dae_prob, DiffEq.IDA(); save_everystep=true,callback=cb_set)

println("\nSol 3")
sol1 = DiffEq.solve(dae_prob, DiffEq.IDA(); save_everystep=true)

The issue does not happen with Sundials 3.8.3.
The issue does happen with Sundials 3.9

function cond1(u, t, integrator)
    if (t < 1e1)
        val = -1
    else
        val = 1
    end
    return val
end

This doesn't make sense. The condition of a ContinuousCallback is supposed to be a rootfinding function, and this won't have a root. First of all, this should probably be a DiscreteCallback? But secondly, the condition as a rootfinding problem would be t-1e1

I wondered the same. Like I said the first post in Discourse, this problem is from Octave ode15i-function tests when Sundials is available in Octave. I am guessing that the event definitions are intended to be a "tough" case for the event finding and not a realistic problem.

In our world, it's not a tough case but an ill-defined one. @kanav99 it would be interesting to somehow support non-root cases though.

My guess is that the purpose of the discontinuous event function is to mimic some possible real world case where there would be need to differentiate two almost simultaneous events.
Anyway, the discontinuity does not seem to be the issue.
I get the same IDA error with conditions defined as:
function cond1(u, t, integrator)
    tanh(t-9.0)
end

function cond2(u, t, integrator)
    tanh(t-10.0)
end

Saw your latest post. t-9 should be a zero-cross right?
Might be similar to the issue I am having here
Works with Sundials from C, not via Sundials.jl might be the same root cause:)

Saw your latest post. t-9 should be a zero-cross right?
Might be similar to the issue I am having here
Works with Sundials from C, not via Sundials.jl might be the same root cause:)

Yes, it should detect two events at t=9 and t=10. The first t=9 event is detected, the second is not, instead the IDA error is generated.
Have you tried your example with Sundials 3.8.3? If it does work, then maybe that indicates the same root cause. (though I have no knowledge of Sundials, so just guessing.)

Yes, it should detect two events at t=9 and t=10. The first t=9 event is detected, the second is not, instead the IDA error is generated.
Have you tried your example with Sundials 3.8.3? If it does work, then maybe that indicates the same root cause. (though I have no knowledge of Sundials, so just guessing.)

SciML uses its own rootfinding because it fixes a few root misdetection issues. However, it always looks for the rootfinding 0. We haven't special-cased for the chance that the sign change is at a point which is not a zero, but a shift from -Inf to Inf. We can do that though.

SciML uses its own rootfinding because it fixes a few root misdetection issues. However, it always looks for the rootfinding 0. We haven't special-cased for the chance that the sign change is at a point which is not a zero, but a shift from -Inf to Inf. We can do that though.

Oh just read the other message. That's... weird. And it's an interpolation issue that Sundials throws? That needs to be looked into. Maybe it's something to do with the reinitialization

Oh just read the other message. That's... weird. And it's an interpolation issue that Sundials throws? That needs to be looked into. Maybe it's something to do with the reinitialization

Below is the error:
Sol 2
Event 1 at time: 8.999999999999998
[IDAS ERROR]  IDAGetDky
Illegal value for k.
┌ Warning: IDAGetDky failed with error code =
│   flag = -25
└ @ Sundials ~/.julia/packages/Sundials/xAoTr/src/simple.jl:20

Below is the error:
Sol 2
Event 1 at time: 8.999999999999998
[IDAS ERROR]  IDAGetDky
Illegal value for k.
┌ Warning: IDAGetDky failed with error code =
│   flag = -25
└ @ Sundials ~/.julia/packages/Sundials/xAoTr/src/simple.jl:20

I'm experiencing the same, or a similar, issue. I want to simulate a hybrid DAE system with a zero-order-hold controller. I use ContinuousCallbacks for triggering jumps in the dynamics and a PeriodicCallback to run the controller.
The attached example is a toy example. I realize that it is an ODE I am solving, and it does work fine to formulate as an ODEproblem and solve with Tsit5, in which case I have no issues with CallbackSets that combine ContinuousCallbaks and PeriodicCallbacks. However, I eventually want to simulate a DAE that is not an ODE.
using DifferentialEquations
using Sundials

# ODE disquised as DAE
function dyns!(y,dx,x,p,t)
    y[1] = dx[1] - x[1]
end

# xmin callback
xmin= -0.5
function xmin_cond(x,t,integrator)
   x[1]-xmin
end
function xmin_affect_neg!(integrator)
    integrator.u[1] = 0.01    # Reset x1. A bit confusing: integrator.u is x, DifferentialEquations reserves u for the state
end
xmin_cb = ContinuousCallback(xmin_cond,nothing,xmin_affect_neg!)

# xmax callback
xmax= 1.0
function xmax_cond(x,t,integrator)
   -(x[1]-xmax)
end
function xmax_affect_neg!(integrator)
    integrator.u[1] = -0.01    # Reset x1. A bit confusing: integrator.u is x, DifferentialEquations reserves u for the state
end
xmax_cb = ContinuousCallback(xmax_cond,nothing,xmax_affect_neg!)

# Nonsense ZOH controller with state in struct
mutable struct Controller_state
    u
    Controller_state() = new()
end
cs = Controller_state()
cs.u = 0.01

h = 1.0
function control_affect!(integrator)
    #nothing
    integrator.u[1] = 0.01
end

control_cb = PeriodicCallback(control_affect!,h)

# Initial state
x0 = [0.5]
dx0 = 0*x0

# Simulation time
tf=10.0
tspan = (0.0,tf)

# Formulate, simulate, plot
differential_vars = [true]
prob = DAEProblem(dyns!,dx0,x0,tspan,differential_vars=differential_vars)

#cbs=CallbackSet(control_cb) # this works
#cbs=CallbackSet(xmin_cb, xmax_cb) # this works
#cbs=CallbackSet(xmin_cb,control_cb) # this works
cbs=CallbackSet(xmin_cb,xmax_cb,control_cb) # this breaks - even if I set control_affect!(integrator) = nothing

sol = solve(prob,IDA(),callback=cbs)
plot(sol,vars=(1))


added code to HTML file

This PR request adds all of the HTML we need for the prework study guide application.


Native AOT Drag&Drop problem

Describe the bug
When Native AOT is used droping file from system is not working (mose cursor turns to no entry). ([STAThread] used)
To Reproduce
Steps to reproduce the behavior:

Publish with dotnet publish -c Release -r win-x64 --self-contained
Start program
Drag file from windows explorer
Try to drop on aplication windows

Expected behavior
Window should accept drop
Desktop (please complete the following information):

OS: Windows 11
Version 0.10.15

Additional context

In normal (no AOT mode) works fine..
I tried different scenarios - changing trim mode, include.xml files - no workaround founded
attached project file

MainWindow.axaml
<Window xmlns="https://github.com/avaloniaui"
        xmlns:x="http://schemas.microsoft.com/winfx/2006/xaml"
        xmlns:d="http://schemas.microsoft.com/expression/blend/2008"
        xmlns:mc="http://schemas.openxmlformats.org/markup-compatibility/2006"
        mc:Ignorable="d" d:DesignWidth="800" d:DesignHeight="450"
        x:Class="DragDropTest.MainWindow"
        Title="DragDropTest"
		DragDrop.AllowDrop="True"
		>
	<TextBox Name="tb"></TextBox>
</Window>

MainWindow.axaml.cs
using Avalonia.Controls;
using Avalonia.Input;
using System;

namespace DragDropTest
{
    public partial class MainWindow : Window
    {
        public MainWindow()
        {
            InitializeComponent();
            SetupDnd( DragDropEffects.Copy | DragDropEffects.Move | DragDropEffects.Link);
        }

        void SetupDnd(DragDropEffects effects)
        {
            void DragOver(object sender, DragEventArgs e)
            {
                if (e.Source is Control c && c.Name == "MoveTarget")
                {
                    e.DragEffects = e.DragEffects & (DragDropEffects.Move);
                }
                else
                {
                    e.DragEffects = e.DragEffects & (DragDropEffects.Copy);
                }

                // Only allow if the dragged data contains text or filenames.
                if (!e.Data.Contains(DataFormats.FileNames))
                    e.DragEffects = DragDropEffects.None;
            }

            void Drop(object sender, DragEventArgs e)
            {
                if (e.Source is Control c && c.Name == "MoveTarget")
                {
                    e.DragEffects = e.DragEffects & (DragDropEffects.Move);
                }
                else
                {
                    e.DragEffects = e.DragEffects & (DragDropEffects.Copy);
                }

                if (e.Data.Contains(DataFormats.FileNames))
                {
                    tb.Text = String.Join('\n', e.Data.GetFileNames());
                }
            }
            AddHandler(DragDrop.DropEvent, Drop);
            AddHandler(DragDrop.DragOverEvent, DragOver);
        }

    }
}

Program.cs
using Avalonia;
using Avalonia.Controls;
using Avalonia.Controls.ApplicationLifetimes;
using System;

namespace DragDropTest
{
    internal class Program
    {
        // Initialization code. Don't use any Avalonia, third-party APIs or any
        // SynchronizationContext-reliant code before AppMain is called: things aren't initialized
        // yet and stuff might break.
        [STAThread]
        public static void Main(string[] args) => BuildAvaloniaApp()
            .StartWithClassicDesktopLifetime(args);

        // Avalonia configuration, don't remove; also used by visual designer.
        public static AppBuilder BuildAvaloniaApp()
            => AppBuilder.Configure<App>()
                .UsePlatformDetect()
                .LogToTrace();
    }
}

csproj
<Project Sdk="Microsoft.NET.Sdk">
  <PropertyGroup>
    <OutputType>WinExe</OutputType>
    <TargetFramework>net7.0</TargetFramework>
    <Nullable>enable</Nullable>

        <BuiltInComInteropSupport>true</BuiltInComInteropSupport>
		<IlcGenerateStackTraceData>false</IlcGenerateStackTraceData>
		<IlcOptimizationPreference>Size</IlcOptimizationPreference>
		<IlcDisableReflection>false</IlcDisableReflection>
		<InvariantGlobalization>false</InvariantGlobalization>
		<IlcTrimMetadata>false</IlcTrimMetadata>
		<!--<PublishTrimmed>true</PublishTrimmed>
		<TrimMode>link</TrimMode>-->
  </PropertyGroup>

  <ItemGroup>
	  <!--Content Include="rd.xml" /-->
  	<PackageReference Include="Microsoft.DotNet.ILCompiler" Version="7.0.0-preview.4.22229.4" />
  </ItemGroup>

  <ItemGroup>
    <PackageReference Include="Avalonia" Version="0.10.15" />
    <PackageReference Include="Avalonia.Desktop" Version="0.10.15" />
    <!--Condition below is needed to remove Avalonia.Diagnostics package from build output in Release configuration.-->
    <PackageReference Condition="'$(Configuration)' == 'Debug'" Include="Avalonia.Diagnostics" Version="0.10.15" />
    <PackageReference Include="XamlNameReferenceGenerator" Version="1.3.4" />
  </ItemGroup>
</Project>

Full project included
DragDropTest.zip

MicroCOM based drag'n'drop is targeting Avalonia 0.11, so you have to wait 0.11 or use nightly version of Avalonia to get drag/n/drop nativeaot support.

thank you for answer. I can wait for 0.11 but from curiosity how to use nightly?
tried this
https://github.com/AvaloniaUI/Avalonia/wiki/Using-nightly-build-feed
but after update to 0.10.999 project can't compile at all..

but after update to 0.10.999 project can't compile at all..

It has breaking changes. Fix the errors that compiler shows you.
Note that some third-party packages won't be compatible until we release preview1 and these packages could be updated.

Closing as it was fixed in the master https://github.com/AvaloniaUI/Avalonia/pull/7506

Dose AOT works in latest release (0.10.15)?

unfortunately not.

ok, fine


Incorporating offsets of real world coordinate systems in A*

Hello,
I wish to know how the states provided to A* are correctly positioned on the occupancy grid created in the lines below. I am repeatedly encountering the assertion assert not occupied[start], although the start state is in the free region. I believe there is some offset that is not accounted for when converting real-world coordinates to grid-index coordinates.
https://github.com/mikh3x4/nerf-navigation/blob/4c54520243cb794e18107c0e8914c14defe467ec/nav/quad_plot.py#L95-L126

Nevermind! I realized that 1 is the offset and 2 is the dynamic range.
https://github.com/mikh3x4/nerf-navigation/blob/4c54520243cb794e18107c0e8914c14defe467ec/nav/quad_plot.py#L120-L121

Hello,  I have the same problem as you. Can you tell me how to solve it?


[fix] macOS build (deprecation)

https://github.com/actions/virtual-environments/issues/5583

I'm submitting a

[x] bug fix
[ ] feature
[ ] documentation addition

What is the current behaviour?
macOS build fails due to deprecation

As I am not using macOS I was wondering if you guys also want to have macOS 12 aarch64-apple-darwin (Silicon) as well in the main.yaml build matrix.

Yeah, lets add 12!

x86 and Silicon, so that we have macOS 11 (Silicon + x86) and macOS 12 (Silicon + x86)

Sounds good


custom function cannot use in retturn()

If I register a custom function like this:
cep.registerExtension("str:groupConcat", GroupConcatFunctionExtension.class);
Below code will return an exception like 'groupConcat() is neither a function or aggregate':
DataStream outstream2 = cep.from("inputstream2").cql("from inputstream2#window.timeBatch(1 sec) " + 					"select str:groupConcat(dip) as related_alerts " + 					"group by sip " + 					"insert into outstream2") 					.returns("outstream2");
But if I change returns() to returnAsMap(), then it will works very well:
DataStream outstream2 = cep.from("inputstream2").cql("from inputstream2#window.timeBatch(1 sec) " + 					"select str:groupConcat(dip) as related_alerts " + 					"group by sip " + 					"insert into outstream2") 					.returnAsMap("outstream2");

The reason of custom function cannot use in returns():
1.returns() has one line:
TypeInformation typeInformation =
SiddhiTypeFactory.getTupleTypeInformation(siddhiContext.getAllEnrichedExecutionPlan(), outStreamId);
2.SiddhiTypeFactory.getTupleTypeInformation() calls the getStreamDefinition() of SiddiTypeFactory

public static AbstractDefinition getStreamDefinition(String executionPlan, String streamId) {         SiddhiManager siddhiManager = null;         SiddhiAppRuntime runtime = null;         try {             siddhiManager = new SiddhiManager();             siddhiManager.setExtension("str:groupConcat", GroupConcatFunctionExtension.class);             runtime = siddhiManager.createSiddhiAppRuntime(executionPlan);             Map<String, StreamDefinition> definitionMap = runtime.getStreamDefinitionMap();             if (definitionMap.containsKey(streamId)) {                 return definitionMap.get(streamId);             } else {                 throw new IllegalArgumentException("Unknown stream id" + streamId);             }         } finally {             if (runtime != null) {                 runtime.shutdown();             }             if (siddhiManager != null) {                 siddhiManager.shutdown();             }         }     }
initialize the siddhiManager, but do not set the custom function which registered in SiddhiCEP into the  siddhiManager.


Enhancement: Replace Prop-based "info links" with slottable links

By creating this pull request you agree to the terms in CONTRIBUTING.md.
https://github.com/Infineon/.github/blob/master/CONTRIBUTING.md
--- DO NOT DELETE ANYTHING ABOVE THIS LINE ---
CONTRIBUTING.md also tells you what to expect in the PR process.
Description
Removed the glossary-, imprint-, terms-, and privacyPolicy-props and instead replaced them with a "buttons" slot.
Related Issue
#1438

📦 Published PR as canary version: 26.0.0--canary.1450.3cdfc161e40916a1877462271071be82b6384ba5.0

:sparkles: Test out this PR locally via:
npm install<EMAIL_ADDRESS># or
yarn add<EMAIL_ADDRESS>

@pfafffabian-ifx

Resolve deployment check fails
remove variant="small" from Storybook snippet.


Add street search APIs

See epic issue: https://github.com/hasadna/anyway-tasks/issues/3

BE part is done.


Source maps are not created for dll bundle

As issue title states problem is that source maps are created for main bundle and not for dll bundle:

Webpack's config:
module.exports = (env = {}) => {
    return {
        entry: './src/index.js',
        output: {
            filename: './bundle.js',
            path: path.resolve(__dirname, 'bundle'),
        },
        resolve: {
            extensions: ['.js']
        },
        plugins: [
            new HtmlWebpackPlugin({
                template: './src/index.html',
                inject: true,
                filename: "index.html",
            }),
            ...(env.dll ? [new AutoDllPlugin({
                inject: true,
                filename: '[name]_[hash].js',
                debug: false,
                entry: {
                    vendor_dll: ['jquery']
                },
            })] : []),
        ],
        devtool: "source-maps",
        devServer: {
            contentBase: path.join(__dirname, "bundle")
        }
    };
};

Reproduction - https://github.com/WiseBird/auto_dll_source_maps

npm i
Build with Dll Plugin - npm run build:dll
Build without - npm run build

You can also run app with dll npm run start:dll and see in browser that code indeed lacks source maps:

@WiseBird Thank you for the very through issue. By default, when the plugin creates the child-webpack config which compiles the DLL(as needed), it does not inherit from the parent config. Which is why the devtool: 'source-maps' is not propagated. This can be fixed by passing inherit: true in the AutoDllPlugin config:
diff --git a/webpack.config.js b/webpack.config.js
index 3b11684..80250c8 100644
--- a/webpack.config.js
+++ b/webpack.config.js
@@ -19,6 +19,7 @@ module.exports = (env = {}) => {
                 filename: "index.html",
             }),
             ...(env.dll ? [new AutoDllPlugin({
+                inherit: true,
                 inject: true,
                 filename: '[name]_[hash].js',
                 debug: false,

I tested this on the repo you had provided and I could see the source maps file vendor_dll_cec34d33b53ddd985834.js.map being created.
I just realised that this option wasn't documented in the readme. I have created an issue(#90) for it and will document it at the earliest.

Thank you!


Left-align file list

When using a "proper" nested filesystem layout, the right-aligned file column lowers readability of the paths.
Before:

After:

Fixed in #345


Feature Request: Smart Sharpe Ratio Backtest Statistic

Expected Behavior
Include Smart Sharpe Ratio in backtest statistics. Relevant thread.
Actual Behavior
Not yet included.
Checklist

[x ] I have completely filled out this template
[x ] I have confirmed that this issue exists on the current master branch
[x ] I have confirmed that this is not a duplicate issue by searching issues

[x ] I have provided detailed steps to reproduce the issue

Relevant Paper

With limited bandwidth focusing on industry standards for now.


v2.51 Release Attempt #3

The build creates a v2.51 on my machine though it creates a v2.50 build on GitHub actions.


Causes HDMI input/No signal flickering

With latest releases, we now support webOS 3.4 and above. Capturing using vt is depreciated by now.


Add Jupyter notebook showing MIRI Image Registration and Combination

Somehow I closed PR #10 by @jbhagan while making some changes/fixes.  This PR contains the same commits as #10.

Thanks, @jbhagan!  I needed to modify your notebook to:

programmatically download the data
set CRDS environment variables for outside of STScI network
include pipeline config files
include requirements.txt file

(this PR contains fixes to @jbhagan's PR in #10, which I reviewed and approved)


Update Project.toml

Bump patch number to 0.3.2
This will incorporate two bug fixes

Codecov Report

Merging #73 (337c97f) into main (a118833) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main      #73   +/-   ##
=======================================
  Coverage   52.41%   52.41%
=======================================
  Files          54       54
  Lines        5992     5992
=======================================
  Hits         3141     3141
  Misses       2851     2851

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a118833...337c97f. Read the comment docs.


⚠ GitLab Server has degraded performance

In 7727827, GitLab Server (https://gitlab01.its-telekom.eu) experienced degraded performance:

HTTP code: 200
Response time: 6611 ms

Resolved: GitLab Server performance has improved in 4851e8d.


Any plans to make it work with Jira Cloud?

Assuming this runs with Jira Server/Data Center only. Do you have any plans to make it work with Jira Cloud? I think it would be beneficial for a lot of ppl using Jira/XRay/Cucumber.
Thomas

It would be nice if it was supporting with API token authentication!


Make start in “insecure” mode section better

In the last round of research, one participant asked, "Is starting it 'insecure' best practice?" Currently, toggling between "insecure" and "secure" modes doesn't reveal much difference. Would be great to explain why I should consider using "secure" mode, or what advantages do I have if I choose to use "insecure."
On the most surface level, perhaps the word "insecure" itself brings out more anxiety than necessary?
cc @jseldess @sploiselle

We have a warning in some places (eg: https://www.cockroachlabs.com/docs/orchestrate-cockroachdb-with-kubernetes.html) but that's pretty deep inside the docs.
We should have something similar on https://www.cockroachlabs.com/docs/start-a-local-cluster.html
As for anxiety, insecure is about as tame as we can make it, I would prefer something even more worrisome (--insecure-no-really-this-is-stupidly-insecure)

In all of our prod deployment tutorials, we map out the dangers of insecure more extensively, for example, https://www.cockroachlabs.com/docs/manual-deployment-insecure.html#recommendations. I don't think we need to go so far for a local testing cluster, but I agree we should be more explicit. @sploiselle, you actually had thoughts about this that I didn't manage to integrate in my last PR. Want to take a shot at this?

We can definitely improve the documentation's treatment of secure/insecure. Glad to put this on the list.
FWIW, though, @kuanluo––developers/operators should have an "intrinsic" understanding of the benefit of a secure deployment of a distributed system. If they don't, it's strange for us to provide that kind of semi-educational material.

We may need to add a specific page detailing exactly what is insecure vs secure, they vary by system with ours being a the very extremes of secure and insecure.
A few important things that should be made very clear:

inter-node encryption vs plain
client-node encryption vs plain
certificate/password authentication vs no authentication
(eventually) admin UI authentication vs no authentication

The insecure mode is so incredibly insecure that I really think we want call it out as soon as possible which would probably be the local cluster case.

@mberhault, @bdarnell created a docs issue to create a more robust summary about security: https://github.com/cockroachdb/docs/issues/1460

I totally defer to you guys on the anxiety level of insecure. Perhaps surfacing the security info as shown in Kubernetes sooner in Start a Cluster, as @mberhault suggested, would be sufficient as the first step.

We've made secure the default in almost all places, and added some stronger language about the dangers of insecure. Closing this, in favor of further improvements noted here: https://github.com/cockroachdb/docs/issues/3549


Ring Door Bell Camera - Not display entity_picture or video_url

Make sure you are running the latest version of Home Assistant before reporting an issue.
You should only file an issue if you found a bug. Feature and enhancement requests should go in the Feature Requests section of our community forum:
Home Assistant release (hass --version):
0.57.2
Python release (python3 --version):
3.6.3
Component/platform:
Ring Binary Camera
@tchellomello
Description of problem:
Ring Camera won't display entity_picture or play video_url when clicked. After a restart it worked for about an hour. Could the camera not be refreshing the URL before the X-Amz-Expires expires? When trying to browse the video_url in chrome I get:
<Error>
AccessDenied
<Message>Request has expired</Message>
<X-Amz-Expires>3600</X-Amz-Expires>
<Expires>2017-11-06T13:42:58Z</Expires>
<ServerTime>2017-11-06T15:46:02Z</ServerTime>
<RequestId>...REDACTED...</RequestId>
<HostId>
...REDACTED...
</HostId>
</Error>

Expected:
To display image snapshot and video.
Problem-relevant configuration.yaml entries and steps to reproduce:
ffmpeg:

camera:
  - platform: ring
    ffmpeg_arguments: -pred 1 -q:v 2

Traceback (if applicable):

Additional info:

I am also seeing this. Occasionally, I see Image not available on the Ring Camera.

@ntalekt  thanks for reporting this. I'm going to take a look.
@ntalekt are you a premium customer subscriber from Ring Door Bell?

@tchellomello Yes, i'm a premium subscriber.

I may be in the same boat, I'll have to double check.  I'm also Premium.  After a bit, I get "Image not available", but if I restart HASS it works as expected.

Confirmed, 1 hour on the dot and you get the below from the URL, as well as "Image not available"

AccessDenied
Request has expired

@ntalekt  could you provide the HASS logs on the issue?

@thegame3202  @ntalekt  did you guys check if the local time of your server is correct?

@tchellomello server time is correct. I'll enable debug logs and see if there is anything.

@tchellomello Same here, time is correct.  It seems like the debug logs think that the video is playing.    Not sure what I can post since they have credentials in them:-\  Here is the start of what I believe to be the relevant line:
2017-11-06 20:08:26 DEBUG (MainThread) [haffmpeg.core] Start FFmpeg with ['ffmpeg', '-i', 'https://ring-transcoded-videos.s3.amazonaws.com/6485
Are you not seeing this on your end?  Part of that url is "expires=3600" which is 1 hour in seconds.  I'm thinking it expires and doesn't generate a new link?
If you want to tell me what to remove, credentials wise, I'm happy to post logs.  Thanks!

I ran in debug for a couple hours. I see ffmpeg snatching a single frame every 3-5 seconds but I don't see the mp4, X-Amz-Credential or the X-Amz-Signature input parameter change.
2017-11-06 16:43:40 INFO (MainThread) [homeassistant.loader] Loaded camera.ring from homeassistant.components.camera.ring
2017-11-06 16:43:48 INFO (MainThread) [homeassistant.components.camera] Setting up camera.ring
2017-11-06 16:44:55 DEBUG (MainThread) [haffmpeg.core] Start FFmpeg with ['ffmpeg', '-i', 'https://ring-transcoded-videos.s3.amazonaws.com/4235.mp4?X-Amz-Expires=3600&X-Amz-Date=20171106T234349Z&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=7DSA/20171106/us-east-1/s3/aws4_request&X-Amz-SignedHeaders=host&X-Amz-Signature=3a12', '-an', '-frames:v', '1', '-c:v', 'mjpeg', '-pred', '1', '-q:v', '2', '-f', 'image2pipe', '-']
...
same haffmpeg.core grabbing one frame every 3-5 seconds
...
2017-11-06 17:44:57 DEBUG (MainThread) [haffmpeg.core] Start FFmpeg with ['ffmpeg', '-i', 'https://ring-transcoded-videos.s3.amazonaws.com/4235.mp4?X-Amz-Expires=3600&X-Amz-Date=20171106T234349Z&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=7DSA/20171106/us-east-1/s3/aws4_request&X-Amz-SignedHeaders=host&X-Amz-Signature=3a12', '-an', '-frames:v', '1', '-c:v', 'mjpeg', '-pred', '1', '-q:v', '2', '-f', 'image2pipe', '-']
...
same haffmpeg.core grabbing one frame every 3-5 seconds
...
2017-11-06 18:44:55 DEBUG (MainThread) [haffmpeg.core] Start FFmpeg with ['ffmpeg', '-i', 'https://ring-transcoded-videos.s3.amazonaws.com/4235.mp4?X-Amz-Expires=3600&X-Amz-Date=20171106T234349Z&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=7DSA/20171106/us-east-1/s3/aws4_request&X-Amz-SignedHeaders=host&X-Amz-Signature=3a12', '-an', '-frames:v', '1', '-c:v', 'mjpeg', '-pred', '1', '-q:v', '2', '-f', 'image2pipe', '-']

Hello guys,
I was able to reproduce the issue.
<Error>
AccessDenied
<Message>Request has expired</Message>
<X-Amz-Expires>3600</X-Amz-Expires>
<Expires>2017-11-06T23:49:25Z</Expires>
<ServerTime>2017-11-07T02:54:05Z</ServerTime>
<RequestId>064B<REDACTED></RequestId>
<HostId>
7sI7b<REDACTED>
</HostId>
</Error>

I'm investigating it now

Guys, any of you see the entry "Updated Ring DoorBell" on your logs?
@ntalekt @thegame3202 @arsaboo

@tchellomello of course I didn't save the log... Running in debug again. I'll update shortly.

Great news!! Troubleshooting the issue with @ntalekt we were able to find the problem.
Actually, there were 3 problems. My apologies for it.

The math used to expire the URL was not working as expected and it was also causing problems if the server's time was incorrect. We simplified the formula which should work fine now.

Even if a new video was detected, only the video_id was being replayed and not the URL. So the video URL would continue the same. So only restarting the HASS it would refresh.

Since the URL expiration math was incorrect, the video would be with a status as  Image not available for a couple of hours. Only the image would be refreshed.

We will be running the test code overnight, however if you want test it you can download it at https://gist.github.com/tchellomello/1197dc38c09c60d6b3922937de4c210f
Just create a directory custom_components/camera and then place the ring.py from the contents from the link above.
Nov 06 23:50:01 myserver.home hass[31057]: 2017-11-06 23:50:01 DEBUG (SyncWorker_8) [custom_components.camera.ring] Checking if Ring DoorBell needs to refresh video_url

<< went outside to force a new video to be captured... >>

Nov 06 23:51:31  myserver.home  hass[31057]: 2017-11-06 23:51:31 DEBUG (SyncWorker_3) [custom_components.camera.ring] Checking if Ring DoorBell needs to refresh video_url
Nov 06 23:51:32 myserver.home hass[31057]: 2017-11-06 23:51:32 INFO (SyncWorker_3) [custom_components.camera.ring] Ring DoorBell properties refreshed

Please let me know if the results..
Thank you!! mmello

@tchellomello It ran clean all night. Thanks for the quick turnaround!

2017-11-06 22:34:57 INFO (SyncWorker_0) [custom_components.camera.ring] Ring DoorBell properties refreshed
2017-11-06 23:20:02 INFO (SyncWorker_4) [custom_components.camera.ring] Ring DoorBell properties refreshed
2017-11-07 00:05:04 INFO (SyncWorker_9) [custom_components.camera.ring] Ring DoorBell properties refreshed
2017-11-07 00:50:08 INFO (SyncWorker_13) [custom_components.camera.ring] Ring DoorBell properties refreshed
2017-11-07 01:35:13 INFO (SyncWorker_3) [custom_components.camera.ring] Ring DoorBell properties refreshed
2017-11-07 02:20:16 INFO (SyncWorker_9) [custom_components.camera.ring] Ring DoorBell properties refreshed
2017-11-07 03:05:23 INFO (SyncWorker_10) [custom_components.camera.ring] Ring DoorBell properties refreshed
2017-11-07 03:50:26 INFO (SyncWorker_0) [custom_components.camera.ring] Ring DoorBell properties refreshed
2017-11-07 04:35:34 INFO (SyncWorker_14) [custom_components.camera.ring] Ring DoorBell properties refreshed
2017-11-07 05:20:40 INFO (SyncWorker_10) [custom_components.camera.ring] Ring DoorBell properties refreshed


Add support for unicode (with python 2)?

This is fairly important and quite an annoyance. I promise our HoloViews users that it will be fixed in the next release. See the last entry of the HoloViews FAQ: ioam/holoviews@d2dec608e
I'm sure we will have enough improvements by then to justify an updated release of param. :-)

I normally do something like:
from __future__ import unicode_literals
import numpy as np
import holoviews as hv

But then params does not work anymore.
Related: https://github.com/ioam/holoviews/issues/29

I agree this is an important issue. Will we have a new param bug-fix release before param 2.0 where we can have this fixed?

Let's discuss param releasing around 14 April; I'm waiting to hear some things about param from Chris.

Closing. Works in Python 3 and Python 2 is no longer a priority.


How to get channel ids

In some occasions I want to send a message in a different room from the one that robot was called. What is the proper way to translate the channel/room name into a channel id ?
I know one option would be to make an API request and retrieve the full list of channels, but is there another way?
And then, to DM users, how can I get the corresponding channel id to DM them ?
So far I've just created a lita say channel command that gets the channel id from "response.message.source.room", and then store it in a table for later use. Is there a more direct way?
Thanks

There isn't a better way to do it right now, but the next version of Lita will treat channels as first-class citizens like users, and will include a "rooms find" command that works like the "users find" command. The latter command can be used today to find the Slack Direct Message ID for that user.

Right, I've just found the "User.find_XXXX" methods some minutes ago.
I'll wait for the next version of Lita, then!
Thank you !

Did the rooms find functionality ever get added? It does not seem to exist in the current stable release?

No, it doesn't look like "rooms find" has been implemented yet.


class PickleShareDB still inherits from collections instead of collections.abc

deprecation warning on python 3.7:
...
from pickleshare import PickleShareDB
../../../../virtualenv/python3.7.0/lib/python3.7/site-packages/pickleshare.py:66: in <module>
    class PickleShareDB(collections.MutableMapping):
../../../../virtualenv/python3.7.0/lib/python3.7/collections/__init__.py:52: in __getattr__
    DeprecationWarning, stacklevel=2)
E   DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated, and in 3.8 it will stop working

Several dependencies including IPython 6.5.0 fail on travis CI tests now.

Thanks, want to make a PR?

Hi Thomas, yes, give me a few hours once I get home tonight.
Johannes
On Mon, 24 Sep 2018 at 17:56, Thomas Kluyver<EMAIL_ADDRESS>wrote:

Thanks, want to make a PR?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/pickleshare/pickleshare/issues/27#issuecomment-424047563,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AC8oHlU7oilk1S5GP_7o6K0CKLgu4f3eks5ueQ7KgaJpZM4W3Bxa
.

Great, thanks. :-)

(To be fair, it only fails for trio because -Werror is used.)

I'm glad someone was using that option - catching it now means we can put out a fix calmly instead of scrambling to fix a real bug when 3.8 is out.

Closed by #28.


Revert "Update lm_eval version (#1473)" except README.md

This reverts commit 50eb073adec7f91978a16c10550f8b523543467d of (https://github.com/huggingface/optimum-habana/pull/1473), except README.md changes.

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

This PR was based on the release branch but we need to merge it into main first, closing this one and going to merge #1582.


Use vim.diagnostic.handlers rather than lsp publishDiagnostics handler

https://neovim.io/doc/user/diagnostic.html#diagnostic-handlers
this handles all kinds of diagnostics and not just lsps. it also means you don't have to override vim.diagnostic.config and in fact can just use it for configuration
the idea comes from lsp_lines.nvim

@IndianBoy42
Thanks for the feedback!
Yeah like i said, i am not really familiar with lua, so appreciate your thoughts.
https://github.com/chikko80/error-lens.nvim/blob/ad14fda7b4efeeeee719524ace440419f1eff342/lua/error-lens/init.lua
I think i used to have this, but i changed it since its required a client in the setup function and i didn't want this, and had no clue how to do is besides this way

What's in that link is not what I'm talking about, maybe check out the lsp_lines.nvim setup function and the help docs I linked. It doesn't require a client. All LSPs and other diagnostics go through the vim.diagnostic API and you can register handlers there
Also, I wonder if you could/should leave rendering the virtual text to neovim core and just add the background highlighting to the line or even subpart of the line that the diagnostic is associated with

The commit triggered some other issues, therefore i changed the code back to the old solution, but i'll take a look at lsp_lines in the future


invalid character '<' looking for beginning of value

time="2019-03-17T19:05:50+09:00" level=info msg="monitor is up" monitor=ChinoBot time="17/03/2019 19:05:50 KST"
time="2019-03-17T19:05:50+09:00" level=info msg="monitor down 100.00%/80.00%" monitor=StayCute time="17/03/2019 19:05:50 KST"
time="2019-03-17T19:05:51+09:00" level=warning msg="Could not log metric! ID: 7, err: invalid character '<' looking for beginning of value"
time="2019-03-17T19:05:51+09:00" level=warning msg="Could not log metric! ID: 5, err: invalid character '<' looking for beginning of value"

under attack activited
https://status.xxx.xyz/api/v1/ping
{"data":"Pong!"}

Okay
Under Attack mode not supported


Add meta ref_name to Feature serializers

Fixes swagger not loading because of Serializer name conflict

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

4 of 4 (100.0%)  changed or added relevant lines in 2 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.001%) to 99.778%

Totals

Change from base Build<PHONE_NUMBER>:
0.001%

Covered Lines:
898

Relevant Lines:
900

💛  - Coveralls


[FEAT] Update browse experts page and api for availability

The browse experts page needs to be updated to filter by availability.

A note from @qjhart, "I think you'll be able to use the search as a guide for the browse, though you'll have to change from a json file to a JS module..." instead of mustache.


Add support for requesting raw response body

If the request query string contains flag raw_response=true, the server will return the request body as the response body as is, without wrapping it in the meta-object containing other request info.

Hey thanks for this.  I did a test and I think I understand what this is doing - just sending the body back.  In that case the parameter name should be more like, response_body_only=true, since that describes what it's doing a bit better.
Also question, what's the purpose of the Buffer.send(), couldn't it just be a res.send(req.body)?

Changed the query param name to response_body_only. Using Buffer was indeed redundant so I removed it.

OK thanks for that, tag :24 is now on Docker Hub.
https://hub.docker.com/repository/docker/mendhak/http-https-echo/tags?page=1&ordering=last_updated


How do we translate the UI language into other languages?

The interface language is only in English, it should be translated into other languages.

Thanks for the suggestion! This looks like a duplicate of https://github.com/atom/atom/issues/3103 though - closing this out in favor of that issue.


Restore i18next-parser functionality

The commit hook and npm run i18n:frontend script recently stopped updating strings.

/hold

/cc @fxiang1 @dtthuynh @zlayne

@fxiang1 and @dtthuynh can you please confirm that the nodepool -> node pool changes in this PR are OK? It looked like some spots were missed.


Docker Not able to start

Hi All,
We are using docker with Centos Linux kernel 3.18.16 and its working properly. Due to hardware incompatibility issue we have downgraded the kernel version to 3.10.79 after that docker not able to start and it says below error.
"Shutting down daemon due to errors: error initializing graphdriver: Error running DeviceCreate (CreatePool) dm_task_run failed"
I have tried by removing /var/lib/docker but still not working.
This is our configuration
docker --version
Docker version 1.6.2, build ba1f6c3/1.6.2
cat /etc/sysconfig/docker
OPTIONS='--selinux-enabled --insecure-registry ztest.xyz.com:5000 -H tcp://<IP_ADDRESS>:4243 --api-enable-cors=true -H unix:///var/run/docker.sock'
DOCKER_CERT_PATH=/etc/docker
cat /etc/sysconfig/docker-storage
DOCKER_STORAGE_OPTIONS="--storage-opt dm.loopmetadatasize=16G --storage-opt dm.loopdatasize=800G --storage-opt dm.basesize=50G --storage-opt dm.no_warn_on_loop_devices=true"
Kindly check and give us the solution asap.

Hi!
Please read this important information about creating issues.
If you are reporting a new issue, make sure that we do not have any duplicates already open. You can ensure this by searching the issue list for this repository. If there is a duplicate, please close your issue and add a comment to the existing issue instead.
If you suspect your issue is a bug, please edit your issue description to include the BUG REPORT INFORMATION shown below. If you fail to provide this information within 7 days, we cannot debug your issue and will close it. We will, however, reopen it if you later provide the information.
This is an automated, informational response.
Thank you.
For more information about reporting issues, see https://github.com/docker/docker/blob/master/CONTRIBUTING.md#reporting-other-issues

BUG REPORT INFORMATION
Use the commands below to provide key information from your environment:
docker version:
docker info:
uname -a:
Provide additional environment details (AWS, VirtualBox, physical, etc.):
List the steps to reproduce the issue:
1.
2.
3.
Describe the results you received:
Describe the results you expected:
Provide additional info you think is important:
----------END REPORT ---------
#ENEEDMOREINFO

Hi All,
Please find the details.
docker version
Client version: 1.6.2
Client API version: 1.18
Go version (client): go1.4.2
Git commit (client): ba1f6c3/1.6.2
OS/Arch (client): linux/amd64
Server version: 1.6.2
Server API version: 1.18
Go version (server): go1.4.2
Git commit (server): ba1f6c3/1.6.2
OS/Arch (server): linux/amd64
Not running state docker info
FATA[0000] Get http:///var/run/docker.sock/v1.18/info: dial unix /var/run/docker.sock: no such file or directory. Are you trying to connect to a TLS-enabled daemon without TLS?
Previous running state docker info
Containers: 0
Images: 0
Storage Driver: devicemapper
Pool Name: docker-8:5-72220844-pool
Pool Blocksize: 65.54 kB
Backing Filesystem: extfs
Data file: /dev/loop0
Metadata file: /dev/loop1
Data Space Used: 979.9 MB
Data Space Total: 536.9 GB
Data Space Available: 535.9 GB
Metadata Space Used: 3.637 MB
Metadata Space Total: 17.05 GB
Metadata Space Available: 17.04 GB
Udev Sync Supported: true
Data loop file: /var/lib/docker/devicemapper/devicemapper/data
Metadata loop file: /var/lib/docker/devicemapper/devicemapper/metadata
Library Version: 1.02.93-RHEL7 (2015-01-28)
Execution Driver: native-0.2
Kernel Version: 3.10.0-229.14.1.el7.x86_64
Operating System: CentOS Linux 7 (Core)
CPUs: 48
Total Memory: 62.71 GiB
Name: integ-hm9
ID: WCZ3:4IXO:MQAN:XNFN:RE37:MC3Y:L6VA:4A3T:HR5L:BBSF:DKEE:2HKF
uname -a
Linux integ-hm9 3.10.91 #2 SMP Tue Oct 27 17:23:35 IST 2015 x86_64 x86_64 x86_64 GNU/Linux
List the steps to reproduce the issue

Install kernel 3.18.16  and install docker and run.
Now downgrade the kernel to 3.10.91 and now docker not able to start.

docker -D -d
DEBU[0000] waiting for daemon to initialize
DEBU[0000] libdevmapper(6): ioctl/libdm-iface.c:1795 (4) dm version   OF   [16384] (1)
DEBU[0000] libdevmapper(6): ioctl/libdm-iface.c:1795 (4) dm version   OF   [16384] (1)
DEBU[0000] devicemapper: udev sync support: true
DEBU[0000] Generated prefix: docker-8:5-72220844
DEBU[0000] Checking for existence of the pool 'docker-8:5-72220844-pool'
DEBU[0000] libdevmapper(6): ioctl/libdm-iface.c:1795 (4) dm info docker-8:5-72220844-pool  OF   [16384] (1)
DEBU[0000] Pool doesn't exist. Creating it.

DEBU[0000] Registering DELETE, /images/{name:.}
DEBU[0000] Registering OPTIONS,
DEBU[0000] Warning: could not chgrp /var/run/docker.sock to docker: Group docker not found
FATA[0000] Shutting down daemon due to errors: error intializing graphdriver: Error running DeviceCreate (CreatePool) dm_task_run failed

given that kernel 3.18.16 is not a supported CentOS kernel, how did you install it? Did you use a public yum repo?
There's a good chance you ended up upgrading the devicemapper libs as well (since they're tightly integrated with the kernel), and they're no longer compatible with your older kernel.

We have downloaded the kernel from https://www.kernel.org/ and complied manually. If the devicemapper libs are not supported with old kernel, then we have other server centos7 default kernel 3.10.0-229.14.1.el7.x86_64 and which is working fine.

As we required some file system functionality and need to compile kernel manually to get that filesystem modules. Even though we have upgrade kernel from centos 7 default kernel 3.10.0-229.14.1.el7.x86_64 to 3.10.1 and 3.10.79 but Its throwing same error.
"Shutting down daemon due to errors: error initializing graphdriver: Error running DeviceCreate (CreatePool) dm_task_run failed"

@gjprabu : Can you provide result of df -h ?
We had similar issue where / was out of space and was unable to start the daemon and was getting same error.

Hi aku,
Please find the details.

df -h
Filesystem      Size  Used Avail Use% Mounted on
/dev/sda2       289G   30G  244G  11% /
devtmpfs         32G     0   32G   0% /dev
tmpfs            32G   12K   32G   1% /dev/shm
tmpfs            32G  9.1M   32G   1% /run
tmpfs            32G     0   32G   0% /sys/fs/cgroup
/dev/sda1       9.5G  396M  8.6G   5% /boot
/dev/sdb1       917G  217G  654G  25% /home
/dev/sda5       1.5T  643G  726G  47% /var
/dev/sdb2       1.5T  460G  978G  32% /data
/dev/rbd1       9.6T  1.5T  8.1T  16% /data/build/downloads

We found the issue, when we change the option in /etc/sysconfig/docker-storage to default value its working fine. When we set below storage option in kernel 3.10.91 docker not able to start. Please share the solution with below options.
DOCKER_STORAGE_OPTIONS="--storage-opt dm.loopmetadatasize=16G --storage-opt dm.loopdatasize=500G --storage-opt dm.basesize=50G --storage-opt dm.no_warn_on_loop_devices=true"

Now problem with only dm.loopmetadatasize=16G, it is not allowing me in storage option. If we remove that setting docker able to start and its working. Our setup will required more image and metadata size. Please advice me to change the size of metadata.

@gjprabu I believe you need to remove the existing device in order to change the size.

IIRC this blog post described the process, but I'm not too familiar with this; https://jpetazzo.github.io/2014/01/29/docker-device-mapper-resize/

Looks resolved.


More validations around SSH keys

The SSH key(s) for a user is one of the input fields in the provider Machine configs, to allow connecting to a node via SSH. This field is made mutable during upgrades to allow rotation of keys for security purposes. However, there is no guard around setting the field to empty ("") or if there is a typo in the public key field, which would lead to the user losing access to the nodes because the private key they use for SSH will not match the current public key on the node. Although an upgrade with the proper key would fix this, this puts too much belief on the upgrade not failing.
We should make this more robust by adding more validations around SSH keys during upgrade, such as:

Checking for empty string input
Warning user when changing SSH keys to a new value
Possible ssh-keygen checks to validate the public key matches private key (although this would mean the CLI reads the private key)

Do we have a way for no ssh access? Seems like empty string is a good way to disable ssh.


ERROR:  function cstore_clean_table_resources(oid) does not exist

Running:
PostgreSQL 9.6.0
cstore_fdw v1.5
Centos 6

It is possible to break DROP TABLE in schemas other than the one in which cstore_fdw was loaded:
psql (9.6.0)
Type "help" for help.

nci=# show role;
   role
----------
 postgres
(1 row)

nci=# show search_path;
   search_path
-----------------
 "$user", public
(1 row)

nci=# create extension cstore_fdw;
CREATE EXTENSION
nci=# create schema abc;
CREATE SCHEMA
nci=# set search_path to abc;
SET
nci=# create table t1 (c1 int);
CREATE TABLE
nci=# drop table t1;
ERROR:  function cstore_clean_table_resources(oid) does not exist
LINE 1: SELECT cstore_clean_table_resources(v_obj.objid)
               ^
HINT:  No function matches the given name and argument types. You might need to add explicit type casts.
QUERY:  SELECT cstore_clean_table_resources(v_obj.objid)
CONTEXT:  PL/pgSQL function cstore_drop_trigger() line 10 at PERFORM

The work around is to set search_path:
nci=# set search_path to abc, public;
SET
nci=# drop table t1;
DROP TABLE
nci=#

Is this the intended behavior?

No it's not an intended behavior. Needs to be fixed.
Thanks for reporting.

We experienced the same error. Could you give me some more information about this error? Thanks

How often does the error occur?
Is there any workaround of the error?
When will the error be fixed?

Looks like changing trigger function  cstore_drop_trigger to add public to function call to cstore_clean_table_resources  like public.cstore_clean_table_resources(v_obj.objid); fixes the issue.
This is going to be addressed in next cstore release.  Unfortunately I can't provide an accurate timing at this time.
Meanwhile as a workaround please run following to fix the function.
CREATE OR REPLACE FUNCTION cstore_drop_trigger()
	RETURNS event_trigger
	LANGUAGE plpgsql
	AS $csdt$
DECLARE v_obj record;
BEGIN
	FOR v_obj IN SELECT * FROM pg_event_trigger_dropped_objects() LOOP

		IF v_obj.object_type NOT IN ('table', 'foreign table') THEN
			CONTINUE;
		END IF;

		PERFORM public.cstore_clean_table_resources(v_obj.objid);

	END LOOP;
END;
$csdt$;

@mtuncer Thanks! I'll try the workaround.

Thanks @mtuncer the workaround works for us.

When this is merged? I hit the issue again ;-(

Hi @nurse
I just merged it to develop branch. Main branch will be updated with the next cstore_fdw release.

@mtuncer sure, thanks!


implement pygit2 backend for fetch_refspec

implement pygit2 backend for fetch_refspec
fix #168
Compare to the cprofile in https://github.com/iterative/dvc/issues/8477.
The new greatly reduced the time cost in fetching.

Making the total dvc exp show query finished in 1s. And brings a much smoother performance in vs-code extension.  And also solves the hanging problem in https://github.com/iterative/dvc/issues/8762
https://user-images.githubusercontent.com/6745454/212892100-ae2d032d-e23b-4b62-9207-28752a3de4c8.mp4
But we still had one problem remaining to solve, how to make scmrepo use the pygit2 as the default backend. In the test and the demo, I simply raise NotImplementError in Dulwich to disable it.

But we still had one problem remaining to solve, how to make scmrepo use the pygit2 as the default backend. In the test and the demo, I simply raise NotImplementError in Dulwich to disable it.

Setting the default backend is controlled here:
https://github.com/iterative/scmrepo/blob/339fdba37383888cd4e5d20dc729efdb509cd919/src/scmrepo/git/__init__.py#L39-L41
But what we probably need is a way to just force preferring a specific backend in our _backend_func wrapper
https://github.com/iterative/scmrepo/blob/339fdba37383888cd4e5d20dc729efdb509cd919/src/scmrepo/git/__init__.py#L282
so we could do something like
scm.fetch_refspec(..., prefer_backend="pygit2")

which would force rotating the backends list until pygit2 is at the top before continuing to try fetch_refspec calls

so we could do something like
scm.fetch_refspec(..., prefer_backend="pygit2")

Instead of a wrapper, we could also use it directly as following in dvc:
scm.pygit2.fetch_refspecs(...)

scm.fetch_refspec(..., prefer_backend="pygit2")

I had considered before, but the problem is that the backends will be determined the first time we call it. So if we want to make sure a function using a special backend, we need to add this prefer to all place we call it. So maybe it's better to add the argument in https://github.com/iterative/scmrepo/blob/339fdba37383888cd4e5d20dc729efdb509cd919/src/scmrepo/git/init.py#L282

Isn't using it directly also an issue with backend switching? We did have issues in the past related to that (https://github.com/iterative/dvc/issues/5641, https://github.com/iterative/dvc/issues/7458)

Using the backends directly can cause issues due to caching of the git index, but fetch does not touch the git index at all so it shouldn't be a problem here

Does this work on Windows? AFAIK there is no ssh support in pygit2 for Windows?

Codecov Report
Base: 81.65% // Head: 80.52% // Decreases project coverage by -1.13% :warning:

Coverage data is based on head (ec6f5ec) compared to base (339fdba).
Patch coverage: 66.66% of modified lines in pull request are covered.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #169      +/-   ##
==========================================
- Coverage   81.65%   80.52%   -1.13%
==========================================
  Files          25       25
  Lines        3412     3476      +64
  Branches      588      603      +15
==========================================
+ Hits         2786     2799      +13
- Misses        544      578      +34
- Partials       82       99      +17

Impacted Files
Coverage Δ

src/scmrepo/git/backend/pygit2.py
73.17% <64.51%> (-3.37%)
:arrow_down:

tests/test_git.py
100.00% <100.00%> (ø)

src/scmrepo/utils.py
67.74% <0.00%> (-19.36%)
:arrow_down:

tests/conftest.py
86.00% <0.00%> (-9.00%)
:arrow_down:

src/scmrepo/git/backend/gitpython.py
63.44% <0.00%> (-1.08%)
:arrow_down:

src/scmrepo/git/backend/dulwich/__init__.py
78.68% <0.00%> (-0.46%)
:arrow_down:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

libgit2 supports ssh but only when it is compiled with libssh2. The libgit2 build bundled with the pygit2 wheels does not include libssh2, so ssh:// is not supported in pygit2 https://github.com/libgit2/pygit2/issues/994
We should be checking to see if we are passed an ssh URL and then raise NotImpelementedError in pygit2 fetch_refspecs for ssh.

@karajan1001 is this waiting on anything else or can it be merged?

@karajan1001 is this waiting on anything else or can it be merged?

I'll do some finally check today together with DVC.


Anybody working in Chef real-time?

Is anybody working in Chef real-time?
what is the actual process/steps  followed ?
Is this the way that most developers do, I mean is it industry standard?
1.we would install Kitchen on laptops
2. create cookbooks
3.test them (on the different specific OS etc) using vagrant etc.
4. and then push to the cookbooks to the server.
All who are working on chef ,, can you please share your thoughts

Yes. There might be slight changes in the process as per project/architectural needs


Reveal "case" builtin

Similar to my last PR #9 this also reveals the case builtin so it can be targeted for highlighting as a keyword. @UserNobody14 let me know if this is okay, I followed the exact same pattern as I did for const and final.

@TimWhiting @UserNobody14 any chance either of you could take a look at this?

Thanks @TimWhiting 👍🏿

No problem, sorry it took so long


v.appendTo is not a function

I configured NToastNotify as mentioned in documentation, but I am getting error in browser's console as

Uncaught (in promise) TypeError: v.appendTo is not a function
at d (toastr.js:474)
at n (toastr.js:474)
at g (toastr.js:474)
at Object.i [as success] (toastr.js:474)
at t.showMessage (toastr.js?v=201806070714:1)
at toastr.js?v=201806070714:1
at Array.forEach ()
at t.e.showMessages (toastr.js?v=201806070714:1)
at t. (toastr.js?v=201806070714:1)
at toastr.js?v=201806070714:1
d @ toastr.js:474
n @ toastr.js:474
g @ toastr.js:474
i @ toastr.js:474
t.showMessage @ toastr.js?v=201806070714:1
(anonymous) @ toastr.js?v=201806070714:1
e.showMessages @ toastr.js?v=201806070714:1
(anonymous) @ toastr.js?v=201806070714:1
(anonymous) @ toastr.js?v=201806070714:1
(anonymous) @ toastr.js?v=201806070714:1
i @ toastr.js?v=201806070714:1
Promise.then (async)
u @ toastr.js?v=201806070714:1
(anonymous) @ toastr.js?v=201806070714:1
o @ toastr.js?v=201806070714:1
e.domContentLoadedHandler @ toastr.js?v=201806070714:1

Let me know if I am doing something wrong or you need more information.

any update on this ?