Errors not reported (using Gulp)

It's possible I'm being thick but if I change a file to introduce an error then watchify not only stops working (as reported in another issue) but also fails to say that it has errored.
Following the recipe here https://github.com/gulpjs/gulp/blob/master/docs/recipes/fast-browserify-builds-with-watchify.md

+1

The recipe's been updated so this can be closed


Static pages

Despite a blog system for publishing news I would also like to have some static pages for semi-permanent information and project related stuff :)

Using Jekyll for static site generation


ops-927 Added new data, corresponding to release on 10/10/2022

Test data
Description
Testing experiment design in which a cell suspension is used as input to another cell suspension (both in the "Cell suspension" tab).
E.g.
Mouse cells -> cell suspension 1
Human cells -> cell suspension 2
Mouse cells (cell suspension 1) + Human cells (cell suspension 2) -> cell suspension 3

The content of the spreadsheet is ok, but shouldn't the name of the spreadsheet stay the same?
Also this branch is behind master, is this a problem? I think this is the reason why some of the changes highlighted by the diff are part of the test data from the treatment protocol

Thanks for the review @idazucchi . I have re-uploaded the Schema_Test_Data.xlsx file with the appropriate same name. I also merged master into this branch, so it should now be updated to align with master.

Please remember to upload the new files to the hca-util area with uuid 428794cc-cec2-4a98-8649-76accda2304f/

Yes will do this now :)

Have requested review from dcp2

Before I can approve this, my team need to write a unit test against it in Azul. We'll discuss internally and get back to you with the timeline for that effort.

Before I can approve this, my team need to write a unit test against it in Azul. We'll discuss internally and get back to you with the timeline for that effort.

Hi @hannes-ucsc , would it be possible to get an update on this?

@theathorn can answer the scheduling questions.
In the meantime, I would like to understand more about the graphs added in this PR. @ami-day, you mention three cell suspensions (CS). Could you post the UUIDs of those three CS?

Mouse cells (cell suspension 1) + Human cells (cell suspension 2) -> cell suspension 3

If I understand that correctly, CS 3 is a mix of CS 1 and 2. Is that correct?
If so, can you point me at the graph edge or edges (post the UUIDs of the corresponding process entities) where that mixing occurs? I expect either one process with two CS as input and one CS as output, or two processes, one with CS1 as the input and one with CS2 the input, both with CS3 as output.

@theathorn can answer the scheduling questions.
In the meantime, I would like to understand more about the graphs added in this PR. @ami-day, you mention three cell suspensions (CS). Could you post the UUIDs of those three CS?

Mouse cells (cell suspension 1) + Human cells (cell suspension 2) -> cell suspension 3

If I understand that correctly, CS 3 is a mix of CS 1 and 2. Is that correct?
If so, can you point me at the graph edge or edges (post the UUIDs of the corresponding process entities) where that mixing occurs? I expect either one process with CS 1 and 2 as inputs and CS3 as the output, or two processes, one with CS1 as the input and one with CS2 the input, both with CS3 as output.

Hi @hannes-ucsc, the cell suspension ids I gave you were a hypothetical example. The actual cell suspension ids and process ids and graph are as following:
Cell suspension uuids
AP1CS: e91df207-3754-423a-b7c3-4a52b6467b15
AP2CS: 45cce5ca-cd3d-4d54-bb19-e1e87add9ea0
AP3CS: a824c723-6307-4b4a-a0c7-d7bbb32f7756
Process uuids

AP1_specimen -> AP1CS: f7beae3a-d981-4014-b28c-f676a0836572
AP2_specimen -> AP2CS: 479e9452-ff89-4472-b7c3-17f09569ce6d
AP2CS -> AP3CS: fbf4dbe0-aec1-4d8a-96f4-9aaf7bb633a0

Process 3 listed above is the test case where a cell suspension is used as input to a cell suspension (AP2CS -> AP3CS)
Does this help?

Ami and Hannes, let's continue to resolve Hannes` questions on this ticket.
There are 2 datasets waiting to be submitted to the DCP that would require this support, but timeline is TBD.

Now I am confused. The description states

Mouse cells (cell suspension 1) + Human cells (cell suspension 2) -> cell suspension 3

and I asked in return

If I understand that correctly, CS 3 is a mix of CS 1 and 2. Is that correct?

As far as I can tell there was no explicit response to that question.
However, in your latest post you write

Process uuids
AP1_specimen -> AP1CS: f7beae3a-d981-4014-b28c-f676a0836572
AP2_specimen -> AP2CS: 479e9452-ff89-4472-b7c3-17f09569ce6d
AP2CS -> AP3CS: fbf4dbe0-aec1-4d8a-96f4-9aaf7bb633a0

From which follows that AP3CS is derived only from AP2CS. Could you please help me resolve the apparent contradiction? What would really help is a diagram of the involved subgraphs. But since we're not even sure that we can support this in the near future (@theathorn decides schedule questions) I am hesitant to explicitly ask for that.

Hi @hannes-ucsc Sorry for the confusion, the original description was a hypothetical scenario, this should be ignored and only the updated description with the cell suspension uuids and process uuids should be considered. Thank you.

Sorry for the confusion, the original description was a hypothetical scenario, this should be ignored and only the updated description with the cell suspension uuids and process uuids should be considered. Thank you.

OK! I will henceforth ignore the contradictory original description, as well as anything the author describes as being "hypothetical".
In order to better understand this graph, and decide how to index it, I would need a diagram. Either my team could reverse engineer the metadata and create a diagram or the author could supply a diagram.

Sorry for the confusion, the original description was a hypothetical scenario, this should be ignored and only the updated description with the cell suspension uuids and process uuids should be considered. Thank you.

OK! I will henceforth ignore the contradictory original description, as well as anything the author describes as being "hypothetical".
In order to better understand this graph, and decide how to index it, I would need a diagram. Either my team could reverse engineer the metadata and create a diagram or the author could supply a diagram.

Hi @hannes-ucsc I am sharing some slides with the graph images captured from the test data project in hca ingest staging: https://docs.google.com/presentation/d/1k9kMKvwL4PnjgcePauuBZE4o1M8BdhhQCT341MY99KU/edit#slide=id.p . I have shared it with your email address, please let me know if you have any problems accessing it.
I am also sharing the test data spreadsheet fyi: https://docs.google.com/spreadsheets/d/1ZPg59eDya6wUde7GX3GtfccNVKQFEcqsxumXfRUcX2k/edit#gid=310770490
If this is still unclear, I am happy to schedule a video call to jump on and screenshare.

Thank you for the graphs. Unfortunately, the fact that they are artificially broken up into fragments by process, fragments that the viewer would have to mentally stitch together makes it really difficult to follow along. The individual process fragments are evident from the links file.

Hi Hannes!
As Ami is leaving, I will pick it up from here!
So, if I understand this correctly, what you want is an accurate representation in the form of a diagram of the new data
I have prepared a very small png with that:

Basically, what this test data is creating is 2 new subgraphs. in reality, it's the same subgraph but it just changes the final output (analysis vs sequence files).
This subgraph represents a situation where a Cell suspension (APCS2) will be used to create another cell suspension (APCS3). In this specific case, they are linked together by a process that also has an enrichment protocol.
Let me know if this is what you want or if you want a little bit more detail into the subgraphs!

Thank you, @ESapenaVentura. I've added what I believe are the implied edges to the graph. Let us know if I got that wrong.

Basically, what this test data is creating is 2 new subgraphs. in reality, it's the same subgraph but it just changes the final output (analysis vs sequence files).

Is it fair to more accurately write that as

Basically, what this test data is creating is 2 new subgraphs. in reality, it's two subgraphs of the same shape but it just changes the final output (analysis vs sequence files).

Any other interpretation would confuse me.

@danielsotirhos is working on a test case in the Azul code base.  He will reverse-engineer the graph structure and compare it with what's described here.

Thank you, @ESapenaVentura. I've added what I believe are the implied edges to the graph. Let us know if I got that wrong.

Basically, what this test data is creating is 2 new subgraphs. in reality, it's the same subgraph but it just changes the final output (analysis vs sequence files).

Is it fair to more accurately write that as

Basically, what this test data is creating is 2 new subgraphs. in reality, it's two subgraphs of the same shape but it just changes the final output (analysis vs sequence files).

Hi Hannes! Yes, that is exactly what this test data is representing
Many thanks for working in this

@hannes-ucsc
$ python scripts/view-bundle-outline.py -b 1ed68210-eaba-531d-ba9e-db80164d65ef
Project 90bf705c
Donor_organism 5bc2bf2f
+   Process 37e91a9f
+   +   Specimen_from_organism 3bee0c9a
+   +   +   Process c352fa85
+   +   +   +   Cell_suspension af3549f4
+   +   +   +   +   Process 9c7b713c
+   +   +   +   +   +   Cell_suspension 6ff38054
+   +   +   +   +   +   +   Process 1ed68210
+   +   +   +   +   +   +   +   Sequence_file de17aa7d
+   +   +   +   +   +   +   +   Sequence_file 8da4bdb9

$ python scripts/view-bundle-outline.py -b 7a330531-ec7f-5aee-84d4-2ba24d66e93b
Project 90bf705c
Donor_organism 5bc2bf2f
+   Process 37e91a9f
+   +   Specimen_from_organism 3bee0c9a
+   +   +   Process c352fa85
+   +   +   +   Cell_suspension af3549f4
+   +   +   +   +   Process 9c7b713c
+   +   +   +   +   +   Cell_suspension 6ff38054
+   +   +   +   +   +   +   Process 7a330531
+   +   +   +   +   +   +   +   Analysis_file caf6d2a8

@ESapenaVentura, @danielsotirhos did some helpful analysis of the subgraphs added/modified here. There are two cell suspensions at play here. One is derived from the other. So far so good. Both cell suspensions have an estimated cell count of 20k. I assume that in reality there are only 20k cells involved. Please correct me if I am wrong.

@hannes-ucsc both cell counts should be taken into account.
The biology behind this reasoning is that they took a cell suspension and divided it to generate another one, and later on they estimated the number of cells on each suspension
So, if the estimated_cell_count fields estimate 20k per cell suspension, the total would be 40k
Many thanks, and have a nice holiday!

they took a cell suspension and divided it to generate another one

This sentence confuses me. When I divide one thing I get at least two other things but in that sentence it appears that one thing is divided into one other thing. That seems counter-intuitive to me.
A cell suspension is an amount of fluid with cells suspended in it. One can transfer some of that fluid into another vessel (well or droplet) but then I would expect a proportional amount of the cells suspended in the original cell suspension to be transferred to the second cell suspension along with the transferred fluid. More importantly, I would also expect the overall amount of cells to remain constant, since cells are discrete entities and no cells are created and the loss of cells should be below a certain margin of error.
Then again, looking at the metadata graph it appears that an entire cell suspension is transformed wholly into another cell suspension and that only the result of the transformation is sequenced. But again, the overall number of discrete cells remains the same. No division takes place. No additional cells are created. So the number of sequenced cells is 20 thousand. I assumed that's really what we want the cell count display in the Data Browser to represent, the estimated number of sequenced or imaged cells.

Then again, looking at the metadata graph it appears that an entire cell suspension is transformed wholly into another cell suspension and that only the result of the transformation is sequenced. But again, the overall number of discrete cells remains the same. No division takes place. No additional cells are created. So the number of sequenced cells is 20 thousand. I assumed that's really what we want the cell count display in the Data Browser to represent: the estimated number of sequenced or imaged cells.

tl;dr: The number of cells in the estimated_cell_count field is accounted post-partition, not pre-partition
Slightly longer answer:
The graph I've shown in the previous comment is not the complete experimental graph - There are other subgraphs present in the experiment. In one of these subgraphs, that cell suspension is used as the input for an analysis file, AP2_file.h5ad. The cell suspension was used as an input to create the other cell suspension, and maybe it was enriched for something specific (In this specific scenario that Ami prepared, I see that it uses the same enrichment protocol, but it could have some other attached) and that differentiates it from the original cell suspension.
However, what was left of the original cell suspension is also used for sequencing; hence, if the cell suspension states that there are 20k cells in there, what that means is that after the partition, there are 20k cells (Or, otherwise put, before the partition, there were 40k cells total in the suspension), and that is the number of cells expected for sequencing.
I understand that this could be modelled as "cell suspension A going into cell suspension B and cell suspension C", but that would only further complicate the subgraph and would not add any additional useful information.
I hope I shed some light on the issue, let me know if you would like to discuss this further!

The terms "divide" and "partition" keep coming up but I don't see this represented in the two subgraphs in this PR.
This is what we currently have in this PR (omitting processes, the colored boxes are subgraphs):

If additional subgraphs were to reflect a "division" or "partition", they should be included here so that we have a representative example. This is what that should look like:

Note that the upstream cell suspension has a cell count of 40k. The two derived cells suspensions have 20k cells each.
The key take away is that if, during the experiment, some of the original cell suspension was "syphoned off" into a new vessel, the remainder of the original cell suspension must be represented in the graph as a new cell suspension in the experiment graph. If we don't do this, we will not be able to correctly count cells without resorting to hacks that will break in the future.

You're right in those diagrams, that is exactly what we were trying to go for.
We were trying to make at least one of the subgraphs easier by skipping one of the cell suspensions, but I understand this will make it harder to the data portal for the cell counts so I will remake the test data to reflect this subgraph
I will ping for re-revision once it's done!

@hannes-ucsc The subgraphs should be fixed now, there is now a cell suspension (CS2_pre, 40k cell count) that goes into CS2 and CS3
Let me know if there's anything else I can do!

Thank you, @ESapenaVentura. @danielsotirhos could you please run view-bundle-outline on the most recent version and post output here?

@hannes-ucsc
The two bundles previously outlined (1ed68210 & 7a330531) are listed first.
$ python scripts/view-bundle-outline.py -b 1ed68210-eaba-531d-ba9e-db80164d65ef
Project 90bf705c
Donor_organism 5bc2bf2f
+   Process 37e91a9f
+   +   Specimen_from_organism 3bee0c9a
+   +   +   Process bd6a4a38
+   +   +   +   Cell_suspension 119c4135
+   +   +   +   +   Process b0092a47
+   +   +   +   +   +   Cell_suspension 6ff38054
+   +   +   +   +   +   +   Process 1ed68210
+   +   +   +   +   +   +   +   Sequence_file de17aa7d
+   +   +   +   +   +   +   +   Sequence_file 8da4bdb9

$ python scripts/view-bundle-outline.py -b 7a330531-ec7f-5aee-84d4-2ba24d66e93b
Project 90bf705c
Donor_organism 5bc2bf2f
+   Process 37e91a9f
+   +   Specimen_from_organism 3bee0c9a
+   +   +   Process bd6a4a38
+   +   +   +   Cell_suspension 119c4135
+   +   +   +   +   Process b0092a47
+   +   +   +   +   +   Cell_suspension 6ff38054
+   +   +   +   +   +   +   Process 7a330531
+   +   +   +   +   +   +   +   Analysis_file caf6d2a8

$ python scripts/view-bundle-outline.py -b d7b8cbff-aee9-5a05-a4a1-d8f4e720aee7
Project 90bf705c
Donor_organism 5bc2bf2f
+   Process 37e91a9f
+   +   Specimen_from_organism 3bee0c9a
+   +   +   Process bd6a4a38
+   +   +   +   Cell_suspension 119c4135
+   +   +   +   +   Process b8ec88d7
+   +   +   +   +   +   Cell_suspension af3549f4
+   +   +   +   +   +   +   Process d7b8cbff
+   +   +   +   +   +   +   +   Analysis_file f0c8ac7c

$ python scripts/view-bundle-outline.py -b 4da04038-adab-59a9-b6c4-3a61242cc972
Project 90bf705c
Donor_organism 9173ee6a
+   Process 223d54fb
+   +   Specimen_from_organism 224d3750
+   +   +   Process 296b47c2
+   +   +   +   Cell_suspension d9eaaffe
+   +   +   +   +   Process 4da04038
+   +   +   +   +   +   Analysis_file cf5d9300

$ python scripts/view-bundle-outline.py -b 1f6afb64-fa14-5c6f-a474-a742540108a3
Project 90bf705c
Donor_organism 2d7b50d8
+   Process c6b932ff
+   +   Specimen_from_organism 9a0bb729
+   +   +   Process ae8529dc
+   +   +   +   Imaged_specimen 0bf91a05
+   +   +   +   +   Process 1f6afb64
+   +   +   +   +   +   Analysis_file 2645ed0a

$ python scripts/view-bundle-outline.py -b 3ac62c33-93e1-56b4-b857-59497f5d942d
Project 90bf705c
Donor_organism 2d7b50d8
+   Process c6b932ff
+   +   Specimen_from_organism 9a0bb729
+   +   +   Process ae8529dc
+   +   +   +   Imaged_specimen 0bf91a05
+   +   +   +   +   Process 3ac62c33
+   +   +   +   +   +   Image_file b29a331e

$ python scripts/view-bundle-outline.py -b 8c1773c3-1885-545f-9381-0dab1edf6074
Project 90bf705c
Donor_organism 2d7b50d8
+   Process c6b932ff
+   +   Specimen_from_organism 9a0bb729
+   +   +   Process ae8529dc
+   +   +   +   Imaged_specimen 0bf91a05
+   +   +   +   +   Process 8c1773c3
+   +   +   +   +   +   Sequence_file 31786d8d
+   +   +   +   +   +   Sequence_file 6a0e071d
+   +   +   +   +   +   Sequence_file f6abda5c

@ESapenaVentura is it intentional that there are now two h5ad files, one for each 20k cell suspension? If I understood your earlier comments correctly there is one cell suspension from which fastqz were made and another one from which an h5ad was made.

@ESapenaVentura is it intentional that there are now two h5ad files, one for each 20k cell suspension? If I understood your earlier comments correctly there is one cell suspension from which fastqz were made and another one from which an h5ad was made.

I did not add any new h5ad file, so if it wasn't showing up before it may have been a bug due to incorrectly splitting up the bundles. The structure showing up now is the intended one.
For what I can see in the spreadsheet, the only cell suspension that gets sequence files is AP3CS (The newly added one), getting both sequence files AND analysis files.
Before this test data, we didn't have any of the cell suspensions generating sequence files because it was an already tested subgraph (Normal donor --> specimen --> cell suspension --> sequence files) so we probably determined we didn't need to test for it.
Does it cause any issue?

Does it cause any issue?

The sequence files are fine, my question is pertaining analysis files. How many .h5ad files do you expect to be directly or indirectly derived from the primary cell suspension whose biomaterial_id is AP2CS_pre?

Does it cause any issue?

The sequence files are fine, my question is pertaining analysis files. How many .h5ad files do you expect to be directly or indirectly derived from the primary cell suspension whose biomaterial_id is AP2CS_pre?

There are no h5ad files directly derived from AP2CS_pre, as it is not sequenced
There is one h5ad file derived from AP2CS and another one derived from AP3CS (And another one derived from AP1CS, but that one is unaffected on this iteration of test data).
Would it be easier if we set-up a meeting to discuss this?

OK, so no .h5ad files are derived directly from AP2CS_pre and two are derived indirectly. Yes?

OK, so no .h5ad files are derived directly from AP2CS_pre and two are derived indirectly. Yes?

Exactly!

See https://github.com/DataBiosphere/azul/issues/4425, PR https://github.com/DataBiosphere/azul/pull/4836 which should land in production next week or the week after.

Thanks @hannes-ucsc ! We will hold the datasets that were pending on this for the next release then


Metric Depth Estimation model training

Hi, can I know the device configuration (GPU, video memory) required for Metric Depth Estimation model training? I want to fine-tune the training on a device with RTX2080 GPU, but it didn't work.

You may need at least 8 RTX2080 GPUs.


[BUG] web go get github.com/micro/go-micro # github.com/lucas-clemente/quic-go/internal/handshake ../../../../pkg/mod/github.com/lucas-clemente/quic-go@v0.14.1/internal/handshake/crypto_setup.go:433:40: not enough arguments in call to h.conn.GetSessionTicket         have ()         want ([]byte)

Describe the bug

What are you trying to do?
What did you expect to happen?
What happens instead?

How to reproduce the bug:
If possible, please include a minimal code snippet here.
Environment:
Go Version: please paste go version output here
please paste `go env` output here

Describe the bug

What are you trying to do?
What did you expect to happen?
What happens instead?

How to reproduce the bug:
If possible, please include a minimal code snippet here.
Environment:
Go Version: please paste go version output here
please paste `go env` output here

Im having same issue here:

go version 1.13.5
go env : GOARCH="amd64"
GOBIN=""
GOCACHE="/Users/nicolasfeoli/Library/Caches/go-build"
GOEXE=""
GOHOSTARCH="amd64"
GOHOSTOS="darwin"
GOOS="darwin"
GOPATH="/Users/nicolasfeoli/go"
GORACE=""
GOROOT="/usr/local/go"
GOTMPDIR=""
GOTOOLDIR="/usr/local/go/pkg/tool/darwin_amd64"
GCCGO="gccgo"
CC="clang"
CXX="clang++"
CGO_ENABLED="1"
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m64 -pthread -fno-caret-diagnostics -Qunused-arguments -fmessage-length=0 -fdebug-prefix-map=/var/folders/bb/1zb1ywv169n1fc1vszjzl4540000gn/T/go-build553186397=/tmp/go-build -gno-record-gcc-switches -fno-common"

export GO111MODULE=on
And only do go get without the -u

Did anyone find a solution?

clear require() in go.mod and do go get ./... again. Additionally you can clear go mod cache.


Use aws bom

This is a small PR that simplifies the pom.xml declarations by including the aws bom in the root dependencyDeclaration.
Curiously, this was almost used in pinot-plugins/pinot-file-system/pinot-s3/pom.xml, but then the version was also specified on each usage.
Netty was already used in this way, so all their exclusions could be removed.
Read https://reflectoring.io/maven-bom to get more context about how this works.

Codecov Report

Merging #11070 (9ab03c4) into master (e3cac64) will increase coverage by 0.00%.
The diff coverage is n/a.

@@            Coverage Diff            @@
##           master   #11070     +/-   ##
=========================================
  Coverage    0.11%    0.11%
=========================================
  Files        2200     2146     -54
  Lines      118818   116313   -2505
  Branches    17993    17691    -302
=========================================
  Hits          137      137
+ Misses     118661   116156   -2505
  Partials       20       20

Flag
Coverage Δ

integration1temurin11
?

integration1temurin17
?

integration1temurin20
?

integration2temurin11
?

integration2temurin17
?

integration2temurin20
?

unittests1temurin11
?

unittests1temurin17
?

unittests1temurin20
?

unittests2temurin11
?

unittests2temurin17
0.11% <ø> (ø)

unittests2temurin20
?

Flags with carried forward coverage won't be shown. Click here to find out more.
see 56 files with indirect coverage changes
:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

CC @klsince to take a look.


Code area in li tag will expand the width of device, so the mobile device to be unable to view normally

Describe the bug
Code area in li tag will expand the width of device, so the mobile device to be unable to view normally
Expected behavior
Wish the max width will be restricted
Screenshots

Platform:

OS: Android
Browser Edge
Version MIUI 12.5 Andoird 11 Edge <IP_ADDRESS>57

Additional context
Add any other context about the problem here.

This is a known issue, see NotionX/react-notion-x#67

This has been fixed.


fix: reduce logging in the critical path

I hereby agree to the terms of the Singularity Data, Inc. Contributor License Agreement.
What's changed and what's your intention?
The original:
./datagen --mode ad-click --qps 10000000 postgres --port 4566 --user root --db dev
2022/07/07 12:15:55 Sent 39389 records in total (Elasped: 10.00005275s)
2022/07/07 12:16:05 Sent 77396 records in total (Elasped: 20.000204125s)

About 7% performance improvement after disabling the logs. (Both were tested in the release mode, ./risedev playground, in-memory mode)
./datagen --mode ad-click --qps 10000000 postgres --port 4566 --user root --db dev
2022/07/07 12:21:15 Sent 42258 records in total (Elasped: 10.000062791s)
2022/07/07 12:21:25 Sent 84152 records in total (Elasped: 20.000125958s)

Checklist

[x] I have written necessary rustdoc comments
[x] I have added necessary unit tests and integration tests
[x] All checks passed in ./risedev check (or alias, ./risedev c)

Release note
Please create a release note for your changes. In the release note, focus on the impact on users, and mention the environment or conditions where the impact may occur.
Refer to a related PR or issue link (optional)

Added mergify/can-merge label


Minor typos and formatting.

@greiginsydney : Thanks for your contribution! The author(s) have been notified to review your proposed change.

Looks good; merging the PR. Thanks.


Some tutorial?

Can u write some tutorial how to connect Hapi with Nuxt using this?

@Pioruniasty Sure! I will create a starter template soon. BTW before that, all thing to do is just simply register this plugin & passing nuxt config object (you may require it from nuxt.config.jsas plugin options. Plugin automatically registers*` to be served with nuxt.

Ok, ok, thanks for quick response 👍 . I'll try then :).

Well .. what I am doing wrong?
Here's my code:
const Hapi = require('hapi');
const HapiNuxt = require('hapi-nuxt');

const server = new Hapi.Server();

server.connection({port: 4321});

server.register({
    register: HapiNuxt,
    options: {
        dev: (process.env.NODE_ENV !== 'production')
    }
}, () => {
    server.start();
});

and I get error "Cannot read property 'dev' of undefined" at
if (nuxt.options.dev) {

Opps seems migration typo. I'll fix it ASAP.

Docs updated. Please open a new issue if any problem exists with it.


Committee export

Current behaviour:
If a committee is exported then some field are missing, in the wrong format or otherwise not correct
Wrong format in the CSV export file:
if committees are exported then:

[x]  the managers are exported with their first and last name, but the import needs their username
[x]  the meeting_start/end_time is exported as YYYYMMDD, but the import needs the date to be YYYY-MM-DD
[ ]  the meeting admins are not exported

Need to fix the third point.


HostZeroCopy not working on OpenCL

Hi,
I have tried out ArgumentMemoryLocation::HostZeroCopy and came across some unexpected behaviour on OpenCL.
I have a small example showing the issue in https://github.com/jpazurikova/KTT/tree/sort-memory-mapping
There is just one kernel in the composition. Its arguments are initialized with random values, the first several values of the arrays are written on the output. The kernel itself just prints out several of the values from the beginning of the arrays (starts with "beginning"), adds 2 to each value and writes the values again (starts with "end").
CUDA version works as expected, it is clear that the values printed from the kernel are the same than the ones initialized in the host code. I am printing just the first value of uint2, that's why there is only every other value printed out by kernel. Example output:

0 128959393 128959393
1<PHONE_NUMBER><PHONE_NUMBER>
2 436085873 436085873
3 748533630 748533630
4 776550279 776550279
5 289134331 289134331
6 807385195 807385195
7 556889022 556889022
8 95168426 95168426
9<PHONE_NUMBER><PHONE_NUMBER>
[INFO] Initializing tuner for device GeForce GTX 680
[INFO] Computing reference class result for kernel sort
[INFO] Running kernel composition sort with configuration: global size (1, 1, 1), local size (1, 1, 1), parameters: SORT_BLOCK_SIZE: 32, SCAN_BLOCK_SIZE: 32, SORT_VECTOR: 2, SCAN_VECTOR: 2
[DEBUG] Uploading buffer for argument 0, event id: 0
[DEBUG] Performing buffer operation synchronization for event id: 0
[DEBUG] Uploading buffer for argument 1, event id: 1
[DEBUG] Uploading buffer for argument 2, event id: 2
[DEBUG] Uploading buffer for argument 3, event id: 3
[DEBUG] Launching kernel radixSortBlocks, event id: 4
[DEBUG] Performing kernel synchronization for event id: 4
beginning
0  128959393  128959393
1  436085873  436085873
2  776550279  776550279
3  807385195  807385195
4  95168426  95168426
5<PHONE_NUMBER><PHONE_NUMBER>
6  686611921  686611921
7  912905316  912905316
8<PHONE_NUMBER><PHONE_NUMBER>
9<PHONE_NUMBER><PHONE_NUMBER>
end
0  128959395  128959393
1  436085875  436085873
2  776550281  776550279
3  807385197  807385195
4  95168428  95168426
5<PHONE_NUMBER><PHONE_NUMBER>
6  686611923  686611921
7  912905318  912905316
8<PHONE_NUMBER><PHONE_NUMBER>
9<PHONE_NUMBER><PHONE_NUMBER>

However, OpenCL kernel prints out zeros, the initialized values do not "get" to the kernel. Example output:

0 128959393 128959393
1<PHONE_NUMBER><PHONE_NUMBER>
2 436085873 436085873
3 748533630 748533630
4 776550279 776550279
5 289134331 289134331
6 807385195 807385195
7 556889022 556889022
8 95168426 95168426
9<PHONE_NUMBER><PHONE_NUMBER>
[INFO] Initializing tuner for device Intel(R) Core(TM) i5-7200U CPU @ 2.50GHz
[INFO] Computing reference class result for kernel sort
[INFO] Running kernel composition sort with configuration: global size (1, 1, 1), local size (1, 1, 1), parameters: SORT_BLOCK_SIZE: 32, SCAN_BLOCK_SIZE: 32, SORT_VECTOR: 2, SCAN_VECTOR: 2
[DEBUG] Uploading buffer for argument 0, event id: 0
[DEBUG] Performing buffer operation synchronization for event id: 0
[DEBUG] Uploading buffer for argument 1, event id: 1
[DEBUG] Uploading buffer for argument 2, event id: 2
[DEBUG] Uploading buffer for argument 3, event id: 3
[DEBUG] Launching kernel radixSortBlocks, event id: 4
[DEBUG]beginning
0  0  0
1  0  0
2  0  0
3  0  0
4  0  0
5  0  0
6  0  0
7  0  0
8  0  0
9  0  0
end
0  2  2
1  2  2
2  2  2
3  2  2
4  2  2
5  2  2
6  2  2
7  2  2
8  2  2
9  2  2

This is obviously unexpected behaviour. If KTT does not support HostZeroCopy for OpenCL, it should say so and end the execution. Or fall back and use Device instead of HostZeroCopy.
I have debugged this a little and pinned it down to the following: the bufferEvent for the vectors created at opencl_engine.cpp:279 gets erased in opencl_engine.cpp:525 due to validFlag set to false. The flag set to true causes segfault, so it's probably false for a good reason. You clearly know better what to do, I just wanted to help with finding the origin of the error.
Hope this helps. If you have any questions, just ask.
Janka

Hi,
HostZeroCopy should work for both backends. The feature was added couple years back and wasn't used that much (none of the examples bundled with KTT use it AFAIK), so it's possible something broke. I'll have a look at it.

Should be fixed on the development branch.


-corner and -side

In the quest log the -corner and -side commands have each other's descriptions.
Love the map, huge fan. Can I upload it on The Hive Workshop? Could you make an account and do it yourself?

Haha, you're right; they're switched.
I'm going to leave it as is, because this repo is really more for historical "what did I make then" purposes rather than active development.
(Also the source files in the repo aren't part of the build process used to generate the map. I always edited things directly in the newgen editor, so the source files are actually just copy-pastes of each trigger's content.)
You can upload the map wherever you want, and modify it however you want.


[Python] pytest only executing a subset of tests.

VSCode Version: 1.25.1
OS Version: Latest Open-Suse

I am using VSCode with the Python plugin, enabled pytest support.
I have one test_XX.py file with five test_somethingXXX() methods which are recognized by pytest on the console as five test. The five tests also have in VSCode the "Run Test, Debug Test" annotation.
Clicking on "Run Test" executes only 2 tests out of five. I don't see the "pytest.." commandline.
Any pointer?

Pease file against Python extension.


refactor: add FeedbackDatasetBase and _ArgillaFeedbackDataset while keeping FeedbackDataset just for local

Description
This PR is still in progress, and the main idea is that we move the common functionality to be used on both local and remote (Argilla) datasets to FeedbackDatasetBase, while we keep FeedbackDataset for working locally with these datasets, and add _ArgillaFeedbackDataset to be instantiated internally via FeedbackDataset.from_argilla and as part of the return statement of FeedbackDataset.push_to_argilla, so as to split the behaviour on some operations such as add_records, since locally means adding those to a local list, while remotely that means pushing those to Argilla, to avoid having to call push_to_argilla right after every record addition.
Some more things are tackled as part of this refactoring and will be listed down below as soon as the PR is out of draft!
Closes #3456
Type of change

[X] Refactor (change restructuring the codebase without changing functionality)
[X] Improvement (change adding some improvement to an existing functionality)

How Has This Been Tested

[ ] Add unit tests for the different classes and methods, while ensuring backwards compatibility on everything related to the FeedbackDataset

Checklist

[ ] I added relevant documentation
[ ] follows the style guidelines of this project
[ ] I did a self-review of my code
[ ] I made corresponding changes to the documentation
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] I filled out the contributor form (see text above)
[ ] I have added relevant notes to the CHANGELOG.md file (See https://keepachangelog.com/)

The code below works fine, the only missing piece is fetch_records, that won't be compatible with the upcoming approach of _ArgillaFeedbackRecords to detach the record-related functionality to a separate class i.e. dataset.records.add would be used via the shortcut dataset.add_records
import argilla as rg

ds = rg.FeedbackDataset(...) # Initialises `FeedbackDataset` as always

records = [...]
ds.add_records(records) # Adds records locally

for record in ds.records: # Loops over the local records
    print(record)

print(ds.records[0]) # Prints the record with index 0 locally

rg.init(
    api_url="...",
    api_key="...",
)

ds.push_to_argilla("my-dataset", workspace="alvaro") # Pushes the `FeedbackDataset` to Argilla, and remaps the class instance to be now of type `_ArgillaFeedbackDataset`, also returns it, but to keep backwards compatibility we're also remapping it for the moment

ds = rg.FeedbackDataset.from_argilla("my-dataset", workspace="alvaro") # Retrieves the `FeedbackDataset` from Argilla and returns an `_ArgillaFeedbackDataset` instance

for record in ds: # Iters over the records of the `FeedbackDataset` in Argilla (yield not return)
    print(record.id)

print(ds[0]) # Prints the record with index 0 in the `FeedbackDataset` in Argilla
print(ds[1:4]) # Prints the records within the specified slice in the `FeedbackDataset` in Argilla
print(len(ds)) # Prints the total number of records in the `FeedbackDataset` in Argilla

ds.push_to_argilla("my-dataset", workspace="alvaro")


Presto Timestamp types are being identified as UNKNOWN datatype

A clear and concise description of what the bug is.
PrestoSQL Version - 341
SuperSet Version - 0.37.2
I have a table in Presto that has 1250 columns. 118 of these columns are timestamp type. When I add this table under Sources -> Tables -> Add a new record, all these timestamps are being identified as UNKNOWN. However, when I manually edit each timestamp column and change UNKNOWN -> TIMESTAMP, it all works fine as expected.
I tried the same in master build docker image. Data -> Datasets -> Add a new record referencing the table in DB. All timestamp fields are being identified as UNKNOWN type.
Adding the DB table in the below screen

what you expected to happen.
timestamp(3) which is the native timestamp of Presto should be identified as timestamp

what actually happens.
Screenshots

If applicable, add screenshots to help explain your problem.
Below screenshot is shown from the image built from master:

How to reproduce the bug

Have a Presto table defined with timestamp field in it.
Add a presto connection in the database section.
Go to Sources -> Tables -> Add a new record
Click on edit record -> COLUMNS -> check the timestamp type you stored in DB.

Environment
(please complete the following information):

superset version: 0.37.2
python version: 3.6
Using docker image for 0.37.2 from https://hub.docker.com/layers/amancevice/superset/0.37.2/images/sha256-0036adb5d313cd8dd1263a843e501380162c57bf70c616913d1613c390a00950?context=explore

Checklist
Make sure these boxes are checked before submitting your issue - thank you!

[y] I have checked the superset logs for python stacktraces and included it here as text if there are any.
[y] I have reproduced the issue with at least the latest released version of superset.
[y] I have checked the issue tracker for the same issue and I haven't found one similar.

Additional context
Add any other context about the problem here.

So, to whoever is running into this problem, the issue should have happened post-Presto 338 release where the timestamp is a parametric timestamp type (timestamp with different precision).
https://github.com/prestosql/presto/pull/4349
This is what I did to resolve the problem. Updated my database connection and specific extra field with the following:
{
"metadata_params": {},
"engine_params": {
"connect_args": {
"protocol": "https",
"session_props": {
"omit_datetime_type_precision": true
}
}
},
"metadata_cache_timeout": {},
"schemas_allowed_for_csv_upload": []
}
Make a note of the  "omit_datetime_type_precision": true property. Refer: https://prestosql.io/docs/current/release/release-338.html
This works fine now after I added the flag. I will leave it to Superset developers if they want to add a fix for it.

@DRavikanth have you been able to test this with master branch? On Superset 0.37.2, timestamps were matched literally as  timestamp:
https://github.com/apache/incubator-superset/blob/bbb8c87e627f49de42d4a4ebe55125bfe8fc9643/superset/models/sql_types/presto_sql_types.py#L112
However, on master branch, they are now matched with a regular expression that should match TIMESTAMP(3):
https://github.com/apache/incubator-superset/blob/53cd05d74af0c5b07307b1c17c86e7c14d868d39/superset/db_engine_specs/presto.py#L356

Closing for now, as this is assumed to be working on current master.

Will this be available in the next release? @villebro

Yes, we're currently preparing 0.38.0 which will include this improvement.

Sounds good.


Make examples fully qualified

Currently our example code (for example StreamPayments) shows code running inside our Go SDK package, but anyone else will be running code outside the package.  This means that they will need to properly qualify all the classes and methods, add the proper imports.  This makes it far harder to just copy/paste/run examples.  We should have the examples be fully qualified.
From @leighmcculloch :
we should put our examples in a separate files, something like examples_test.go, and at the top of the file, change package wonderfulthings to package wonderfulthings_test.

it will mean you’ll need to import github.com/stellar/wonderfulthings and throughout the code you’ll reference functions, types, etc as wonderfulthings.AmazingType.

It will definitely be helpful. thank you very much


[LINUX] no heic here

heic-to-jpg version:0.1.9
Python version: Python 3.10.12
Operating System:

Ubuntu 22.04.3 LTS
LXDE
Linux version 5.15.0-83-generic (buildd@lcy02-amd64-027) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023

free -h
               total       utilisé      libre     partagé tamp/cache   disponible
Mem:            15Gi       6,7Gi       1,4Gi       918Mi       7,0Gi       7,1Gi
Échange:      4,0Gi       496Mi       3,5Gi

Description
heic-to-jpg -s ./ && cd ../
convert-im6.q16: unable to open image `*.[hH][eE][iI][cC]*': Aucun fichier ou dossier de ce type @ error/blob.c/OpenBlob/2924.
convert-im6.q16: no decode delegate for this image format `' @ error/constitute.c/ReadImage/575.
convert-im6.q16: no images defined `%[filename:base].jpg' @ error/convert.c/ConvertImageCommand/3229.

if the folder has no heic, simply display "no heic here" in GREEN
and automatically make a CD ../

@Fr-Dae Please clarify, it is not quite clear what you're intending to communicate with this issue. Please try to use the English language, I don't speak French. Thanks!

I don't speak any more English than you do French, so in the end it comes down to the same thing, one of us has to go to a translation site like deepl,

I'm closing the issue because of your rude response. It is you who is approaching me about this particular piece of software, not the other way around. I'm therefore expecting your to communicate in a clear, understandable and respectful way.


Editor bug in WebKit

This issue was imported from Closure Library's previous home at http://closure-library.googlecode.com
The link to the original issue is:
https://code.google.com/p/closure-library/issues/detail?id=290

This issue is being closed as a preparation step before archiving the repository.  See the README for more detail.


Release Linux/ARM64 images

I am trying to use mailhog image on arm64 platform but arm64 tag is not available in dockerhub.
I have successfully built the docker image for Linux/ARM64 by using below buildx commands in the travis.yml file without any changes in Dockerfile:
{
docker buildx build -t odidev/sample:mailhogx64ARM --platform linux/amd64,linux/arm64 --push .
}
Commit: https://github.com/odidev/MailHog/commit/5584b40e55484fdec7f175afa4f8e13edc1437f9
Image: https://hub.docker.com/r/odidev/sample/tags?page=1&ordering=last_updated
May I know how you are releasing the images?
I will be happy to contribute and raise the PR.

I will look into adding this to builds via Github actions

Hi @tyndyll,
I have raised PR by adding builds via Github actions.
PR link: https://github.com/mailhog/MailHog/pull/378

I am not looking for a Docker image but just a plain ARM64 build if possible.

Inspired by #245, we have made this (which we use in daily basis). There are amd64 and arm64 variants.
https://hub.docker.com/repository/docker/druidfi/mailhog
Here is the Dockerfile: https://github.com/druidfi/docker-images/blob/main/misc/mailhog/Dockerfile

@Fossil01 ^^

I will look into adding this to builds via Github actions

I've done it yesterday to create a automatic mailhog docker image which supports arm64 and amd64.
https://github.com/teawithfruit/mailhog
Feel free to copy...

@tyndyll @gedge @pmhausen @lafentres @marcdeop ... ?

This would be really nice to have..

This would be really nice to have..

+1

+1

Mailpit has arm64 images, FYI

This is not maintained anymore https://github.com/mailhog/MailHog/issues/442#issuecomment-1493415258
We all should move to Mailpit (or any other alternative)


Fix issues with edge-app run

Change generage-mock-data
Right now we have this:
$ screenly edge-app run
Error: No mock-data exist. Please run "screenly edge-app generate-mock-data" and try again.

As discussed, let's move generate-mock-data to a sub-command for run like this screenly edge-app run --generate-mock-data
Resolve Hello World
If you do edge-app create and then try to run it with edge-app run, it's currently broken and yields the following output:
Greetings !

I'm . Assuming you've pinned me in the right location, I'm located in (more precisely at latitude ° and longitude °).

My Screenly ID is (which conveniently is also my hostname), and I'm running on a .

Let's make sure we actually get the Hello World to work.

Resolved in the current master


stem df

It looks like this was opened accidentally.

@yosifkit Indeed...! My appologies :disappointed:


Repository selection

Hi,
i'm using multiple restic repositories for different devices and users. Being able to use multiple repositories with different configs without having to reenter the non-secret informations would be helpful.
I would for example consider a drag down menu where currently the path is displayed, or a menu similar to the one from Lens (K8s management software).
Do you think that would help? Do you see security risks or UX issues?

Some form of "preset" or "session" manager where you can quickly add, remove, edit and recall previously used repositories would indeed be nice, and is actually the next thing on my TODOs for restic-browser.
But to do this, we would first need a way to store a persistent state of user preferences. Currently there is only an AppState, which is not persistent.
Then we could also store custom paths to the restic binary, or additional options that should be passed to restic.

Did you consider creating files with environment variables to start restic-browser?
I am using
cd /d %~dp0

PATH=%PATH%"C:\resticBackup"

call resticEnv.bat

Restic-Browser.exe

In resticEnv.bat there are then the settings like set RESTIC_REPOSITORY=
This might be a solution for you, so you don't have to enter the nonsecret Information each time.

Did you consider creating files with environment variables to start restic-browser?
I am using
cd /d %~dp0

PATH=%PATH%"C:\resticBackup"

call resticEnv.bat

Restic-Browser.exe

In resticEnv.bat there are then the settings like set RESTIC_REPOSITORY=
This might be a solution for you, so you don't have to enter the nonsecret Information each time.

My batch file
@echo off set RESTIC_REPOSITORY=restic-repositry set RESTIC_PASSWORD=Passwrod for repository start "" d:\Restic-Browser.exe

https://github.com/emuell/restic-browser/pull/83 now adds persistent preset management.
Using it should be self-explanatory. Just open the "Open Repository" dialog. If it's not self-explanatory, let me know, and we'll think about how to clarify the implementation.
@nettnikl @SakiSakiSakiSakiSaki @damoclark
Would be great to get some feedback on this before it gets merged. You can download the builds from the pull request checks here: https://github.com/emuell/restic-browser/actions/runs/6756302035?pr=83

I was just installing this for the first time and was thinking that this software is missing this feature so i found this issue.
Tested #83 on windows and it is working grate for me!

#83 now adds persistent preset management.
Using it should be self-explanatory. Just open the "Open Repository" dialog. If it's not self-explanatory, let me know, and we'll think about how to clarify the implementation.
@nettnikl @SakiSakiSakiSakiSaki @damoclark Would be great to get some feedback on this before it gets merged. You can download the builds from the pull request checks here: https://github.com/emuell/restic-browser/actions/runs/6756302035?pr=83

Hey @emuell  Only just saw this now.  I downloaded and ran the build, but it won't start up.  I'm on macos Ventura.  Running the binary directly gives stderr output on console.  The following was output:
 % /Applications/Restic-Browser\ 2.app/Contents/MacOS/Restic-Browser
09:15:07 [WARN] Failed to resolve restic binary
09:15:07 [WARN] Failed to read version info from restic binary: No such file or directory (os error 2)

It should find the restic binary because it is in my zsh shell path in the terminal session.

Can you show your path? On Windows this error occurs when path ends with ; which is the delimiter. Removing it and restic-browser finds the binary.

@damoclark  Weird.  Also, where is restic installed on your system. You should get a "Please select your restic binary" dialog after that. Is this missing in your case?

@damoclark Weird. Also, where is restic installed on your system. You should get a "Please select your restic binary" dialog after that. Is this missing in your case?

I am using macports, so the binary is in /opt/local/bin
I can confirm that a dialog does appear when I use v0.2.6.
I just tried specifying the path to the restic binary using the command line switch --restic.  This generated a different error:
 % /Applications/Restic-Browser\ 2.app/Contents/MacOS/Restic-Browser --restic /opt/local/bin/restic
04:15:46 [WARN] Failed to read version info from restic binary: Operation not permitted (os error 1)

If I run restic version, I get
% /opt/local/bin/restic version
restic 0.16.2 compiled with go1.21.3 on darwin/arm64

I think the issue is related to Apple's sandboxing and/or package signing.  Does the PR build use the same packaging process for Apple bundling as your releases do?  The operation not permitted error is one that occurs when SIP (System Integrity Protection) prevents an application from doing something, it isn't authorised to do.  That is why the initial error is different.  It was trying to check my path for the file, and it doesn't have permission to read the directory contents of /opt/local/bin.  In this case, I told it where restic is but doesn't have permission to execute it.

I am using macports, so the binary is in /opt/local/bin

This path should have been picked automatically, even if the PATH was not adjusted in recent builds. You can also run it directly from the Finder.

I think the issue is related to Apple's sandboxing and/or package signing. Does the PR build use the same packaging process for Apple bundling as your releases do?

Yes, it is signed and notarised. Apple's SIP sometimes decides more or less randomly to sandbox an application.
This often happens if you launch an application from the ~/Download folder before moving it to /Applications.
You can fix this in the terminal by removing the quarantine flag:
xattr /Applications/Restic-Browser\ 2.app likely returns:
com.apple.quarantine
sudo xattr -r -d com.apple.quarantine /Applications/Restic-Browser\ 2.app
will remove the quarantine flag and fix the problem.

You were right, it did have the quarantine flag.  But after removing it following your instructions, I am still getting the same errors.
Went back to the zip download and removed its quarantine attribute, then unzipped, untarred, checking there was no quarantine attribute, and moved it into /Applications before starting it.  Still the same errors.  I'm a bit baffled.
I'm on macOS 13.6.1

I have now been able to replicate this issue on another MacOS machine and have now explicitly disabled the sanfboxing application. Could you please check if this works for you now?
https://github.com/emuell/restic-browser/actions/runs/6816670593?pr=85

Yep, that sorted the issue.
Is great to see how far you have progressed with RB. :)
I've checked out the presets feature and it looks very nice.  A couple of observations, and suggestions you might like to consider.
Listing snapshot contents
My machine has an M1 Max processor with 64GB.
I've noticed when I click on a snapshot in my repository list, RB forks 5 restic processes, using the ls command all for the same snapshot id.
/opt/local/bin/restic ls {hash} --json /
/opt/local/bin/restic ls {hash} --json /
/opt/local/bin/restic ls {hash} --json /
/opt/local/bin/restic ls {hash} --json /
/opt/local/bin/restic ls {hash} --json /

I presume its 5 because an M1 Max has 10 cores.  I'm wondering if there is a bug here as each process will be returning essentially exactly the same data.  When I navigated to a separate snapshot, another 5 restic processes were started, while the initial 5 continued running.  My machine at this point was consuming 42GB of ram (this repo is big).  This is a bit tricky.  Because on the one hand, it may be useful, after having already started a restic ls to retrieve metadata, you allow it to finish so its kept in cache.  But on the other hand, it could cause memory issues if people are jumping around between snapshots and paths and you have multiple concurrent restic ls processes running.  Each of my restic processes for this repo was consuming around 3GB.
rclone path
I am using rclone for some remote repositories.  And this RB version doesn't seem to use the same logic that you have embedded for locating the path to the restic binary (very nice by the way).  Usually I'd have rclone installed through macports, but I installed it directly instead (can't recall why now - I think there was a new feature and macports didn't have the new version yet).  I have it in /usr/local/bin.  Be great for the same logic you implemented to locate restic to also locate rclone, including the option to specify the path manually.
Especially with the difficulty on the mac of configuring your environment such as PATH for a login session (the irony for a real BSD UNIX operating system).
caching
I recall us having a conversation some time ago about caching of file information for paths in snapshots already visited, so a call to restic isn't needed upon revisit.  I can see that you have implemented it.  Just wondering if this cache kept in memory?  While restic, as a core philosophy, treats the client machine upon which restic is running as 'trusted', they have kept the locally cached files encrypted.  If in future, you consider caching or even better, prefetching a catalog of files for snapshots in locally stored files, it would be a big bonus that these were encrypted too.  By caching snapshot metadata in say, an encrypted sqlite db (there are a few libraries around to do this), it would substantially speed up navigation of the snapshot filesystem structure, and also searching for files using metadata.  This is a big gap for restic generally. restic find is very slow.
resticprofile
This is a neat little project that provides a configuration file framework for restic.  Something you could consider, down the road, is to allow RB to pull its profiles directly from resticprofile config files.  They support a range of encoding formats, such as yaml, toml etc.  So you would have to consider that.  But all the information needed for RB profiles can already exist in config files (including passwords), that RB can call upon, rather than the user having to configure them in two places (at least for those who use resticprofile and RB).
Hope this feedback is helpful.
Thanks for your work on RB.  It really does fill a usability gap for restic, and does so quite elegantly.
Cheers,
D.

Thanks for the kind words and the suggestions!

Listing snapshot contents

This should not happen, sounds/looks more like a bug to me. I will check that soon.

rclone path

Agreed. We could indeed magically/automatically add the rclone path to restic if it is in the shared PATH on MacOS. This is probably the most convenient solution to this problem.

caching

I would like to avoid doing any extra sophisticated caching in Rustic Browser and still hope this can be solved by either fetching the entire list of files at once (which would also be required for find operations) or using Rustic as a backend. See also https://github.com/emuell/restic-browser/issues/84

resticprofile

Nice, I didn't know about this project until now. I'll see how easy it is to integrate.

This should not happen, sounds/looks more like a bug to me. I will check that soon.

This got now fixed in: https://github.com/emuell/restic-browser/pull/87


ng-content inside a Listview isn't being injected with content

I have a component named ItemsSelector which contains a ListView :
<ListView class="list-group" [items]="[1,22,34,6]" style="height:1250px">
    <ng-content></ng-content>
</ListView>

This is how I use the ItemsSelector component:
<StackLayout class="home-panel">
	<ItemsSelector>
		<ng-template let-item="$implicit" let-i="index">

		</ng-template>
	</ItemsSelector>
<StackLayout>

But it seems that  ng-content is not being injected with content , And it display items not like I wanted

BTW - According to  the docs , this is the way how to use Listview  :

So all I was doing is to send the view from outside , but without success...
Question:
Why isn't ng-content being injected with the content I provide ?
Playground

update : https://play.nativescript.org/?template=play-ng&id=s3Nqun


hotfix for resend 2fa codes

There was a mismatch between twoFactor.js and Account2FA from near-api-js.
Discovered via Sentry this morning.
Reduced code. e2e tested branch for resending 2fa code:

deploying 2fa account
sending 2fa tx

@mattlockyer do I understand correctly that this should fix https://github.com/near/near-wallet/issues/1248?

@mattlockyer do I understand correctly that this should fix #1248?

I was unaware of this issue but this will fix it!


Not Working [responsive_framework: ^0.1.4]

[√] Flutter (Channel stable, 2.2.3, on Microsoft Windows [Version 10.0.19043.1110], locale en-IN)
• Flutter version 2.2.3 at D:\FlutterSDK\flutter
• Framework revision f4abaa0735 (4 weeks ago), 2021-07-01 12:46:11 -0700
• Engine revision 241c87ad80
• Dart version 2.13.4
Just Create Default sample flutter project add responsive framework and run.
`import 'package:animations/animations.dart';
import 'package:flutter/material.dart';
import 'package:responsive_framework/responsive_framework.dart';
void main() {
runApp(MyApp());
}
class MyApp extends StatelessWidget {
// This widget is the root of your application.
@override
Widget build(BuildContext context) {
return MaterialApp(
title: 'Flutter Demo',
theme: ThemeData(
// This is the theme of your application.
//
// Try running your application with "flutter run". You'll see the
// application has a blue toolbar. Then, without quitting the app, try
// changing the primarySwatch below to Colors.green and then invoke
// "hot reload" (press "r" in the console where you ran "flutter run",
// or simply save your changes to "hot reload" in a Flutter IDE).
// Notice that the counter didn't reset back to zero; the application
// is not restarted.
primarySwatch: Colors.blue,
),
builder: (context, child) => ResponsiveWrapper(
child: child,
maxWidth: 1200,
minWidth: 450,
defaultScale: true,
breakpoints: [
ResponsiveBreakpoint.resize(450, name: MOBILE),
ResponsiveBreakpoint.autoScale(800, name: TABLET),
ResponsiveBreakpoint.autoScale(1000, name: TABLET),
ResponsiveBreakpoint.resize(1200, name: DESKTOP),
ResponsiveBreakpoint.autoScale(2460, name: "4K"),
],
background: Container(color: Color(0xFFF5F5F5)),
),
initialRoute: Routes.home,
onGenerateRoute: (RouteSettings settings) {
return PageRouteBuilder(
settings: settings,
pageBuilder: (context, animation, secondaryAnimation) => MyHomePage(title: 'Flutter Demo Home Page'),
);
},
);
}
}
class MyHomePage extends StatefulWidget {
MyHomePage({Key? key, required this.title}) : super(key: key);
// This widget is the home page of your application. It is stateful, meaning
// that it has a State object (defined below) that contains fields that affect
// how it looks.
// This class is the configuration for the state. It holds the values (in this
// case the title) provided by the parent (in this case the App widget) and
// used by the build method of the State. Fields in a Widget subclass are
// always marked "final".
final String title;
@override
_MyHomePageState createState() => _MyHomePageState();
}
class _MyHomePageState extends State {
int _counter = 0;
void _incrementCounter() {
setState(() {
// This call to setState tells the Flutter framework that something has
// changed in this State, which causes it to rerun the build method below
// so that the display can reflect the updated values. If we changed
// _counter without calling setState(), then the build method would not be
// called again, and so nothing would appear to happen.
_counter++;
});
}
@override
Widget build(BuildContext context) {
// This method is rerun every time setState is called, for instance as done
// by the _incrementCounter method above.
//
// The Flutter framework has been optimized to make rerunning build methods
// fast, so that you can just rebuild anything that needs updating rather
// than having to individually change instances of widgets.
return Scaffold(
appBar: AppBar(
// Here we take the value from the MyHomePage object that was created by
// the App.build method, and use it to set our appbar title.
title: Text(widget.title),
),
body: Center(
child: Column(
// Column is also a layout widget. It takes a list of children and
// arranges them vertically. By default, it sizes itself to fit its
// children horizontally, and tries to be as tall as its parent.
//
// Invoke "debug painting" (press "p" in the console, choose the
// "Toggle Debug Paint" action from the Flutter Inspector in Android
// Studio, or the "Toggle Debug Paint" command in Visual Studio Code)
// to see the wireframe for each widget.
//
// Column has various properties to control how it sizes itself and
// how it positions its children. Here we use mainAxisAlignment to
// center the children vertically; the main axis here is the vertical
// axis because Columns are vertical (the cross axis would be
// horizontal).
mainAxisAlignment: MainAxisAlignment.center,
children: [
Text(
'You have pushed the button this many times:',
style: TextStyle(fontSize: 16),
),
Text(
'$_counter',
style: Theme.of(context).textTheme.headline4,
),
],
),
),
floatingActionButton: FloatingActionButton(
onPressed: _incrementCounter,
tooltip: 'Increment',
child: Icon(Icons.add),
), // This trailing comma makes auto-formatting nicer for build methods.
);
}
}`
Logs
======== Exception caught by rendering library =====================================================
The following assertion was thrown during performResize():
'package:flutter/src/widgets/overlay.dart': Failed assertion: line 720 pos 12: 'constraints.biggest.isFinite': is not true.
Either the assertion indicates an error in the framework itself, or we should provide substantially more information in this error message to help you determine and fix the underlying cause.
In either case, please report this assertion by filing a bug on GitHub:
https://github.com/flutter/flutter/issues/new?template=2_bug.md
The relevant error-causing widget was:
Container file:///C:/Users/kishan.gohel/AppData/Local/Pub/Cache/hosted/pub.dartlang.org/responsive_framework-0.1.4/lib/responsive_wrapper.dart:649:30
When the exception was thrown, this was the stack:
#2      _RenderTheatre.computeDryLayout (package:flutter/src/widgets/overlay.dart:720:12)
#3      RenderBox.performResize (package:flutter/src/rendering/box.dart:2332:12)
#4      RenderObject.layout (package:flutter/src/rendering/object.dart:1758:9)
#5      RenderProxyBoxMixin.performLayout (package:flutter/src/rendering/proxy_box.dart:116:14)
#6      RenderObject.layout (package:flutter/src/rendering/object.dart:1779:7)

fix issue by changing import file
import 'package:responsive_framework/responsive_framework.dart';
to
import 'package:responsive_framework/responsive_wrapper.dart';


minecraft-server: 1.20.6 -> 1.21

Automatic update generated by nixpkgs-update tools. This update was made based on information from passthru.updateScript.
meta.description for minecraft-server is: Minecraft Server
meta.homepage for minecraft-server is: https://minecraft.net
Updates performed

Ran passthru.UpdateScript

To inspect upstream changes
Impact
Checks done

built on NixOS
The tests defined in passthru.tests, if any, passed
found 1.21 with grep in /nix/store/piv3ffvkzprwxbnljqaxb1plk4xidzgz-minecraft-server-1.21
found 1.21 in filename of file in /nix/store/piv3ffvkzprwxbnljqaxb1plk4xidzgz-minecraft-server-1.21

Rebuild report (if merged into master) (click to expand)

3 total rebuild path(s)

3 package rebuild(s)

First fifty rebuilds by attrpath

minecraft-server
minecraftServers.vanilla

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/piv3ffvkzprwxbnljqaxb1plk4xidzgz-minecraft-server-1.21 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A minecraft-server https://github.com/r-ryantm/nixpkgs/archive/9b773f6ac02166c71ea4ea2dbe0ddbd073ce599b.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/9b773f6ac02166c71ea4ea2dbe0ddbd073ce599b#minecraft-server

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/piv3ffvkzprwxbnljqaxb1plk4xidzgz-minecraft-server-1.21
ls -la /nix/store/piv3ffvkzprwxbnljqaxb1plk4xidzgz-minecraft-server-1.21/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review --extra-nixpkgs-config '{ allowInsecurePredicate = x: true; }' run on x86_64-linux 1

2 packages built:

minecraft-server
minecraftServers.vanilla-1-20

Maintainer pings
cc @thoughtpolice @tomberek @costrouc @joelkoen for testing.

Closing in favour of #319794


VSTS agent supports Windows 10 ARM32v7

I needed to run VSTS agent on Windows 10 IoT Core (ARM32v7).  Based on my understandings, it is easy to support win-arm for VSTS  agent; only need to upgrade Agent.Service project to .Net Core 2.1 and related build script (I already did locally).  However, there are many external dependencies, e.g. Git, NodeJS.
Questions:

Do you have any plan to support VSTS agent on Windows ARM32v7?
Do you know any other workaround/trick to allow those externals to run on Windows ARM32v7?

FYI @adityapatwardhan

We're moving to .NET Core 3.1 shortly. While I don't have plans to ship a Windows ARM32 build (since x86 emulation seems to work pretty well), I'm not opposed to it. We would likely still rely on x86 emulation for dependencies like Git and Node -- would that be acceptable?

PowerShell still needs this to test the scenario that @philipktlin is saying that he is using.

Can we please keep this issue open?  My team's scenario involves the building/testing of .NET Docker ARM images.  Right now we need to have a Linux agent machine that communicates with a remote ARM device.  We'd really like to simplify our infrastructure by simply having the ARM device act directly as the agent.

Sure, let's leave it open a bit longer to see if we can fit it in.

@vtbassmatt - Now that we have switched the agent to use .NET Core 3.1, is this issue complete?

Let's hear from the community whether using x86 emulation is good enough. I'm not highly inclined to add a Windows/ARM flavor unless there's specific demand for it.

I still refer to https://github.com/microsoft/azure-pipelines-agent/issues/2062#issuecomment-584989073

@vtbassmatt Is this the same issue to track Windows 10 on ARM64?
I I'm absolutely fine with having x86 emulation for certain dependencies, as long as perf is acceptable, which seems to be the case. Releasing a version of the agent that supports Windows on ARM64 would improve perf a little bit, which I honestly think its a win by itself. My scenario is not to build the ARM64 binary, which can always be done on x64 host machines, but to actually run the tests on the real physical hardware. Is there anything blocking this from being released? It doesn't seem a lot of work.

@azchohfi this issue was originally for ARM32. In the interest of not proliferating issues, I won't open a second one for ARM64 until/unless we decide to do something different for 32/64. Feel free to discuss here.
The pre-reqs we need are:

.NET Core native support for the platform (which I believe is coming in .NET 5.0, while we're on 3.1)
A usable Git build
A usable Node 10, Node 14, and (not a hard requirement but a very very very nice to have) Node 6 build
Hardware the team can use for build and test

Of these, the first is the hardest. We don't upgrade .NET versions willy-nilly, since it can impose a burden on everyone with a self-hosted runner. But assuming we move the agent to .NET 5 eventually anyhow, then it would be a matter of sourcing the right hardware that we can use for our build/test farm. I assume we can use Git and Node from Win/x86 with acceptable performance, but we'd of course have to test that as well.
I guess I'd turn it back and say - what do you gain by having a "native" agent to use for testing your bits? As long as the agent runs with acceptable performance AND can launch your processes natively, would it matter?

That is a fair point. I'm not sure if these reasons are enough to back the cost of this, but they might:

Having the agents support ARM64 is a first step for having ADO support it as well, in the future, eventually. Perf on hosted builds do have a cost, so any time we gain by having a native ARM64 binary is valuable.
One of the value propositions of Windows on ARM(64) is improved battery life. Again, x86 emulation have a cost, and for specific test scenarios, the x86 emulation might interfere with these results.
x86 processes are limited to <4GB of RAM, so having node natively on ARM64 could interfere with custom tasks that do their work inproc. Same goes for the agent itself.

Since the agent is only an orchestrator, I don't think its a hard requirement, but if the work to support it is minimal, why not?

Appreciate hearing your thinking, thanks! The "why not" is the other 90 zillion things I could ask the team to build 😁  It comes down to the science art of deciding what has the most impact: the little thing that helps everyone, the big thing that helps one person, or the splashy thing that attracts a bunch of new people?

If resourcing is an issue, is this something the team would accept a PR for? I'm up for it.

We had an offline chat about this. It's not really about resourcing per se.

Hello, trying to set up our runners for Windows on Arm. Turns out Azure Pipelines doesn't support ARM. The specs of the PC are below. I would really like to see this feature added if Microsoft is serious about its future on ARM as we use azure pipelines to build our windows software.
Processor	Snapdragon (TM) 8cx Gen 2 @ 3.15 GHz   3.15 GHz
Installed RAM	16.0 GB (15.6 GB usable)
System type	64-bit operating system, ARM-based processor


Note

Get-AzADUser -UserPrincipalName $upn might return nothing. Use Get-AzADUser -DisplayName instead (visible top-right on the portal). The reason is that UPN can be different from email (example UPN: mickey.mouse_contoso.com#EXT#@mickeymouse.onmicrosoft.com).

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: ec4b373d-ae48-beb4-c5f2-3fab4d88732e
Version Independent ID: 7b9753ea-c773-bec1-2530-5539ee69cdc1
Content: Integrate Azure Key Vault in Resource Manager template deployment
Content Source: articles/azure-resource-manager/resource-manager-tutorial-use-key-vault.md
Service: azure-resource-manager
GitHub Login: @mumian
Microsoft Alias: jgao

@mcurko Thanks for the comment! We can have this investigated by the content owner and update as appropriate.

@mcurko - Thank you very much for taking time providing us the feedback.  I will list both options.  The changes will go live later today.
#please-close


What about the vue 3 version? 🤨

Hey folks!
A lot of you have been wondering what happened with the next version of this package and if it will be ready soon, so I created this issue to give you all the details:
New name

The new version will have a new identity that better represents this new version. First of all, I am working on a sibling for React and potentially another for Alpine.js, and if I find the time for svelte. So as you may guess, vue-tailwind will not be accurate at all.
The new name is variantjs. I even created a Twitter account  (https://twitter.com/variantjs) and registered the domain 🙌
All the progress is hosted in a new GitHub namespace in case you want to take a look: https://github.com/variantjs

PD: I am looking for a designer that wants to help me with the new branding,  so if you know someone that wants to work on an open-source project, let him know about this.
Whats is expected?
This new version will have at first (when released) the same components this library already but for vue3 (and react) with a couple of improvements. The main improvements are:

Cleaner code prepared to encourage collaboration and accept custom components
100% test coverage
Better typescript implementation
Better tree-shaking
Almost no-dependencies
Easy to configure and more flexible
Vue 3 and React version

Progress

You can see the progress here https://github.com/variantjs
I already finished like 60% of the components that this library will have but still need to work on the complex ones, so you still need to wait.
I don't have a release date, hopefully in one month, but no promises.

How can I help?
Consider that this is a side,  non-lucrative project that I make in my free time. I have a full-time job that is my priority since I still need to pay the bills, so:

Give me a star on the new repositories https://github.com/variantjs (free, fast, and helpful)
Sponsor the project. It's not only about the money. Seeing people liking the project enough to give me a few bucks really motivates me.
Need help with design!
Once the MVP for this new version is ready and released, you can help me by contributing docs, etc.

BTW a lot ❤❤❤  for my current sponsors.

Just wondering:

Will this still be based on tailwind css?
Are you sure that also providing it for react will not slow down the dev or limits its feature?

I'm especially curious on how you can take advantage on stuff like composition API and still providing it for react and vue?

Yes, will be based on tailwind but ready for any css framework (like this one)
React also uses composition, (actually came first there)
I'm moving most of the common and more complex stuff into a separated core library https://github.com/variantjs/core
Im doing my best with the test suite and the code itself to encourage collaboration, so, yes Can potentially slow down the development for sure but also can grow the  community, if grows big enough maybe more people will decide to collaborate on the project and maybe more people (or companies) sponsor this project and maybe, just maybe one day I'll be able to work full time on this

I am looking for a designer that wants to help me with the new branding

I would be interested in contributing some design work :)

@alfonsobries, I think you should immediately put us in a position to try the components with 3 (even using the master branch) so that we can help you more in development (even graphics).

I think you should config a mono repo. It will be easier to grow in a long time.

Preview version ready, feel free to open issues or PR if you encounter any error, also consider that is a preview version and is subject to change.
Docs and stable version soon 🤞
https://github.com/variantjs/vue


Remove JSX support

After discussing with @catmando, to support JSX, extra dependency on sprockets make it hard to maintain backward compatibility either for opal 0.7 or rails 3.
And given that the integration with react-rails gem is possible, we could simply rely on JSX compiling feature provided by it rather than rolling our own.

This issue was moved to reactrb/reactrb#46


fromAnything - community project idea

Hi everybody !
I really do not know if I am in the right way by writing this here.
Fallen in love about reactive programing, then met MostJs made my hear beating a lot.
So I wished a way to perform something I did with Xstream : build a stream for a Firebase producer.
However, most seem to do not have this feature (unless I badly sought).
That is why I found another way. I used proxy and event capabilities :
most.fromFirebase = function(event_name, reference_obj) {
  const event_emitter = new EventEmitter();

  reference_obj.on(event_name,
    (snapshot) =>  event_emitter.emitEvent(event_name, [snapshot])
  )

  return most.fromEvent(event_name, event_emitter);
}

I know this isnt the better way. I read in code about StreamSource.
So, this is not the main subject. This research work, raised something in my mind. If I want tomorrow to move to GunJs or the departed Parse, I will need to do the same research and build adapter again and again.
And what about socketIO ? And others ?
TL;DR is here
Therefore what are you thinking about building a massive libraries of forAnything stream builder ?
Somewhere to place all our work for building stream for any source.
I guess, one bit dependency for just a source, could be a lot, so what about building many packages but in the same repository like Cyclejs.
Can I use @most npm scope ? With something like @most/from-sourcename
Cheers,

Hello @Swizz, welcome to mostjs I hope you find our libraries to be useful to you.
If I'm not mistaken you're looking for something like @most/create which is analogous to xs.create(producer) in xstream. I've use firebase in a similar fashion to this
import create from '@most/create'

function fromFirebase (eventName, firebaseReference) {
  return create((add, end, error) => {
    firebaseReference.on(eventName, add)
    return () => firebaseReference.off(eventName, add)
  })
}

what about building many packages but in the same repository like Cyclejs

We've discussed the potential of working in a monorepo, but there are some drawbacks I've experienced with Cycle.js as well (I'm a core contributor there too), namely extremely long build times on TravisCI. The Cycle.js tests take about 18-20 minutes on Travis CI which is not fun for outside contributors, because it can take a long time to find out if your test failed, and then make a trivial change and again have to wait a large amount of time to see if it has passed with your new change.
Most of the time is spent on installing dependencies in each of the packages, and then in the case of Cycle.js we run @cycle/dom against a multitude of browsers with saucelabs to ensure cross-browser support. Some of these things could potentially be non-problems for most, but we've not made this decision yet.

Can I use @most npm scope

The @most scope is for packages found in the mostjs orginization which is the home for packages that the mostjs core team are committed to maintaining ourselves. So if we find a package useful and we'd like to continue maintenance ourselves in the event the author is not active then yes. In general community contributions are suggested to be published with a most- prefix and we generously welcome contributions to find a home in our community organization. I myself maintain most-subject and most-proxy there.

Hello @TylorS,
I apologize to have not made so much research.  It is what I looking for.
Thank you very much for all the answers.
I will read more about github/most and github/mostjs-community works.
And I apologize again.

No need for apologies, glad to help you find it, and I hope you enjoy using most.js :slightly_smiling_face:


Incentive Cash FAQ says "You will earn 1 Minima a week"

Hi,
The new version of IC 1.0.43 says you will earn 1 Minima per week...

Thanks
Jazmin

this will be corrected, good catch

This is now fixed in iC v2.0.0.. coming soon ;)

Checked and confirm this is now fixed.
The other added info in the FAQs is a good improvement too 🙂


Ability to lock maxzoom for background imagery

When mapping for HOT projects, it is often the case that there are different imagery dates at different zoom levels.  In these cases, newer buildings are present at the lower zoom levels, but not at the higher zoom levels (e.g. newer imagery at zooms to 18 and older at 19-22). Disabling auto zoom at a lower zoom level allows the new features to be mapped accurately by allowing the mapper to zoom in to the newest imagery. This is currently available in JOSM, but most new mappers use ID.  I believe this would significantly reduce the amount of validation work required if the project manager were able to specify which zoom levels to use in the instructions. Thanks!
Troy

There are also some areas where DG Premium seems to return blank tiles at a high z level (around 18).  Locking the tiles at z=17 would solve this.

@tyrasd Any chance to consider this issue? Maybe it can get a "good first issue" label if it's relatively simple (which it seems to be)?


Set the HTTP/2 session's event listener count to infinity to address warnings

When sending notifications using a newly constructed APN provider all at once, the HTTP/2 session will queue up the calls to this.session.request(). Internally, the HTTP/2 session adds a "connect" event listener for each request since it needs to wait until the connection has been established before it can actually send the requests.
As a result, if more than 10 notifications are sent at once (to a new APN provider whose HTTP/2 session is still setting up the connection), the HTTP/2 session will add more than 10 "connect" event listeners, triggering a MaxListenersExceededWarning. Setting the max listener count to infinity addresses this warning:
(node:1) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 11 connect listeners added. Use emitter.setMaxListeners() to increase limit
Additionally, looking through the code, the APN client doesn't otherwise add an unbounded number of event listeners to the HTTP/2 session (listeners are mostly added just once, when the session is constructed), so this commit shouldn't hide actual problems.

Coverage remained the same at 100.0% when pulling 323fe08d3a4ea29ce27c943e23fcef4bdfba957b on expo:http2-warning-fix into<PHONE_NUMBER>499fe53c9974b19f1b169d25649039 on node-apn:native-http2.


Upgrade azure-armrest to 0.2.9.

This version adds slightly nicer error messages which would aid us in debugging.
@miq-bot add_label darga/yes

@djberg96 - do you know how I can see a list of commits in this specific version?

@bronaghs https://github.com/ManageIQ/azure-armrest/pull/210

@djberg96 - just 1 PR ?

@bronaghs Yes.

LGTM 👍

https://bugzilla.redhat.com/show_bug.cgi?id=1375343


[feature request] yurtadm add label to node with host network mode

What would you like to be added:
When executing yurtadm join, first check the specified nodepool type, if it is hostnetwork=true, we can use yurtadm to add a parameter --node-labels=nodepool to kubeadm-flags.env .openyurt.io/host-network=true`.
Why is this needed:
Label nodepool.openyurt.io/hostnetwork=true add by yurtadm join.
others
/kind feature

/assign


How to obtain the checkpoint in the paper

Thank you for your great job!The above error occurred when I reproduced your code. May I ask where can I obtain this checkpoint and other checkpoints mentioned in your code (such as those in the following picture)?

Hi xixi, thanks for your interest in our work. We have released the pretrained models at https://drive.google.com/drive/folders/1gQjsiCS7DZ8H8KwsTL_I-jTQes2Ha7b9?usp=sharing. You may check them out, where the model names are the same as the code, just changing the model path to your own.

Thank you very much for your reply. In addition, could you please tell me the memory and numbers of GPUs used in this experiment?

Generally, we train the models on 4 to 8 2080ti/1080ti GPUs with 16 CPU cores.  You may scale down/up the number of GPU by adjusting the batch_size (see trainCIFAR10.sh --batch_size **, --gpus ", *,").

After comparing your paper with SCOOD, I have the following two questions:

You mentioned the training process of the generative model in Appendix A of this article, so I want to know what training set is used by the generative model, and is it the training set in the SCOOD benchmark?
Did you calculate the CCR@FPRn in the experimental metrics in SCOOD when evaluating the method in this paper? If so, what are the results of CCR@FPRn?

Hi, xixi-Lu. 1. We use the In-D dataset (e.g. cifar10) as the training set for the generative model. 2. We did not employ CCR@FPRn in our paper.

Hi, I want to calculate the CCR@FPRn metric(which means correct classification accuracy when FPR reaches a value n)  of your method, but I can't find where calculate the ID classsification accuracy in your code. So could please you point out where this part is?
Moreover, considering the OOD detector is independent with classifer in your work, do you think it is meaningful to calculate the CCR@FPRn metric which reflects model's performence of ID classification and OOD detection simultaneously?

Hi, I check eq3 in [1]. As the CCR@FPRn is not directly defined for ours, which is a standalone ood detector, we should make some conversions. I think it is ok to calculate the numerator as the number of samples that 1. pass our detector and 2. can be correctly classified. Since CCR typically shows the performance of the classifier, not our ood detector, we do not use this for evaluation in the paper. Note that, given the FPRn of our detector, whether one sample can pass or not is fixed.
[1] A. R. Dhamija, M. Gunther, and T. Boult, “Reducing network agnostophobia,” in NeurIPS, 2018.

You are correct. Sorry, my words are a little confusing. I am just talking about our method. In MoodCat, given the class label and the image as input, there is a score.

Thank you for your reply. But I still can’t find where is the code for calculating the ID classsification accuracy in "mcoodcat_on_scood.py",  "./CIFAR10_masking/testmodel.py" and  "./ CIFAR100_masking/testmodel.py" ,  which make it difficult for me to test the CCR@FPRn metric with your method. Could you please tell where's this part in your code to let me complete test ?

How to prepare the training dataset, such as CIFAR and ImageNet？How to split？

Thank you for your reply. But I still can’t find where is the code for calculating the ID classsification accuracy in "mcoodcat_on_scood.py", "./CIFAR10_masking/testmodel.py" and "./ CIFAR100_masking/testmodel.py" , which make it difficult for me to test the CCR@FPRn metric with your method. Could you please tell where's this part in your code to let me complete test ?

@LuFan31 Sorry, we did not consider that metric in the evaluation. There is no code in this repo for CCR@FPRn. As a standalone OOD detector, we only test the ID classification accuracy with the classifier itself, without MOODCat. Therefore, we do not include the test for ID classification accuracy in our evaluation.

How to prepare the training dataset, such as CIFAR and ImageNet？How to split？

@Buren-joker There is an official split for cifar10 and cifar100. We follow them from torchvision dataloader. For testing, we follow SCOOD.


HHH-10550: Replaced int cast/usage for long implementation

Fixes
https://hibernate.atlassian.net/browse/HHH-10550

Thsnks for the bug reporting and the PR. Seems a good catch and fixing. The only thing that is missing is a testing case which shows:

without the code fixes it would be broken;
with the code fixes it would succeed.

Usually there is slim chance for the PR to be accepted without such compelling testing case (unless the PR is to fix some documentation). Please see existing testing cases to get the clue how to come up with one. It is not difficult and coding such testing case is both fun and mandatory.

Thsnks for the bug reporting and the PR. Seems a good catch and fixing. The only thing that is missing is a testing case which shows:

without the code fixes it would be broken;
with the code fixes it would succeed.

Usually there is slim chance for the PR to be accepted without such compelling testing case (unless the PR is to fix some documentation). Please see existing testing cases to get the clue how to come up with one. It is not difficult and coding such testing case is both fun and mandatory.

Thank you for taking a look in this PR :)
I'll take a look on the existing tests, it might be specially hard because the test-case would need to hold in memory a binary which exceeds the value of the Integer.MAX_VALUE constant (2,147,483,647 bytes). Any suggestion??
In my real world use-case issue that's actually what is happening...

Thank you for taking a look in this PR :)
I'll take a look on the existing tests, it might be specially hard because the test-case would need to hold in memory a binary which exceeds the value of the Integer.MAX_VALUE constant (2,147,483,647 bytes). Any suggestion??
In my real world use-case issue that's actually what is happening...

Thank you for taking a look in this PR :)
I'll check existing tests, it might be specially hard to create one for this issue, specially because the test-case would need to hold in memory a binary which exceeds the value of the Integer.MAX_VALUE constant (2,147,483,647 bytes). Any suggestion??
In my real world use-case issue that's actually what is happening...

Could you mock something to simulate that then?

Thank you for taking a look in this PR :)
I'll check existing tests, it might be specially hard to create one for this issue, specially because the test-case would need to hold in memory a binary which exceeds the value of the Integer.MAX_VALUE constant (2,147,483,647 bytes). Any suggestion??
In my real world use-case issue that's actually what is happening...

Could you mock something to simulate that then?

Closing this because the bug was already fixed.


New Post

New post about the OPA permissions plugin.

Going to close this for now and will reopen another one, things have changed pretty drastically since this was raised :sweat_smile:

👍 keep us posted 🙂


Large batch insert hangs with too many records in Postgres

GORM Playground Link

https://github.com/go-gorm/playground/pull/221
Note the 10m timeout on Postgres.
Description
When inserting a large number of records using batch insert, Gorm hangs for a long time. Not clear if it ever completes.
This can be averted using CreateInBatches, but it's unclear what a "good" batch size is. E.g. in my case, 100 works fine, but 1000 hangs. I have no way of knowing if a future PR (e.g. to add new columns) is going to tip me over a threshold and start hanging.
Previously, we'd been doing these inserts 1000 at a time using raw SQL, which worked well (we needed to limit to ~1000 due to the limit of 65535 max query parameters in a postgres query). But 1000 seems to be too much for Gorm.

https://gorm.io/docs/create.html#Batch-Insert set a batch size

Previously, we'd been doing these inserts 1000 at a time using raw SQL, which worked well (we needed to limit to ~1000 due to the limit of 65535 max query parameters in a postgres query). But 1000 seems to be too much for Gorm.

The batch size based on your data size, there is no general rule

@jinzhu - I think this needs to stay open.
If the data size is too big for postgres to handle, at the very least, Gorm should return an error instead of hanging. This should be computable based on known limitations in Postgres.


Create a template for algorithm documentation

Expected Behavior
Future documentation of detection algorithms (Issues #18, #19, #20, #21, #22, #23, #24, #25, #26, #27 and #28) should have a consistent structure and make it easy to compare the different algorithms.
Current Behavior

The issues mentioned above ask for documentation of algorithms from the Data Science Bowl. If addressed by several people, the documentation of each algorithm inconsistent and messy, making it unnecessarily harder to read and compare algorithms. Thus the advantage over just using the original documentation would be minimal.
Possible Solution

Creating a template-file specifying sections and content to be filled in as much as possible. This issue thread is also thought of a place to discuss, which information about the algorithm should be included into the documentation.
Possible Implementation

Add a template_algorithms.md file containing the template to the docs/template-folder.

TL;DR: competition algorithms predict if patient has cancer, not the probability that each nodule is cancerous, right?
It looks like most of these go through the same z-slice normalization, lung segmentation, and nodule detection/isolation steps. But then it's the final feature generation steps that might need to be refactored quite a bit to tackle the new problem statement of predicting the probability of each nodule being cancerous. Is that a fair statement?
A feature such as total_number_of_nodules (I made that up as an example) aggregated at the patient level might still be important at the nodule level, but it does seem to imply that the goal was slightly different. Interested to hear anyone else's thoughts on this.
If this is the consensus, then I think part of the documentation should include difficulty/feasibility of refactoring features and final ensemble models to predict at the nodule level, not patient level.

Tagging this as official

TL;DR: competition algorithms predict if patient has cancer, not the probability that each nodule is cancerous, right?

Yes

.... Is that a fair statement?

Mostly. I've noticed a few differences in some of the pre-processing. A good first step would be to just enumerate the individual steps and then (roughly) categorize the different ways of doing each step.

... the goal was slightly different.

Correct. Since the initial competition ended, our end user research led us to develop a system that operates on a more granular level (node). As you mentioned, the aggregate stats (total num of cancerous nodules, etc.) are still useful and should be fairly easy to calculate from the individual data.

I created a pull request with a first draft of the template. If you have ideas of how to improve it please fill free to comment on it or to directly add a commit.


Correcting encoding code from unicode to UTF8

@vin-yu : Thanks for your contribution! The author(s) have been notified to review your proposed change.

#sign-off

@MikeRayMSFT: I'm sorry - only the author of this article, @twright-msft, can sign off on your changes. But we do have an exception process - if you are on the Microsoft content or product team for this product area, you can ask the PR review team to review and merge it by sending mail to the techdocprs alias.


Faster terminal startup

See:
http://apple.stackexchange.com/a/71930/40515

And I had to do this:
$ sudo ln -s /bin/bash /usr/bin/bash

Put this info in README.

Also, removing asl files:
$ sudo mv /private/var/log/asl/*.asl ~/.Trash

sudo ln -s /bin/bash /usr/bin/bash

Note that this no longer works in El Capitan:
http://apple.stackexchange.com/a/196226/40515

https://www.reddit.com/r/applehelp_betas/comments/3jzzyp/slow_terminal_or_iterm_start_times_on_el_capitan/