added takeFirst and takeFirst_n

Hi,
First I have to say, I'm really happy that this library exists, thanks for all the work that went into it!
I've expanded it slightly by adding two functions that I was desperately in a need for - takeFirst and takeFirst_n.
I'm aware that my terminology is confusing, but I haven't yet found an equivalent in any functional libraries or Haskell.
Before merging in, I'd definitely like to ask the maintainers and whoever is reading this: what would be the best name for this operation?
Also, I've only added them to LazyCollectionType so far. I'm happy to make it available on eager Collections/Sequences if somebody would find it useful (or just for the sake of consistency).
I've included tests for the added functionality.
Thanks!

Thanks for the pull request! As it happens, the takeFirst method already exists: it's called first. The takeFirst_n is achievable with filter and prefix:
(0..<10) // [0, 2, 4, 6]
  .filter { $0 % 2 == 0 }
  .prefix(4)

Although prefix isn't lazy in its current form. I'm not sure about putting filter and prefix things into one method: it doesn't seem very composable. I think maybe a lazy prefix is preferable, which would let you do something like this:
(0..<10) // [0, 2, 4, 6]
  .lazy
  .filter { $0 % 2 == 0 }
  .prefix(4)

Thanks for the response!
You're right, it would be a lot nicer to do lazy.filter.prefix instead of this. My original problem was the one you pointed out -  prefix doesn't have a lazy variant, it's performed eagerly even on lazy lists, which kind of defeats the point!
Now that I think about it again (writing a lazy prefix was the original idea, but I wasn't that familiar with writing lazy generators, and writing this seemed more easy), it may be possible to do it though, based on this and and your implementation of various generators.
I'll do some work on this and submit another PR!
Ohh just one thing - not that it matters much, but first(predicate) wasn't previously defined for lazy collections. Is this a useful addition? Or should I strip it and restrict this PR to add a lazy prefix(x) ?
Thanks for the feedback!

I'm not sure how a lazy first(predicate) would work. How would it be different from an eager version?

It wouldn't be any different in terms of API, and underneath, it would just use filter(predicate).lazyPrefix(1).
The reason why I'm bringing it up since as of the last commit in master, .first is not defined on LazySequenceType, only on SequenceType. Not sure if it'll be super useful, but may be a worthy addition - at least I had a case when I wanted to use it:).

Yes, but `LazySequenceType

Yes, but LazySequenceType inherits from SequenceType, so on any lazy sequence, you already have the first method. I'm not sure, but I don't think that a lazy version of first would function any differently than the eager version of first (since both have to evaluate the sequence up until the first thing that passes the predicate, and neither would evaluate the rest)

True! I was really confused by the the fact that when I was in the framework in other files, autocomplete wasn't offering me first on any LazySequenceTypes...
Let me close this and thank you!:)


issue with parquet reader

parquetSample.zip
I am getting an error while using parquet reader.
Error is {"fatal error reading column 'SN'"} and message is Unable to read beyond the end of the stream.
I have set TreatByteArrayAsString = true .
My code is:
var options = new ParquetOptions { TreatByteArrayAsString = true };
DataSet ds = ParquetReader.Read(fs, options, null);
Please check attached zip folder for the file.

Are you able to reproduce the issue?

@dimpalbhole just looking at this now.

Hi @dimpalbhole. Absolutely no issues on my side so I'm closing this. You might want to reopen the issue with details suggested when you create a new issue, otherwise it will be a long guesswork.

forgot to add one thing. I am reading a blob using  ParquetReader.Read(fs, options, null).
where fs is
Stream fs = (MyAzureBlob).OpenRead()

@dimpalbhole which .net runtime/version are you using and which parquet.net library version?

@aloneguid .Net version is 4.5.2 and parquet library is  v4.0.30319 runtime version and 2.1.2(installed version)

Are you able to reproduce this issue?

@dimpalbhole non still can't reproduce it, maybe you can attach a sample project here?

Have you tried uploading that file as a azure blob?

@dimpalbhole I'm not quite sure what azure blob has to do with parquet.

@dimpalbhole I've just created a simple console app which reads a parquet file from Azure Blob as a stream in the same way you are doing and it's working okay.
https://gist.github.com/dazfuller/ffedb2ed17a1977ce56c2aac13b7896c
Are you able to read the entire file and save to disk (excluding the reading as Parquet part). Just wondering if this is a network related issue.

Have you tried with the file which i have shared? Because i am getting this
issue only with this file, other files in the same container are getting
read.If a save this file to the local disk then i am able to read this.
On Feb 9, 2018 9:16 PM, "Darren Fuller"<EMAIL_ADDRESS>wrote:

@dimpalbhole https://github.com/dimpalbhole I've just created a simple
console app which reads a parquet file from Azure Blob as a stream in the
same way you are doing and it's working okay.
https://gist.github.com/dazfuller/ffedb2ed17a1977ce56c2aac13b7896c
Are you able to read the entire file and save to disk (excluding the
reading as Parquet part). Just wondering if this is a network related issue.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/elastacloud/parquet-dotnet/issues/289#issuecomment-364470939,
or mute the thread
https://github.com/notifications/unsubscribe-auth/Ag7pgZlj_H3DwsvpnYCpBY584L_Nq7OXks5tTGhIgaJpZM4R1ERv
.

Okay, using that file (sorry, read straight past it originally) I can re-create the error with the following from the internal stack

at System.IO.MemoryStream.InternalReadInt32()
at System.IO.BinaryReader.ReadInt32()
at Parquet.Data.Concrete.StringDataTypeHandler.ReadOne(BinaryReader reader)
at Parquet.Data.BasicDataTypeHandler`1.Read(SchemaElement tse, BinaryReader reader, ParquetOptions formatOptions)
at Parquet.File.ColumnarReader.TryReadDictionaryPage(PageHeader ph, IList& dictionary)
at Parquet.File.ColumnarReader.Read(Int64 offset, Int64 count)
at Parquet.ParquetReader.Read()

@dimpalbhole @dazfuller when you use blob.OpenRead() and start start reading the stream as parquet it's not fully downloaded from blob storage yet therefore this error. Parquet needs to read the file footer before anything else, so if you're in the middle of the file it's not the right data.

I think with smaller files this works fine as it's downloaded in full prior to read (I've can get it to work anyway), but with the larger files it's as per @aloneguid says.  I've updated that Gist to work with downloading the file into a local byte array before reading and that works with the same file you've provided.

Closing this as not a parquet issue.


docs(gh-pages): create a browser support section

PR Details

add a browser support section for the landing page
minor refactor to landing page styles
fix mobile view of category cards

Related Issue

https://github.com/exadel-inc/esl/issues/617

:tada: This PR is included in version 3.5.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Updating Decoding doc with example of writing custom decoder

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Translate Manipulating the DOM with Refs page

Closes #388
Description
This PR is aimed at resolving the task of translating the "Manipulating the DOM with Refs" page.

Any updates @andriawan

Any updates @andriawan

Sorry for slow progress...kind of busy at main work... 😅
promise i will finish the translation this week @r17x

this PR is ready for review. cc @r17x @zainfathoni @mhaidarhanif @resir014 @mazipan

been already improved translation node in the latest commit. cc @r17x


Beta directions for immune related traits are incorrect

Beta directions for a number of immune traits including de Lange (GCST004131) or Liu (GCST003043) are incorrect
As can be seen in the GWAS Coloc table here:
https://dev--genetics-app.netlify.com/study-locus/GCST003044/2_233252937_T_C

Another good example: https://dev--genetics-app.netlify.com/variant/1_67240275_G_A

Case 1:
https://dev--genetics-app.netlify.com/variant/1_67240275_G_A
In PheWAS:
Beta | Study ID | Trait | Trait Category | P-value | Odds Ratio | PMID | Author (Year) | N Cases | N Overall
-- | -- | -- | -- | -- | -- | -- | -- | -- | --
0.70947984 | GCST001725 | Inflammatory bowel disease | Immune system | 8.12E-161 | 2.03293352 | PMID:23128233 | Jostins L | 12924 | 34366
0.6578 | GCST004131 | Inflammatory bowel disease | Immune system | 4.81E-111 | 1.93054047 | PMID:28067908 | de Lange KM | 25042 | 59957
0.7935 | GCST004132 | Crohn's disease | Immune system | 6.85E-93 | 2.21112183 | PMID:28067908 | de Lange KM | 12194 | 40266
0.52020279 | GCST001728 | Ulcerative colitis | Immune system | 3.20E-62 | 1.68236878 | PMID:23128233 | Jostins L | 12924 | 34366
0.86369828 | GCST001729 | Crohn's disease | Immune system | 1.87E-54 | 2.37191651 | PMID:23128233 | Jostins L | 12924 | 34366
0.483 | GCST004133 | Ulcerative colitis | Immune system | 2.00E-41 | 1.62092991 | PMID:28067908 | de Lange KM | 12366 | 45975
0.55388511 | GCST000964 | Ulcerative colitis | Immune system | 5.12E-28 | 1.74 | PMID:21297633 | Anderson CA | 6687 | 26405
-0.401 | SAIGE_555 | Inflammatory bowel disease and other gastroenteritis and colitis | Uncategorised | 3.58E-19 | 0.66965006 |   | UKB SAIGE | 4528 | 339311
-0.522 | SAIGE_555_1 | Regional enteritis | Uncategorised | 4.11E-13 | 0.5933327 |   | UKB SAIGE | 1743 | 336526
-0.614589 | NEALE2_20002_1462 | crohns disease \| Non-cancer illness code, self-reported | Immune system | 7.03E-13 | 0.54086315 |   | UKB Neale v2 | 1096 | 361141
-0.323 | SAIGE_555_2 | Ulcerative colitis | Uncategorised | 5.53E-10 | 0.72397385 |   | UKB SAIGE | 3195 | 337978
-0.4530285 | GCST005527 | Psoriasis | Immune system | 6.09E-09 | 0.6357 | PMID:23143594 | Tsoi LC | 10588 | 33394
-0.2241854 | NEALE2_20002_1453 | psoriasis \| Non-cancer illness code, self-reported | Immune system | 3.39E-07 | 0.79916699 |   | UKB Neale v2 | 4192 | 361141
-0.3217067 | NEALE2_20002_1463 | ulcerative colitis \| Non-cancer illness code, self-reported | Immune system | 6.95E-07 | 0.72491075 |   | UKB Neale v2 | 1916 | 361141

Case 2:
rs6740847: https://dev--genetics-app.netlify.com/variant/2_181443625_A_G
Paper (https://www.nature.com/articles/ng.3760/tables/1):

A increasing, G decreasing

PheWAS:

G increasing, A decreasing

Raw:

MarkerName
Allele1
Allele2
Effect
StdErr
P.value

2:182308352_A_G
a
g
-0.0924
0.0125
1.22E-13

To match paper,

Allele2 (G) is effect (decreasing)
Allele1 (A) is non-effect (increasing)

Case 2 IBD de Lange:
rs67289879: https://dev--genetics-app.netlify.com/variant/2_181443625_A_G
Paper (https://www.nature.com/articles/ng.3760/tables/1):

T increasing, C decreasing

PheWAS de Lange:

C increasing, T decreasing

PheWAS UK Biobank (SAIGE_555):

T increasing, C decreasing

Raw summary statistics:

MarkerName
Allele1
Allele2
Effect
StdErr
P.value

6:42007403_C_T
t
c
-0.0898
0.0162
3.04E-08

To match paper & SAIGE,

Allele2 (C) is effect (decreasing)
Allele1 (T) is non-effect (increasing)

I think all of these studies need flipping

study_id
pmid
pub_date
pub_journal
pub_title
pub_author
trait_reported

GCST004131
PMID:28067908
2017-01-09
Nat Genet
Genome-wide association study implicates immune activation of multiple integrin genes in inflammatory bowel disease.
de Lange KM
Inflammatory bowel disease

GCST004132
PMID:28067908
2017-01-09
Nat Genet
Genome-wide association study implicates immune activation of multiple integrin genes in inflammatory bowel disease.
de Lange KM
Crohn's disease

GCST004133
PMID:28067908
2017-01-09
Nat Genet
Genome-wide association study implicates immune activation of multiple integrin genes in inflammatory bowel disease.
de Lange KM
Ulcerative colitis

study_id
pmid
pub_date
pub_journal
pub_title
pub_author
trait_reported

GCST001725
PMID:23128233
2012-11-01
Nature
Host-microbe interactions have shaped the genetic architecture of inflammatory bowel disease.
Jostins L
Inflammatory bowel disease

GCST001728
PMID:23128233
2012-11-01
Nature
Host-microbe interactions have shaped the genetic architecture of inflammatory bowel disease.
Jostins L
Ulcerative colitis

GCST001729
PMID:23128233
2012-11-01
Nature
Host-microbe interactions have shaped the genetic architecture of inflammatory bowel disease.
Jostins L
Crohn's disease

However,
https://dev--genetics-app.netlify.com/variant/1_19845367_G_A
Anderson raw file:
hrom   pos     rsid    other_allele    effect_allele   p       beta    se      OR      OR_lower        OR_upper
1	20171860	rs6426833	A	G	3.9299999999999994e-35	0.26236426446749106	0.02121442129707982	1.3	1.2470540362088030	1.3551938816843954

G is increasing, which is the same as in the portal.

These studies have incorrect beta directions and will be fixed in post-production:

study_id
pmid
pub_date
pub_journal
pub_title
pub_author
trait_reported

GCST004131
PMID:28067908
2017-01-09
Nat Genet
Genome-wide association study implicates immune activation of multiple integrin genes in inflammatory bowel disease.
de Lange KM
Inflammatory bowel disease

GCST004132
PMID:28067908
2017-01-09
Nat Genet
Genome-wide association study implicates immune activation of multiple integrin genes in inflammatory bowel disease.
de Lange KM
Crohn's disease

GCST004133
PMID:28067908
2017-01-09
Nat Genet
Genome-wide association study implicates immune activation of multiple integrin genes in inflammatory bowel disease.
de Lange KM
Ulcerative colitis

GCST001725
PMID:23128233
2012-11-01
Nature
Host-microbe interactions have shaped the genetic architecture of inflammatory bowel disease.
Jostins L
Inflammatory bowel disease

GCST001728
PMID:23128233
2012-11-01
Nature
Host-microbe interactions have shaped the genetic architecture of inflammatory bowel disease.
Jostins L
Ulcerative colitis

GCST001729
PMID:23128233
2012-11-01
Nature
Host-microbe interactions have shaped the genetic architecture of inflammatory bowel disease.
Jostins L
Crohn's disease

GCST000964
PMID:21297633
2011-02-06
Nat Genet
Meta-analysis identifies 29 additional ulcerative colitis risk loci, increasing the number of confirmed associations to 47.
Anderson CA
Ulcerative colitis

@mkarmona Here are the locations of the updated files
Top loci

[ ] gs://genetics-portal-data/v2d/190612/ has been created, only gs://genetics-portal-data/v2d/190612/toploci.parquet is different from the previous version

Credible sets

[ ] gs://genetics-portal-data/credible_sets/190612

Sumstats

[ ] gs://genetics-portal-data/v2d_sa/gwas/190612
[ ] Unchanged: gs://genetics-portal-data/v2d_sa/molecular_trait/190606

Coloc

[ ] gs://genetics-portal-data/coloc/190612

This is fixed in the current version, but is not fixed at source. To fix at source requires:

[ ] GWAS Catalog to correct the problem
[ ] Reprocess sumstats
[ ] Remove faulty studies from data
[ ] Update fine-mapping and coloc pipelines to skip existing results
[ ] Re-run fine-mapping
[ ] Re-run coloc

@Jeremy37 @ktsirigos - this issue has been fixed at source (GWAS Cat harmonised summary statistics) back in 2019.
I have noticed, however, that in OTAR Gen betas from De Lange 2017 (GCST004131, GCST004132, GCST004133) are reported with opposite direction from what is made available in the Catalog harmonised files. I know you also recently received a user query reporting this discrepancy between OTAr and the Catalog.
Please note the effect alleles reported in OTAR are in line with the GWAS harm file, only betas are inverted at your end.
Example from the user: Taking an IRF5 variant 7_128933913_G_A as an example, we see that the effect allele in the GWAS Catalog summary stats is A and the beta is 0.0995. However, in Open Targets the effect allele is A and the beta is -0.0995. https://genetics.opentargets.org/variant/7_128933913_G_A.
Variants I have checked to confirm behaviour: 10_99527227_C_T  (UC), 10_99558359_G_A (UC), 10_62748961_A_G (CD),, 10_79306820_G_A (CD), 10_62685804_A_G (IBD), 10_62756305_G_T (IBD), 10_62657529_C_T (IBD).
I hope this helps!


Content Injection due to quoteless attributes

Content Injection due to quoteless attributes
Vulnerable module: mustache
Introduced through<EMAIL_ADDRESS>and<EMAIL_ADDRESS>Detailed paths
Introduced through: cartodb-ui@CartoDB/cartodb#5f555a1234a3bf69a51f5e87d5be2e2e782a061c ›<EMAIL_ADDRESS>›<EMAIL_ADDRESS>Introduced through: cartodb-ui@CartoDB/cartodb#5f555a1234a3bf69a51f5e87d5be2e2e782a061c ›<EMAIL_ADDRESS>›<EMAIL_ADDRESS>Overview
When using attributes without quotes in a mustache template, an attacker can manipulate the input to introduce additional attributes, potentially executing code. This may lead to a Cross-site Scripting (XSS) vulnerability, assuming an attacker can influence the value entered into the template. If the mustache template is used to render user-generated content, this vulnerability may escalate to a persistent XSS vulnerability.
Example
For example, assume mustache was used to display user comments, using the following template: {{name}}{{comment}}
If an attacker spoofed his email address and provided the following value<EMAIL_ADDRESS>onload=alert(document.cookie)
The resulting HTML would be:  Evil WizardBusted!

@CartoDB/rt-managers

@alrocar

Assigned to the backend project until we prioritize.

cc. @VictorVelarde


[Autocomplete]: Chips affects container's height

[x] The issue is present in the latest release.
[x] I have searched the issues of this repository and believe that this is not a duplicate.

Current Behavior 😯
It can be checked in Multi values demo: https://material-ui.com/components/autocomplete/#multiple-values
When you select a option on container (TextField) with variant  standard or filled the height grows because of the generated Chip
Expected Behavior 🤔
Selected values should not affect component's height
Steps to Reproduce 🕹

Steps:
1.Open material-ui site
2.Go to Autocomplete
3.Multi values section
4.Select a value in the first and third example
Addtional Info 🔦
The issue does not happen with variant outlined because it has this css:
.MuiAutocomplete-inputRoot[class*="MuiOutlinedInput-root"] .MuiAutocomplete-input {
    padding: 9.5px 4px;
}

whereas filled has:
.MuiAutocomplete-inputRoot[class*="MuiFilledInput-root"] .MuiAutocomplete-input {
    padding: 9px 4px;
}

and standard:
.MuiAutocomplete-inputRoot[class*="MuiInput-root"] .MuiAutocomplete-input {
    padding: 4px;

If we align those css, the problem is solved but I think the impact in the overall design/style won't be the desirable for those two.
We can also change the size of the Chip (32px + 6px margin [3px top and 3px bottom]) to 26px but also, I don't think this is the ideal.
So, what do you think?
p.s: The label on filled variant is also incorrect. It's too close of the Chip:

Your Environment 🌎

Tech
Version

Material-UI
latest

This is part of the constraints of the chip. You can use a smaller variant to avoid the issue.

I want to pre-calculate input height based on chip, with the normal chip size


Consistently use managed/unmanaged to refer to persisted/standalone objects

In the docs, we use a variety of words to describe Realm objects when they are either attached or detached from a Realm. Java has settled on using the terms managed & unmanaged and I think we should do the same. At the very least, no matter the terms we pick, we should be consistent.

I still need to edit (and copyedit) the code documentation.

This is finished. Swift 3 needs its own documentation, but that's contingent on a few other things and orthogonal to this ticket.


Reproduce results on KINS dataset

Hi @lkeab,
Thank you for your consideration.
I have reproduced the results on the KINS dataset, the training config I used is this one (https://github.com/lkeab/BCNet/blob/main/configs/fcos/fcos_imprv_R_101_FPN.yaml)
This is my result:
Task: bbox
AP,AP50,AP75,APs,APm,APl
22.1250,36.1991,22.7091,7.1252,29.4600,50.7804
Task: segm
AP,AP50,AP75,APs,APm,APl
19.0872,35.3957,18.6023,5.3862,25.6557,49.1075
I think I find that there is a large gap between my results and the reported results

I would like to ask if I have done something wrong or is there any specific config for the KINS dataset. Thank you.

Training KINS should have difference settings compared to COCO, including lr, iters, lr reduce steps. I followed the same setting here. Also, the results are not that stable due to its small size.

Great, thank for you advice @lkeab

However, do you have your trained model that I can use for doing the evaluation on KINS? Thanks a lot!

Sorry, I didn't preserve that model due to change of work place.

https://github.com/lkeab/BCNet/blob/main/configs/fcos/fcos_imprv_R_101_FPN.yaml

Hi trqminh,
Did you reproduce results on KINS?

@usherbob
yes, I reproduced the kins results of bcnet. however, you need to run with mask rcnn instead of fcos to get the reported performance.

@zhangyufeng1998
I am a bit occupied now but I'll organize the code and let u know as soon as I can


Add 0x Limit Order Support

This issue captures work for adding 0x limit order support.
I think this can be done fairly straightforwardly with our current architecture. We would need to define a new liquidity source in the driver that would query the 0x API for limit orders. The following paginated query, for example, returns a page (of 7 at the time of writing) of 0x limit orders that we would be able to use for any of our solvers:
curl -s 'https://api.0x.org/orderbook/v1/orders?taker=0x0000000000000000000000000000000000000000&sender=0x0000000000000000000000000000000000000000&verifyingContract=0xDef1C0ded9bec7F1a1670819833240f027b25EfF&page=2&perPage=100'

Some notes:

taker needs to be address(0) (or, technically, the address of the EOA that submits the transction filling this order)
sender needs to be address(0) or settlement.address. Since I don't think anyone is creating orders for GPv2Settlement contract specifically, we can probably just use address(0) to start
verifyingContract is set to the latest 0x v4 contract. While we could support older versions (v2 was popular for example) I don't think its worth the effort of the additional logic for encoding interactions (at the time of writing there were 3/651 orders that were not for v4).

The API is speedy enough that we should be able to realistically query it every batch:
% cat get_all_orders.sh
#!/usr/bin/env bash

for page in $(seq 1 7); do
  curl -s "https://api.0x.org/orderbook/v1/orders?taker=0x0000000000000000000000000000000000000000&sender=0x0000000000000000000000000000000000000000&verifyingContract=0xDef1C0ded9bec7F1a1670819833240f027b25EfF&page=${page}&perPage=100" > /dev/null
done
% /usr/bin/time bash get_all_orders.sh
        5.71 real         0.16 user         0.09 sys

From what I can tell there isn't any ordering that we can take advantage of to speed this up.
The solver already support liquidity orders (i.e. limit orders orders that should not receive any surplus) so most of the work will be towards implementing the calldata encoding logic for filling the 0x orders. I think they may be some differences with costs/fees but I can't think of anything substantial.

Since all the orders fit within a single page at the max page size (1000) lets just use the HTTP API since it is super easy to use.
In the future, it might make sense to use their WebSocket API where we can subscribe for orders and get them as soon as they are added (instead of needing multiple pages and having weird races from fetching them sequentially - since there is no "pagination token" concept in the paging API). Just posting this here so we have some record of it (not that we should implement the WebSocket API at the moment).


[WIP] Feature/distributed storage support multiple indexers

I made a Indexer interface, so that it should be easier in the feature to add multiple implementations and technologies that can hold the central index of a dApps.

In the future we can also add datproject, beaker/webdb to the framework.
Maybe forsee a monorepo, to host these subpackages ...
...

@hstove can you look into this?
Would be awesome if this is something to move into radiks. Only question that I can't takkle is the send sendNewGaiaUrl.

Hey @jorishermans! Thank you for making a PR. Abstracting the 'indexer' layer is definitely something that is a positive change. I haven't given this a thorough enough look yet, but overall I understand the idea. I'll have to do some testing to make sure this is fully compatible with Radiks, and doesn't include breaking changes.
My first concern is how this will work in the world of a more decentralized, peer-to-peer radiks. You can read my proposal for my thoughts about where I'd like Radiks to grow. Ultimately, if we merged something like this, I would want to make sure its compatible with that proposal in the future.

Can we abstract the storage layer in this story of decentralized radiverse? And then the protocol to share and peer data will be handle somewhat higher in the architectural layer?
So imagine you have a mongoDB and an OrbitDB and a firebase that contains index data, how can we peer them to each other. Maybe it is possible to create a higher protocol on top of that? For orbitDB you also need a node.js part that creates an instance of orbitDB and is forseeing an adress so that all the peers can connect to. /orbitdb/Qmd8TmZrWASypEp4Er9tgWP4kCNQnW4ncSnvjvyHQ3EVSU/first-database
So the orbitDB implementation needs to have that p2p signaling as well. Maybe libp2p library is a good one to use. I know that ipfs has a pubsub protocol baked into it.

So another take can be to develop on top of ipfs and not use orbitDB at all, because radiverse will be a protocol on top of ipfs that brings blockstack.js, gaiahub data p2p to our end users.
Then you need to give up mongoDB ofcourse. But then we could have something like /radiverse/Qmd8TmZrWASypEp4Er9tgWP4kCNQnW4ncSnvjvyHQ3EVSU/first-database
This is a different path and then radiks need to change a lot, this will effect a lot of users right now.

Abstracting away the index, stored to what the application developer wants and then using a library like libp2p, to do the communication to super nodes can maybe do the trick.
Maybe it would be nice to organise a hangout, skype, ... meeting to discuss this further. Everyone that likes to be involved and wants to develop this can be joining.
The main reason why I made this PR is because I don't like the centralization, express & mongoDB part at the moment. I like the way you are defining models, saving them to your gaiahub and then to an index.

@jorishermans is this ready for a full review?

Only the method sendNewGaiaUrl in the orbit-db.indexer.ts is not been implemented because I don't know if that is possible when you create your index in IPFS.

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

 All committers have signed the CLA.


Added How to create a map

To simply explain how to create a map file.

Leave a comment

Hi @Gordonby, I'm your friendly neighborhood Azure Pull Request Bot (You can call me AZPRBOT). Thanks for your contribution!

It looks like you're working at Microsoft (gobyers). If you're full-time, we DON'T require a contribution license agreement.

If you are a vendor, DO please sign the electronic contribution license agreement. It will take 2 minutes and there's no faxing! https://cla.azure.com.

TTYL, AZPRBOT;

Yes, I'm an FTE.

Hi @Gordonby, I'm your friendly neighborhood Azure Pull Request Bot (You can call me AZPRBOT). Thanks for your contribution!

It looks like you're working at Microsoft (gobyers). If you're full-time, we DON'T require a contribution license agreement.

If you are a vendor, DO please sign the electronic contribution license agreement. It will take 2 minutes and there's no faxing! https://cla.azure.com.

TTYL, AZPRBOT;

@Gordonby : Thanks for your contribution to the Azure documentation! The author, @msftman, has been notified to review your proposed change.

This looks okay to me. @msftman is OOF. @MandiOhlinger - Let us know if there are any issues you see. Adding @ggailey777 to overlook this PR.

@Gordonby Thank you for the addition. Looks good. #sign-off

Only the author of the article can use the sign off comment to add the ready-to-merge label.


Ingest streamlit page - introduce state

resolves #1027
*** The pushed code uses dummy ingest and library functions to test failures.

When input dataset as error, ingestion fails
when input version as  error, library fails

Use the drop-down sidebar to select a process:

Ingest Success:

Ingest Fails:

Library Success:

Library Fails:

Ingest and Library Success:

Library Fails after Successful Ingest:

Retry Library Calls (Pressed button Call Library with File s3 Path):
s3 Path auto-filled:

Retry Success:

Retry Fails - Can continue to retry unless click on End Retry:

End Retry: Resets Process

Also - don't worry about the weird failed jobs on pushes - that'll be resolved by @sf-dcp 's pr

This is looking pretty good. I'm going to think a little more about how we maybe can make things look a little clearer (in terms of just the layout of the code), but I'm really happy with this.
Can you go ahead and

keep the call to the dummy archive function for now
add logic to call the next ingest step, as outlined in #1027 ?

I would recommend adding validation logic for dataset_name (ex: replace text field with a dropdown menu) and maybe version

Validation Logic for Input Fields
Following up on @sf-dcp's recommendation, validation logics are likely needed for the input fields (dataset name and version). This could hardly be handled by a dropdown menu, given the very large list of raw datasets we would process. I'm wondering if we should include backend validation logic and if they should be part of this PR? @fvankrieken

There's a handy function dcpy.library.utils.get_all_templates() which returns a list of all dataset names.
I would go ahead and try a dropdown for the dataset name (selectbox in streamlit I think) - streamlit dropdowns are text-searchable. If it feels way too unwieldy, then we could just validate the input in the text box.
Version is a little more complicated, and I'm not sure every version format we use follows the most consistent of formats - I would leave unvalidated for now.

Small request - can the dropdown default to s3 + library?


Calibration canvas is not fixed to screen coordinates

We removed fixing the calibration coordinates to screen coordinates as discussed in #15. Then when we stopped showing the grid by default it became a lot less obvious that the calibration only works for full screen or vice versa. I removed the full screen button from the projection page and added an alert/turn on the grid if the full screen mode is exited by using the escape key or some other method in #196. I think we should attempt fixing the canvas to screen coordinates again though!

I'm confused by this. Are you saying that full screen calibration and normal screen calibration have different scales? Or just different locations? I saw the post in the group about the calibration canvas being a different size in normal mode vs. fullscreen mode. Is that accurate and has that always been the case? If the location moves around, I'd say no big deal, but if the actual scale is off, that's a much bigger problem. It sounds like you've added some measures to help raise awareness of that.
I'm not sure what the benefit of fixing the canvas to the screen coordinates buys us. It definitely creates problems - is there a benefit here I am missing?

@hluedeke if someone calibrates in full screen, then the calibration is only accurate in full screen. It’s been that way since screen based coordinates were removed in #15. At the time, it felt ok removing screen coordinates because there were issues with bottom and right toolbars throwing off the calculations. Plus we had the grid shown by default so it was easy to see that the grid was off. Now I’m sure lots of people have the grid turned off by default so it’s not obvious that the calibration is not accurate when toggling full screen.
We need to switch to screen coordinates but that’s really hard to do with bottom and right toolbars. The only thing I can think to do is calculate the client offset on pointer move/down but it doesn’t work well with tablets because you have to wait for them to tap after toggling full screen.

Question: if the calibration is done in full screen mode, is the calibration then still ok when full screen mode is deactivated when a pattern is open?
Suggestion 1: Could text be added on top of calibration box that says "full screen mode (pic of icon) must be activated for accurate calibration". Then that message disappears when they enter full screen mode. (Maybe repeats when they go back to regular mode on calibration screen?).
Caveats: full screen mode doesn't work for ios devices from my tests, so text wouldn't apply for them,so suggestion 1 not full solution. Also I'm no sure the failsafe of the calibration box being on ever prevented or solved this issue. Once calibrated people have fabric on their mats so many would never see that the calibration box has changed with the full screen issue.
Suggestion 2:
Could a "check calibration" button/process be implemented? This extra button could bring up a dialog box that either explains this full screen issue, or automatically brings the calibration screen to full screen mode of device allows it, tells user to double check that calibration is still accurate, allows user to adjust, and then user clicks "save calibration". This is extra ste, but scale is so essential I don't think people wood be annoyed that there's this double check in place.
Bonus for suggestion 2: as part of the "calibration check" process, the screen could add a diagonal/hypotenuse measurement that user needs to check that ensures they haven't made a measuring error. This is a suggestion I have given to Clinton as well, and I think would go a long way to solve the problem of people using mat measurements that start from 1 instead of 0 that we have seen, and other measuring inaccuracies because they use mat grid instead of tape measure to enter measurements. A diagonal measurement would nicely "force" user to get tape measure to check accuracy, which would then show then any error they have made in their calibration.

OK, reading your message again Courtney, I see answer to my question is no, full screen calibration will not be accurate for pattern projected in regular mode.
But what about the reverse? If calibrated in regular mode, will pattern still be accurate in full screen mode? I'm guessing no, but if it happens to be yes, then best solution would be to not allow full screen mode when calibrating, and just allow it when projecting pattern.

Reading #15 , am I to uderstand that this full screen scale issue is only as a result of the fix for multiple screens? If so, the number of users that have mutiple screens is minuscule comapred to the number of people who are affected by this risk of innacurate scale. I would suggest that the fix for multiple screens be removed, so that there's never a risk of this scale problem happening.

Sorry, I’m having a when it rains it pours sort of day. My cat is at the vets getting her leg amputated, this issue feels horrible, and my daughter was up in the middle of the night so I’m sleep deprived.
The calibration is only accurate in the same mode it was created in so calibrating in full screen, then switching to regular mode will have inaccurate calibration. You can tell if the calibration is accurate if the grid matches your mat in either calibration or projection mode.
I turned off toggling full screen mode when projecting and if someone exits it there is a pop up that explains and opens the grid overlay. Maybe instead I could have the pop up show up anytime full screen is toggled and have it redirect to the calibration page?
I really like the diagonal measurement idea :)
It’s not just because of multiple screens. It was never working well because the browser location data you can get never accounts for the bottom or right side menu bars/keyboard. I’m still not sure how it can be done well. But I’ll look into it more. I think we can at least do a better job of detecting wether or not there is a mismatch between the screen size when calibrating and projecting. We could save the screen size when calibrating and put up a banner when that size doesn’t match when projecting as a stopgap for the time being.

That banner sounds like a good way to warn people! 👍🏻
What a sad situation with your cat! I would be losing sleep too.  Don't worry about all this other stuff, it can all wait.

I'm confused by this. Are you saying that full screen calibration and normal screen calibration have different scales? Or just different locations?

Sorry, I did a bad job responding to this. If the calibration grid does not match the mat grid, as happens when toggling full screen (the grid gets shifted up or down), then the perspective transform is happening on the wrong grid location, so the perspective transform is incorrect and the scale is off. Whenever the calibration grid doesn't match the mat grid, the perspective and scale are off.

I saw the post in the group about the calibration canvas being a different size in normal mode vs. fullscreen mode. Is that accurate and has that always been the case?

Since #15 yes, but it wasn't working well before that either since it didn't take into consideration bottom or right toolbars. I honestly forgot about this issue since I cast from my device I don't use full screen.

That banner sounds like a good way to warn people! 👍🏻

Ok, I'll see what I can do about this.

What a sad situation with your cat! I would be losing sleep too.  Don't worry about all this other stuff, it can all wait.

Thank you :)

In so sorry @courtneypattison 😢 I hope you are able to get some rest tonight, and I hope your cat heals quickly. As @sashasewist said, this stuff can wait! It’s already so useful, and I hope the banner will be enough! I didn’t realize that removing screen coordinates would cause this issue. I appreciate the clarification. Get some rest and worry about this later - you are doing amazing and will get through all this!

I really like the way you have done the banner and limited the full screen button to only being accessible in Calibrate mode. 👍
I can't believe how quick you have done that. Again, please don't worry about PP while you have more important stuff going on.
I will explain to people in the PfS group this change, and manage questions about it, so you don't have to. ❤

Thank you both so much <3

The more I think about this, the less inclined I am to switch to screen coordinates. Although the flow isn't perfect, I think #208 resolves this issue. Here are the limitations that need to be overcome to switch to screen coordinates:

It's possible to get screen coordinates from any pointer event but screen and client coordinates change over time: window position, multiple monitors, DPR, bottom bars, tabs.
Calculating where to draw based on screen coordinates is difficult because all of the aforementioned factors need to be considered
The client offset (screenX - clientX) can be calculated on a pointer event but those are sporadic on touch screens and non-existent for arrow key movements
Even if we prompted users to get a pointer event to calculate the client offset, it would be inaccurate for multiple monitors since the screenX is across multiple monitors


Fix the example section of the cargo generated documentation

Added code tags so that the generated documentation is formatted directly (cargo doc --open).

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

It looks like the restyled job is using an outdated version of Rust, it isn't accepting async fn in rs-matter/src/core.rs:178.


Click to Load module

Task/Issue URL: https://app.asana.com/0/0/1204211084384755/f
Description
This PR adds:

Click to Load module
Plugins to inject and store the relevant config

Steps to test this PR

[ ] Freshly install the app from this branch
[ ] Verify that the click_to_load table is populated with JSON

Current dependencies on/for this PR:

develop

PR #2978   👈

This comment was auto-generated by Graphite.

@joshliebe  is this still valid? please close if it isn’t.


Avoid RuntimeError on Windows due to multiprocessing

Added main function enclosing the code, to avoid RuntimeError from reloading the module (due to multiprocessing) on Windows. Similar to https://github.com/pytorch/tutorials/issues/1661.

Thanks for your valuable code.
But this commit has some conflicts with our current version. It will be very helpful if you re-submit a new pull request based on the latest code.


SPDY Request stuck

I have an Android bugreport in which a user has all communications with a server halted due to what appears to be a hanging SSL handshake. Full report isn't provided due to confidentiality, but I can provide some more information as needed.
Relevant stacks appear to be:
"OkHttp <REMOVED>" prio=5 tid=22 Native
  | group="main" sCount=1 dsCount=0 obj=0x12c07940 self=0xaec4b000
  | sysTid=23547 nice=0 cgrp=bg_non_interactive sched=0/0 handle=0xaef1c800
  | state=S schedstat=( 5023230 434323 20 ) utm=0 stm=0 core=1 HZ=100
  | stack=0xa232a000-0xa232c000 stackSize=1036KB
  | held mutexes=
  kernel: (couldn't read /proc/self/task/23547/stack)
  native: #00 pc 0003b070  /system/lib/libc.so (__pselect6+20)
  native: #01 pc 00016347  /system/lib/libc.so (select+60)
  native: #02 pc 000152fb  /data/app/com.google.android.gms-1/lib/arm/libgmscore.so (???)
  native: #03 pc 000196ff  /data/app/com.google.android.gms-1/lib/arm/libgmscore.so (???)
  native: #04 pc 0207e411  /data/dalvik-cache/arm/data@app@com.google.android.gms-1<EMAIL_ADDRESS>(Java_com_google_android_gms_org_conscrypt_NativeCrypto_SSL_1read__JLjava_io_FileDescriptor_2Lcom_google_android_gms_org_conscrypt_NativeCrypto_00024SSLHandshakeCallbacks_2_3BIII+196)
  at com.google.android.gms.org.conscrypt.NativeCrypto.SSL_read(Native method)
  at com.google.android.gms.org.conscrypt.r.read(SourceFile:698)
  - locked <@addr=0x12c001d0> (a java.lang.Object)
  at okio.Okio$2.read(Okio.java:137)
  at okio.AsyncTimeout$2.read(AsyncTimeout.java:211)
  at okio.RealBufferedSource.request(RealBufferedSource.java:71)
  at okio.RealBufferedSource.require(RealBufferedSource.java:64)
  at okio.RealBufferedSource.readInt(RealBufferedSource.java:217)
  at com.squareup.okhttp.internal.spdy.Spdy3$Reader.nextFrame(Spdy3.java:129)
  at com.squareup.okhttp.internal.spdy.SpdyConnection$Reader.execute(SpdyConnection.java:574)
  at com.squareup.okhttp.internal.NamedRunnable.run(NamedRunnable.java:33)
  at java.lang.Thread.run(Thread.java:818)

"OkHttp ConnectionPool" daemon prio=5 tid=25 TimedWaiting
  | group="main" sCount=1 dsCount=0 obj=0x12c078e0 self=0xaec4ac00
  | sysTid=19849 nice=0 cgrp=bg_non_interactive sched=0/0 handle=0xaec5e980
  | state=S schedstat=(<PHONE_NUMBER>12 7 ) utm=0 stm=0 core=0 HZ=100
  | stack=0xa242e000-0xa2430000 stackSize=1036KB
  | held mutexes=
  at java.lang.Object.wait!(Native method)
  - waiting on <0x3311b349> (a com.squareup.okhttp.ConnectionPool)
  at com.squareup.okhttp.ConnectionPool.performCleanup(ConnectionPool.java:304)
  - locked <0x3311b349> (a com.squareup.okhttp.ConnectionPool)
  at com.squareup.okhttp.ConnectionPool.runCleanupUntilPoolIsEmpty(ConnectionPool.java:241)
  at com.squareup.okhttp.ConnectionPool.access$000(ConnectionPool.java:54)
  at com.squareup.okhttp.ConnectionPool$1.run(ConnectionPool.java:97)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1112)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:587)
  at java.lang.Thread.run(Thread.java:818)

"Okio Watchdog" daemon prio=5 tid=27 Waiting
  | group="main" sCount=1 dsCount=0 obj=0x12c076a0 self=0x9cd39c00
  | sysTid=12193 nice=0 cgrp=bg_non_interactive sched=0/0 handle=0x9b02f280
  | state=S schedstat=( 183982797 342420840 5954 ) utm=4 stm=14 core=1 HZ=100
  | stack=0x99859000-0x9985b000 stackSize=1036KB
  | held mutexes=
  at java.lang.Object.wait!(Native method)
  - waiting on <0x03943ee4> (a java.lang.Class<okio.AsyncTimeout>)
  at okio.AsyncTimeout.awaitTimeout(AsyncTimeout.java:297)
  - locked <0x03943ee4> (a java.lang.Class<okio.AsyncTimeout>)
  at okio.AsyncTimeout.access$000(AsyncTimeout.java:40)
  at okio.AsyncTimeout$Watchdog.run(AsyncTimeout.java:272)

"Thread-27808" prio=5 tid=23 Waiting
  | group="main" sCount=1 dsCount=0 obj=0x12c09120 self=0x9cd38800
  | sysTid=8876 nice=0 cgrp=bg_non_interactive sched=0/0 handle=0xb491f100
  | state=S schedstat=(<PHONE_NUMBER><PHONE_NUMBER> 11998 ) utm=249 stm=131 core=0 HZ=100
  | stack=0x9b55d000-0x9b55f000 stackSize=1036KB
  | held mutexes=
  at java.lang.Object.wait!(Native method)
  - waiting on <0x2673c277> (a com.squareup.okhttp.internal.spdy.SpdyConnection)
  at com.squareup.okhttp.internal.spdy.SpdyConnection.writeData(SpdyConnection.java:314)
  - locked <0x2673c277> (a com.squareup.okhttp.internal.spdy.SpdyConnection)
  at com.squareup.okhttp.internal.spdy.SpdyStream$SpdyDataSink.write(SpdyStream.java:499)
  at okio.RealBufferedSink.emitCompleteSegments(RealBufferedSink.java:156)
  at okio.RealBufferedSink.write(RealBufferedSink.java:70)
  at com.squareup.okhttp.RequestBody$1.writeTo(RequestBody.java:72)
  at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:787)
  at com.squareup.okhttp.internal.http.HttpEngine.readResponse(HttpEngine.java:652)
  at com.squareup.okhttp.Call.getResponse(Call.java:263)
  at com.squareup.okhttp.Call$ApplicationInterceptorChain.proceed(Call.java:219)
  at com.squareup.okhttp.Call.getResponseWithInterceptorChain(Call.java:192)
  at com.squareup.okhttp.Call.execute(Call.java:79)
  at <APPCODE>
  at <APPCODE>
  at <APPCODE>
  at <APPCODE>
  at <APPCODE>
  at <APPCODE>
  at <APPCODE>
  at android.os.Handler.dispatchMessage(Handler.java:102)
  at android.os.Looper.loop(Looper.java:135)
  at <APPCODE>

I should have observed timeouts/errors as I have:
client.setConnectTimeout(2, TimeUnit.SECONDS);
client.setReadTimeout(4, TimeUnit.SECONDS);
client.setWriteTimeout(2, TimeUnit.SECONDS);

Looking at the rest of my logs here, the request was initiated before the logs started at around 11am, with the last log at around 1pm. The service making this request was created and initiated it therefore over 2 hours before. I also have in the logs many wifi and data connection losses and connects, so we would have expected an error or timeout by now.

Thanks for the complete bug report. Made it easy to build a testcase & write a fix.

Awesome, I completely missed that. Thanks :)

Ran into a similar and perplexing issue on a build that should have the above fix in it. Truncated thread dump:
"downloader-pool-thread-1" prio=5 tid=62 NATIVE
| group="main" sCount=1 dsCount=0 obj=0x44578580 self=0x622cc470
| sysTid=13979 nice=10 sched=0/0 cgrp=apps/bg_non_interactive handle=1646803144
| schedstat=(<PHONE_NUMBER><PHONE_NUMBER> 32938 ) utm=180 stm=104 core=0
#00  pc 0000ccb8  /system/lib/libc.so (select+20)
#01  pc 0001f383  /system/lib/libjavacore.so
#02  pc 0002077f  /system/lib/libjavacore.so
#03  pc 0001de70  /system/lib/libdvm.so (dvmPlatformInvoke+112)
#04  pc 0004d0c3  /system/lib/libdvm.so (dvmCallJNIMethod(unsigned int const*, JValue*, Method   const*, Thread*)+394)
#05  pc 00000214  /dev/ashmem/dalvik-jit-code-cache (deleted)
at org.apache.harmony.xnet.provider.jsse.NativeCrypto.SSL_read(Native Method)
at org.apache.harmony.xnet.provider.jsse.OpenSSLSocketImpl$SSLInputStream.read(OpenSSLSocketImpl  .java:651)
at okio.Okio$2.read(Okio.java:137)
at okio.AsyncTimeout$2.read(AsyncTimeout.java:211)
at okio.RealBufferedSource.read(RealBufferedSource.java:50)
at com.squareup.okhttp.internal.http.HttpConnection$FixedLengthSource.read(HttpConnection.  java:418)
at okio.RealBufferedSource.read(RealBufferedSource.java:50)
at okio.RealBufferedSink.writeAll(RealBufferedSink.java:102)

The symptoms of this behavior are downloads that simply hang indefinitely. We aren't explicitly configuring OkHttp to have timeouts, but from reading the code it seems like it has default values, so I would expect a timeout to trigger eventually.
So far we've seen this behavior on a Samsung Note 2 and a Samsung Galaxy S3. It doesn't reproduce very consistently, and we're not sure yet if it's possibly an issue in our app code or something deeper in the stack.


no pv_rcnn_8369.pth?

when i try to run the demo, but i can't find the pre-train weight pv_rcnn_8369.pth. so, where can i find the file pv_rcnn_8369.pth?

You can download it from model zoom


Excellent work! Let me know if you need me.

@pestopancake , excellent work on this addon!! 🎉🎉🎉

I really REALLY like it. And I think a lot of Backpack developers will too.
I'll start promoting this as a recommended Backpack addon, great job!
I've just submitted a few PRs and ideas too, let me know what you think. Of course, you know what's best for your package, what you want and what's out of scope. Feel free to say "no" to any of them.
I've also started watching this repo for all activity, so if you need my input on anything, just mention me.
Cheers!
PS. Sorry for taking so long to take a look at it... slipped through the cracks...

Also, I'd love to promote this to our community. I'm going to track doing that inside this issue here - https://github.com/Laravel-Backpack/addons/issues/25
Related to that... how would you like to create a small Backpack article, for our blog, detailing how someone can use your package (and why)? Sort of a "show-and-tell" with more images or GIFs, so we make people really want to use it? If we add an article to our blog, you'd get in the inbox of our article digest subscribers. It's a small list right now, just about 300 people, but... it's a start! The more downloads this has, the more reputation it can accrue, and more people will download it. That's how this works, I'm afraid.
If so, please write a google doc (or markdown gist, or anything collaborative really) and send it to my email address (cristian.tabacitu@backpackforlaravel.com), I'd love to help you out with it, then post it to our blog, so more people find out about your package.
Keep 'em coming!
Cheers.


Can you explain in detail how to use it?

I found 31049740.blk but I don't know how to use it

Extract it using File -> Extract File in AssetStudio-CAB, then used the resulted .bin file in this tool, should work.
[NOTE: make sure key is set to 0 in Export Options]

thanks for the answer


tiscamera example doesn't work

I use camera type "DMM 37AX296-ML"
When I used the example 6 from the website(https://www.theimagingsource.com/en-us/documentation/tiscamera/examples.html). I received the following error:
Traceback (most recent call last):
File "//test.py", line 6, in
gi.require_version("Gst", "1.0")
File "/usr/lib/python3/dist-packages/gi/init.py", line 126, in require_version
raise ValueError('Namespace %s not available' % namespace)
ValueError: Namespace Gst not available

And when I download the install package tiscamera, there is no examples in it.

May I get the instructions to fix the code and run the example on my raspberrypi successfully?
Screenshots
computer used (please complete the following information):

OS: [raspbian]
Camera  model you use
(DMM 37AX296-ML)
tiscamera version (tiscamera Linux 32 Bit Camera Library for ARMHF Architecture --version<IP_ADDRESS>39)

If your bug report has potentially sensitive information, please write us directly at<EMAIL_ADDRESS>.

After I install the gstreamer package the example runs. it has the image.
But the "trigger" Botton cannot work and when I press "enter" to trigger the image the error comes as "the property is not implemented"
May I have the solution of the problem?

I am very sorry, but your camera does not have trigger support. The documentation says:

Since your model still has the name "37AX..." I must assume, it is board revision 1.
When did you got this camera?
Stefan

I'm sorry for the typing mistake before. The type of my camera is DMM 36AX296-ML, as the form you sent to me, it should have the trigger mode. But it still reports error when I try to trigger  it in example 6.
MaxexTian

Hi
Actually I bought DMM 36AX296-ML on Jun 16th 2023. we purchased it because the website stated it has trigger capability. we were given a box with DMM 37AX296-ML. We were told that the DMM 36 and DMM 37 are the same camera and just difference in inventory vs website enumeration. If the DMM 37 is not capable for a trigger, then an RMA process needs to be started.
Estimate_55618_Redacted.pdf
Gmail - Imaging Source 36 vs. 37_Redacted.pdf

Hello
This is a bad situation. Can you have a look on the board revision of the sensor board? If version 1, then there is no trigger and we have to make an RMA.
I am very sorry for this
Stefan

Hi
Here are the pictures of the board version and the identification of the product.
If there is no trigger mode on this board, please contact me and make an RMA soon.
Thanks for your help!
MaxexTian

Hello
it is "R1.00", which means revision 1.0. Thus, please contact your camera dealer.
Stefan

Closed due to inactivity.


restic should sanitize filenames in output

Output of restic version
restic 0.9.5 compiled with go1.12.4 on linux/amd64
How did you run restic exactly?
$ truncate -s 1M $'x\e[31m\nred\nis\nbeautiful\nand\nnewlines\nare\nannoying\n'
$ restic -r repo init
$ restic -r repo backup x*
$ restic -r repo ls latest

What backend/server/service did you use to store the repository?
not relevant
Expected behavior
Output not messing up the terminal.
Actual behavior
I got the following output in the terminal with parts of it being red due to the escape sequence included in the filename:
$ restic -r repo backup x*
repository 5d1e95b3 opened successfully, password is correct
[0:00] 1 files 1024.000 KiB, total 1 files 1024.000 KiB, 0 errors
/x
red
is
beautiful
and
newlines

[0:00] 1 files 1024.000 KiB, total 1 files 1024.000 KiB, 0 errors
/x
red
is
beautiful
and
newlines
Files:           1 new,     0 changed,     0 unmodified
[0:00] 1 files 1024.000 KiB, total 1 files 1024.000 KiB, 0 errors
/x
red
is
beautiful
and
newlines
Dirs:            0 new,     0 changed,     0 unmodified
Added to the repo: 512.500 KiB

processed 1 files, 1024.000 KiB in 0:00
snapshot 0e0b6872 saved
$ restic -r repo ls latest
repository 5d1e95b3 opened successfully, password is correct
snapshot 0e0b6872 of [/tmp/tmp.XgxPfBNlHs/x
red
is
beautiful
and
newlines
are
annoying
] filtered by [] at 2019-04-30 23:45:43.594055711 +0200 CEST):
/x
red
is
beautiful
and
newlines
are
annoying

Steps to reproduce the behavior
See "How did you run restic exactly?"
Do you have any idea what may have caused this?
restic outputs filenames without any kind of sanitization so any included escape sequences are interpreted by the terminal and special characters like \n can mess up the output.
Do you have an idea how to solve the issue?
Sanitize filenames when outputting them to a terminal.
Did restic help you or made you happy in any way?
Yes, it's a pleasure to use, especially when compared to some enterprise™ backup "solutions".

Oh, good point! This should be something our terminal abstraction should handle. Thanks!


I cannot get the result in the paper on the voc 2007 dataset.

Hi, I didn't change configs but get a much lower result. I notice that:
Adaptive config changes:
effective_batch_size: 2 --> 4
NUM_GPUS:             1 --> 1
IMS_PER_BATCH:        2 --> 1
Adjust BASE_LR linearly according to batch_size change:
BASE_LR: 0.001 --> 0.0005
Adjust SOLVER.STEPS and SOLVER.MAX_ITER linearly based on effective_batch_size change:
SOLVER.STEPS: [0, 35000] --> [0, 17500]
SOLVER.MAX_ITER: 500000 --> 250000
Number of data loading threads: 4

Is it right? Does it mean my batch size is 4, which is 2 in the paper?

Hi, thanks for trying my code. Unfortunately, this is a known issue with my and PCL PyTorch code.
You can enable the fixed seed in the training script and/or try to retrain the model.
Anyway, if you enable the fixed seed, the results between different training sections using the same seed still differ.  I am investigating this nondeterminism present in my code, and I am not sure how to solve this problem yet :|.
If any of you guys have experience with PyTorch and reproducibility, help would be very appreciable =)

Hi, I returned the code to an old version. Now the final mAP is really near to the results reported in the paper. I retrained the model with the same seed five times, and the final mAP oscillates between 49.0 and 49.9.

Hi, I returned the code to an old version. Now the final mAP is really near to the results reported in the paper. I retrained the model with the same seed five times, and the final mAP oscillates between 49.0 and 49.9.

thank you very much~


Tweak client creation

According to https://github.com/kubernetes/kubernetes/pull/43027

one of the Travis CI jobs has failed: https://travis-ci.org/atlassian/smith/jobs/212919938


Copy Error: Start is offset by 256 in Vello

Since 0.8.1 (i.e. with #79 fixed), I can't run wgpu-profiler on Vello, because of the:
[2024-09-12T10:10:03.568Z ERROR wgpu::backend::wgpu_core] Handling wgpu errors as fatal by default
thread 'main' panicked at /home/djmcnab/.cargo/registry/src/index.crates.io-6f17d22bba15001f/wgpu-22.1.0/src/backend/wgpu_core.rs:3411:5:
wgpu error: Validation Error

Caused by:
  In CommandEncoder::copy_buffer_to_buffer
    Copy error
      Copy of 256..544 would end up overrunning the bounds of the Destination buffer of size 288

stack backtrace:
   0: rust_begin_unwind
   1: core::panicking::panic_fmt
   2: core::ops::function::Fn::call
   3: wgpu::backend::wgpu_core::ContextWgpuCore::handle_error
   4: <wgpu::backend::wgpu_core::ContextWgpuCore as wgpu::context::Context>::command_encoder_copy_buffer_to_buffer
   5: <T as wgpu::context::DynContext>::command_encoder_copy_buffer_to_buffer
   6: wgpu::CommandEncoder::copy_buffer_to_buffer
   7: wgpu_profiler::profiler::GpuProfiler::resolve_queries
   8: vello::wgpu_engine::WgpuEngine::run_recording
   9: vello::Renderer::render_to_surface
  10: <with_winit::VelloApp as winit::application::ApplicationHandler<with_winit::UserEvent>>::window_event
  11: core::ops::function::impls::<impl core::ops::function::FnMut<A> for &mut F>::call_mut
  12: winit::platform_impl::platform::wayland::event_loop::EventLoop<T>::pump_events
  13: winit::platform_impl::platform::wayland::event_loop::EventLoop<T>::run_on_demand
  14: with_winit::main
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

This can be reproduced in https://github.com/linebender/vello/pull/687 using:
> cargo run -p with_winit

then pressing G

@DJMcNab thanks for the clean repro. Was able to get it into the regression test and fix it proper this time. Hopefully :).
Published 0.18.2 containing the fix!


Remove-ProgressBar throws an error

I'm not sure if it's doing anything at the moment, but it is throwing an error every time I use it and the variable isn't being cleared

Issue is with Dispose() depth: a depth of 2 works when testing directly, but when loaded correctly as a module, it needs to be bumped to 3.
I'm sure there's a better way to do this that would be more dynamic, but for now, this will work.


Fixed #5871 -- Do not show plugins the user can't add

Links to related discussion
#5871

Coverage remained the same at 82.688% when pulling 698af9430291fb6f1e9c13f4caaa9010d70e68d6 on haricot:patch-2 into 0d25012fce3743130a4c94418c523faa568f2a76 on divio:release/3.4.x.

Coverage remained the same at 82.688% when pulling e05498d4cc0e362a2a84c3a8e939bd437e3e0081 on haricot:patch-2 into 0d25012fce3743130a4c94418c523faa568f2a76 on divio:release/3.4.x.

Coverage remained the same at 82.688% when pulling e05498d4cc0e362a2a84c3a8e939bd437e3e0081 on haricot:patch-2 into 0d25012fce3743130a4c94418c523faa568f2a76 on divio:release/3.4.x.

Coverage remained the same at 82.688% when pulling c3201e0099a9b680aa107c1a4d01aca87bf37254 on haricot:patch-2 into 0d25012fce3743130a4c94418c523faa568f2a76 on divio:release/3.4.x.

Coverage remained the same at 82.688% when pulling c3201e0099a9b680aa107c1a4d01aca87bf37254 on haricot:patch-2 into 0d25012fce3743130a4c94418c523faa568f2a76 on divio:release/3.4.x.

Hello @haricot,
Thanks for fixing this! Here is my feedback:
Because the get_toolbar_plugin_struct function takes a list of plugins and returns their toolbar code, I suggest to not do the permissions check here. The caller is the one responsible for passing the plugins that will actually be displayed. In this case the caller is render_editable_placeholder.
Here it's much easier to check for permissions because you have the user object attached to the renderer, thus no need to use the thread user.
So you can modify the render_editable_placeholder function like so:
plugins = [plugin for plugin in self.registered_plugins if has_plugin_permission(self.request.user, plugin.value, 'add')]
plugin_menu = get_toolbar_plugin_struct(
    plugins=plugins,
    slot=placeholder.slot,
    page=placeholder.page,
)

To avoid calling has_plugin_permission out of scope, you could use functools.partial so:
from functools import partial

can_add_plugin = partial(has_plugin_permission, user=self.request.user, permission_type='add')
plugins = [plugin for plugin in self.registered_plugins if can_add_plugin(plugin_type=plugin.value)]
plugin_menu = get_toolbar_plugin_struct(
    plugins=plugins,
    slot=placeholder.slot,
    page=placeholder.page,
)

Many thanks @czpython ! :)  It is very instructive. It works well !
Small reminders regarding the configuration of the rights of the plugins:
For static_placeholder, we must configure them in the site administration interface> Authentication and Authorization> group or user.
On the other hand for {% placeholder "foo"%}, in superuser we must also think of adding in the site administration> DJANGOCMS> Pages global permissions.> rights to a group or user.
Then we have to reload the page manually just after the rights configuration and this will not show the plugins if user does not have the permissions.
Otherwise the official doc is fine. permissions

Coverage remained the same at 82.688% when pulling 90ff0592fe6b0ba71cdd51068996ea7218cfff34 on haricot:patch-2 into 0d25012fce3743130a4c94418c523faa568f2a76 on divio:release/3.4.x.

Coverage remained the same at 82.688% when pulling f974fc9cf1406b5fe185d52e249e37e7f272ccf2 on haricot:patch-2 into 0d25012fce3743130a4c94418c523faa568f2a76 on divio:release/3.4.x.

Thank you for your constructive remarks!
I hope this is the proper implementation of the test.
Sorry for the Travis test repeatedly, I should probably test it locally and in a branch that does not bind to the PR.

I'm not sure if adding a specific user with a single permission in test_plugins.py is a good idea on my part. ^^

Coverage remained the same at 82.688% when pulling c0558fe42fe0a3948a05719ccba90767d4e8d496 on haricot:patch-2 into 0d25012fce3743130a4c94418c523faa568f2a76 on divio:release/3.4.x.

Coverage remained the same at 82.688% when pulling 1711ca9330930044c5886043e0c14c4d6b07d14d on haricot:patch-2 into 0d25012fce3743130a4c94418c523faa568f2a76 on divio:release/3.4.x.

Coverage remained the same at 82.688% when pulling 1711ca9330930044c5886043e0c14c4d6b07d14d on haricot:patch-2 into 0d25012fce3743130a4c94418c523faa568f2a76 on divio:release/3.4.x.

Coverage remained the same at 82.688% when pulling 29f33a6eabcb058b28a2e218353b137756217b76 on haricot:patch-2 into 0d25012fce3743130a4c94418c523faa568f2a76 on divio:release/3.4.x.

The test function render_placeholder had crossed my mind, it's much clearer now.
I hope this is not a problem, i had to change  :
from django.template.context import Context
to
from sekizai.context import SekizaiContext
Because that would return this error :
django.template.exceptions.TemplateSyntaxError: You must enable the 'sekizai.context_processors.sekizai' template context processor or use 'sekizai.context.SekizaiContext' to render your templates.
Nevertheless the context processor 'sekizai' look well loaded :
settings.TEMPLATES[0]['OPTIONS']['context_processors']
['django.contrib.auth.context_processors.auth', 'django.contrib.messages.context_processors.messages', 'django.template.context_processors.i18n', 'django.template.context_processors.debug', 'django.template.context_processors.request', 'django.template.context_processors.media', 'django.template.context_processors.csrf', 'cms.context_processors.cms_settings', 'sekizai.context_processors.sekizai', 'django.template.context_processors.static'
```]

Thanks again for your help, you did everything, I hope to do better next time.

Thanks @haricot!


644-755

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 29.93%. Comparing base (e312ec3) to head (a180dbf).
Report is 2 commits behind head on develop.

Additional details and impacted files
@@             Coverage Diff             @@
##           develop      #20      +/-   ##
===========================================
+ Coverage    24.13%   29.93%   +5.80%
===========================================
  Files           55       32      -23
  Lines          750      932     +182
  Branches       180        0     -180
===========================================
+ Hits           181      279      +98
- Misses         569      653      +84

Flag
Coverage Δ

compliance-api
29.93% <ø> (?)

compliance-web
?

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Enable the use of staticfiles finder in compressor when it is installed

I ran into and issue with my AWS / S3 deployment where it was not finding the files until I applied this fix

Thanks a lot for this :)


#5-added-route-for-json-data-Olus

Change

create route to get jobs

reason

so client can request jobs, to confirm working connection, to display jobs

Deliverable

[x] can request data from the server with a get request using postman or other tools.

Related to
Fixes #5

[x] created route for json

Checklist:

[ ] My code follows the style guidelines of this project
[x] I have carefully reviewed my own code
[x] I have tested my code locally to make sure it does what is intended
[x] I have commented my code
[ ] I have updated any documentation

To test locally

you need a json file in the root folder with data or
create a json file at the location that has been commented out and uncomment the import statement.

Thanks @OlushoreOdude. Looks good to me.


Click event on TextMarker

I'm creating text markers within CodeMirror but I can't seem to find a good way to detect click events within the markers. CM doesn't seem to provide access to the DOM node which makes sense. Therefore is there a good way to catch click events within a marker? I've tried beforeCursorEnter, which strangely is triggered on click but is called twice. I've also tried cm.on(marker, 'mousedown', fn) with no luck. Could someone shed some light on this?

The best way to handle this is to register a mousedown handler on editor.getWrapperElement(), and in there, use the coordsChar method to figure out what text was clicked, and then the findMarksAt method to figure out whether there's a marker you're interested at at that position.

Posting here for others who care to do something similar. Everything works great, thanks @marijnh!
 cm.getWrapperElement().onmousedown = function(e) {
    var lineCh = _cm.coordsChar({ left: e.clientX, top: e.clientY });
    var markers = _cm.findMarksAt(lineCh);
    if (markers.length === 0) { return; }
    ... do stuff with markers ...


Development

:warning: Please install the  to ensure uploads and comments are reliably processed by Codecov.
Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 96.30%. Comparing base (8f70c10) to head (9a5149d).

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #210      +/-   ##
==========================================
+ Coverage   96.21%   96.30%   +0.08%
==========================================
  Files           5        5
  Lines         476      487      +11
==========================================
+ Hits          458      469      +11
  Misses         18       18

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


[Bug] tests/python/contrib/test_popen_pool.py::test_popen_pool_executor_async is flaky

This test (from #8851) seems flaky by design, does it really matter which task finishes first in absolute time?
example failure on main:
https://ci.tlcpack.ai/blue/organizations/jenkins/tvm/detail/main/2391/pipeline
older PR failures:
https://ci.tlcpack.ai/blue/organizations/jenkins/tvm/detail/PR-9802/11/
https://ci.tlcpack.ai/blue/organizations/jenkins/tvm/detail/PR-9909/5/
cc @tqchen @vinx13 @shingjan

the timeout parameter could be the source of flakiness.

Which one finishing first doesn't really matter, it is merely to show that they are concurrent. I think it is fine to remove this test case. @shingjan would you like to send a PR?

PR sent out here: https://github.com/apache/tvm/pull/10160 @vinx13 @driazati


fix(docs): fix layout in documentation after #11380

I have just checked the documentation after my previous PR #11380 was merged...unfortunately I broke the layout (see: https://docs-website-1dvlu3ird-acryldata.vercel.app/docs/how/restore-indices/) , because I have forgot the closing colons in the Markdown...this PR is fixing this.
(I have not expected the previous PR to be merged that fast...I wanted to check the layout this morning to make sure everything is right...sorry! 😁)
Checklist

[x] The PR conforms to DataHub's Contributing Guideline (particularly Commit Message Format)
[x] Links to related issues (if applicable)
[x] Tests for the changes have been added/updated (if applicable)
[x] Docs related to the changes have been added/updated (if applicable). If a new feature has been added a Usage Guide has been added for the same.
[x] For any breaking change/potential downtime/deprecation/big changes an entry has been made in Updating DataHub

Thanks!


Thumbnail Card doesn't render correctly in Skype

It works fine in the emulator, but when I deploy it renders as a picture link I need to open - once clicked, it navigates to Skype Online.
Bot ID: 865c519c-ef60-4db4-9f83-fb88e077fc81
The bot is located here: https://homeadvisortestbot.azurewebsites.net/api/messages
I'm fairly sure I'm setting the ContentType attribute correctly, but if not, an enum would be nice and provide some direction.

Activity replyToConversation = activity.CreateReply("Should go to conversation, with a thumbnail card");
replyToConversation.Recipient = activity.From;
replyToConversation.Type = "message";
replyToConversation.Attachments = new List<Attachment>();
List<CardImage> cardImages = new List<CardImage>();
cardImages.Add(new CardImage(url: "https://upload.wikimedia.org/wikipedia/commons/f/ff/Aminah_Cendrakasih%2C_c._1959%2C_by_Tati_Photo_Studio.jpg"));
List<CardAction> cardButtons = new List<CardAction>();
CardAction plButton = new CardAction() {
    Value = "https://en.wikipedia.org/wiki/Pig_Latin",
    Type = "openUrl",
    Title = "WikiPedia Page"
};
cardButtons.Add(plButton);
ThumbnailCard plCard = new ThumbnailCard() {
    Title = "I'm a thumbnail card",
    Subtitle = "Pig Latin Wikipedia Page",
    Images = cardImages,
    Buttons = cardButtons
};
Attachment plAttachment = plCard.ToAttachment();
plAttachment.ContentType = "application/vnd.microsoft.card.hero";

replyToConversation.Attachments.Add(plAttachment);
APIResponse reply = await connector.Conversations.SendToConversationAsync(replyToConversation);

You will need to use Skype Developer web app for v3 bots. http://docs.botframework.com/en-us/skype/getting-started/#navtitle

Developer version of the Skype Web App

You should test Skype bots using the developer version of the Skype Web App until updated Skype apps for desktop and mobile are available at the end of July.

Go to https://web.skype.com
Sign in using your Skype credentials
Copy and paste the following URL into the address bar of the browser https://web.skype.com/en/?ecsoverride=developer

Thanks, buddy!
Do you have any idea if any of the V3 stuff will be available within Facebook or Slack integrations?

It is supported today.


Queryability of dataframe attribute columns

Parent context: #106.
Context:

Users are going to want to have unicode values in their obs/var columns
Unicode values are not currently queryable in the TileDB query-condition logic

Error message: tiledb.cc.TileDBError: [TileDB::QueryCondition] Error: Clause non-empty attribute may only be var-sized for ASCII strings: cell_type

Workaround for the near term:

Force certain “key” dataframe columns (or maybe all columns) to be stored as ASCII
At write time, this works — "α,β,γ" stores as "\xce\xb1,\xce\xb2,\xce\xb3"
At read time: since SOMA is an API: utf8-decode those strings when a query is done & give the user back "α,β,γ"

Nothing more to do here.
When we have true Unicode values on disk, that will be an internal change, and existing unit-test cases will ensure we don't have a regression.


Batches generated from python package are named None

I published something using roboflow-python and the batch name was None.

import roboflow
rf = roboflow.Roboflow()
project = rf.workspace().project("PROJECT_ID")
project.upload(image_path="YOUR_IMAGE.jpg")

Not sure this is the best way. The upload_image at roboflowpy.py takes an dict as an argument, the best thing would be to refactor it to be more explicit of what's inside of it
https://github.com/roboflow/roboflow-python/pull/278


Forbidden lands v1.73 update - Brazilian Portuguese translation added (thank you Teuri)

Changes / Comments

Brazilian Portuguese translation added (thank you Teuri)
needed to change html data-i18n and translation,json to differentiate the use of "melee" as a skill vs melee as a range increment.
updated all language files to include new keys

Roll20 Requests
Comments are very helpful for reviewing the code changes. Please answer the relevant questions below in your comment.

[x] Does the pull request title have the sheet name(s)? Include each sheet name.
[ ] Is this a bug fix?
[ ] Does this add functional enhancements (new features or extending existing features) ?
[ ] Does this add or change functional aesthetics (such as layout or color scheme) ?
[ ] If changing or removing attributes, what steps have you taken, if any, to preserve player data ?
[ ] If this is a new sheet, did you follow Building Character Sheets standards ?

If you do not know English. Please leave a comment in your native language.

Hello! Your Pull Request includes changes to translation files. We will not deny your Pull Request, but we would prefer sheet contributors use Crowdin for translations. Please email Cassie at<EMAIL_ADDRESS>and she will get you an invite to our Crowdin within 48 hours. Be sure to include the languages you would like to translate, Please use that for future translation updates! Thanks for all you do!


URGENT fix required to link on this page

[Enter feedback here]
Under Additional Resources section there is a link to Official GDPR site. Click it, it's probably not the site you thought you were looking for :) :) :)

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 846e96c4-bb7a-f267-e099-1cbe76be5132
Version Independent ID: 1e9e6e32-da47-f24e-e0f6-0929b566d6c7
Content: GDPR data requests for Lifecycle Services (LCS) - Finance & Operations | Dynamics 365
Content Source: articles/fin-ops-core/dev-itpro/gdpr/gdpr-lcs.md
Service: dynamics-365-cross-app
Product: ****
Technology: ****
GitHub Login: @josaw1
Microsoft Alias: josaw

Thank you for the correction. This fix will go live today.


liveshare - easiest way for people to follow along

We say that we're going to use liveshare: what is the easiest way for people to follow along? (http://vscode.dev/ ?)
Perhaps we can even share a URL at the beginning of the tutorial that people can simply click on and follow along without any other setup?

fixed in 71ae6a536ed195c726c1ed335aabc1e3309e612d


Remove quorum-mainnet-launcher

Fixes compilation errors (dependency not found)
https://app.circleci.com/pipelines/github/hyperledger/besu/21741/workflows/75a54db3-8824-4caf-87b8-bad4d63050fc/jobs/134348
Execution failed for task ':downloadLicenses'.
> Could not resolve all dependencies for configuration ':acceptance-tests:dsl:runtimeClasspath'.
   > Could not find net.consensys.services:quorum-mainnet-launcher:1.0.1.
     Required by:
         project :acceptance-tests:dsl > project :besu

Don't think we need to keep this ... plenty of mainnet guides for configuration files
would need to have dedicated time to make useful for PoS

Launcher docs - https://besu.hyperledger.org/en/stable/public-networks/get-started/start-node/?h=launcher#besu-launcher


New Rules for Packages

New rules recently presented for this awesome list of awesome Laravel;

I have been inundated with a large number of pull requests after Taylor Otwell retweeted a link to this repo. Starting now, I will be adding links to the "Popular Packages" section, only if the package has received more than 200 stars on Github. Because of this pre-requisite, a lot of helpful packages will fall through the cracks – but I think this fair to everyone involved. Apologies for the inconvenience.

Instead I think the points below will make it easier to choose which packages that should be added to this list or not. IMO, the downloads count and/or the number of stars you've on GitHub doesn't say anything about how good the package. For example, your package isn't awesome if you don't have any tests.

Use PSR-4 autoloader.
Adhere to PSR-2 as the coding style guide.
Listed on Packagist.
Has unit tests. Aim for at least 80% coverage in version 1.
DocBlock all the things.
Use Semantic Versioning to manage version numbers.
Keep a Changelog.
Use Travis-CI to automatically check coding standards and run tests.
Have an extensive README.
Exclude non-essential files in .gitattributes.

Note that this is taken from http://thephpleague.com/
Started in #105.

This is a good starting point. Thanks for the help!
Now I lower the limit of Github stars required to get listed - Let's make it 100 stars.

I think we should lower it even more, maybe below 50? Lets take Laravel Fractal which is built by @freekmurze. That package is awesome, it follows all the guidelines above. Currently the package (at the time of this comment) has 34 downloads and 42 stars on GitHub. Keeping 100 stars would mean that package wouldn't make it on this list. Even though it is well written, well documented and is built by trusted Laravel developers who makes a lot of good packages.

Create a CONTRIBUTING.md file and put these rules in it.

@arcanedev-maroc That is a good idea :+1: We just need to discuss the rules first.

@arcanedev-maroc Yup! Will do this shortly.

@chiraggude I've created a pull request in #119

https://github.com/thekordy/ticketit


Update deploy-zerto-disaster-recovery.md

Zerto Product manager here, removing message that was set to expire today, as well as updating links to the new version of Zerto's documentation.

@jjaygbay1
Can you review the proposed changes?
Important: When the changes are ready for publication, adding a #sign-off comment is the best way to signal that the PR is ready for the review team to merge.
#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team


Can't create a graphmap with String node identifiers

The unit tests for graphmap appear to use &str or integral types for the node identifier type.
In my own application it is most useful to have String or similar for the node identifiers which are discovered (with file input) at run time.
Unfortunately, String does not implement the NodeTrait trait (which equals Copy + Ord + Hash).  Why is NodeTrait so restrictive?  Wouldn't Clone + Ord + Hash be sufficient (with some minor adjustments in the code)? Is there some simple answer to this which I don't know?
I've tried making a tweak to NodeTrait in a clone of the repo, but I am not experienced enough to track down all the breakages and fix them.
[Pardon me for putting this question here as an issue, but it is not apparent where general questions like this should go.]

To be clear, this is by design. it's how GraphMap is, so it's not a bug. Sure, it would be neat to implement data structures with other features.


ModuleNotFoundError: No module named 'bert_dp'

my code is :
from deeppavlov import build_model, configs
config_path = r"D:\code\python\DeepPavlov-master\tests\test_configs\squad\squad_zh_bert_zh.json"
model = build_model(config_path, download=False)
model(['DeepPavlov is library for NLP and dialog systems.'], ['What is DeepPavlov?'])
but i get an error:
[nltk_data] Error loading punkt: <urlopen error [Errno 11004]
[nltk_data]     getaddrinfo failed>
[nltk_data] Error loading stopwords: <urlopen error [Errno 11004]
[nltk_data]     getaddrinfo failed>
[nltk_data] Error loading perluniprops: <urlopen error [Errno 11004]
[nltk_data]     getaddrinfo failed>
[nltk_data] Error loading nonbreaking_prefixes: <urlopen error [Errno
[nltk_data]     11004] getaddrinfo failed>
Traceback (most recent call last):
File "D:/code/python/DeepPavlov-master/tests/squad.py", line 15, in
model = build_model(config_path, download=False)
File "D:\code\python\DeepPavlov-master\deeppavlov\core\commands\infer.py", line 62, in build_model
component = from_params(component_config, mode=mode, serialized=component_serialized)
File "D:\code\python\DeepPavlov-master\deeppavlov\core\common\params.py", line 95, in from_params
obj = get_model(cls_name)
File "D:\code\python\DeepPavlov-master\deeppavlov\core\common\registry.py", line 72, in get_model
return cls_from_str(REGISTRY[name])
File "D:\code\python\DeepPavlov-master\deeppavlov\core\common\registry.py", line 40, in cls_from_str
return getattr(importlib.import_module(module_name), cls_name)
File "D:\app\Anaconda3\lib\importlib_init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 994, in _gcd_import
File "", line 971, in _find_and_load
File "", line 955, in _find_and_load_unlocked
File "", line 665, in _load_unlocked
File "", line 678, in exec_module
File "", line 219, in _call_with_frames_removed
File "D:\code\python\DeepPavlov-master\deeppavlov\models\preprocessors\bert_preprocessor.py", line 19, in
from bert_dp.preprocessing import convert_examples_to_features, InputExample, InputFeatures
ModuleNotFoundError: No module named 'bert_dp'
and my python in pycharm as same as python in terminal. I saw this :https://github.com/deepmipt/DeepPavlov/issues/1058
pip install bert_dp is not helpful. Could you help me？Thanks a lot!

Hi!
Did you run python -m deeppavlov install squad_zh_bert_zh  like described here https://github.com/deepmipt/DeepPavlov/issues/808#issuecomment-484113024

Thank you very much for your solution！


Bump PPM version to 2024.11.0-7

Bump PPM version to 2024.11.0-7

I was having trouble getting the rstudio-docker-products GHA to push the docker image, but I got it working by running the job manually. This is passing now, merging.


Clustering methods?

Just making a note here that we might want to implement clustering methods. We could try:

agglomerative clustering over the text similarity vectors
topic modeling

None of these are urgent, and it is not clear we should definitely do this, but am making an issue so we don't forget.

I feel this can be closed? We are doing clustering, but on cosine-similarity

Yes. Lets close it.


colcon build uses the wrong Python version when inside a virtualenvironment on Windows

See also this stackexchange issue: https://robotics.stackexchange.com/questions/105587
I have ROS2 running from a venv. And when building a workspace I get a bunch of ModuleNotFound errors, because colcon is using the wrong Python executable according to the logs.
It's using C:\Program Files\Python310\python.exe instead of C:\dev\ros2_humble\.venv\Scripts\python.exe.
So colcon does not use the currently activated virtualenvironment, which seems wrong.
On Windows 10, with ROS2 humble, and Python 3.8 (used as venv).

Actually, I doubt this is the fault of colcon.
In a fresh directory I created the following CMakeLists.txt:
cmake_minimum_required(VERSION 3.5)
project("PythonDemo")

find_package(Python COMPONENTS Interpreter Development)

message(STATUS "Python_EXECUTABLE: ${Python_EXECUTABLE}")

And build from inside ROS2:
> C:\dev\ros2_humble\.venv\Scritps\Activate.ps1
> C:\dev\ros2_humble\local_setup.ps1
> mkdir build; cd build
> python -V

Python 3.8.10

> cmake ..

-- Python_EXECUTABLE: C:/Program Files/Python310/python.exe

It seems CMake who doesn't pick up the right version.


[WIP][DOC]Added documentation for index server

Added documentation for index server
Be sure to do all of the following checklist to help us incorporate
your contribution quickly and easily:

[ ] Any interfaces changed?

[ ] Any backward compatibility impacted?

[ ] Document update required?

[ ] Testing done
Please provide details on
- Whether new unit test cases have been added or why no new tests are required?
- How it is tested? Please attach test report.
- Is it a performance related change? Please attach the performance test report.
- Any additional information to help reviewers in testing this change.

[ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.

Build Success with Spark 2.1.0, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder2.1/3619/

Build Success with Spark 2.3.2, Please check CI http://<IP_ADDRESS>:8080/job/carbondataprbuilder2.3/11893/

Build Success with Spark 2.2.1, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder1/3826/

Build Success with Spark 2.1.0, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder2.1/3636/

Build Success with Spark 2.3.2, Please check CI http://<IP_ADDRESS>:8080/job/carbondataprbuilder2.3/11910/

Build Success with Spark 2.2.1, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder1/3847/

Build Failed  with Spark 2.3.2, Please check CI http://<IP_ADDRESS>:8080/job/carbondataprbuilder2.3/11943/

Build Success with Spark 2.1.0, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder2.1/3670/

Build Success with Spark 2.2.1, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder1/3879/

Build Success with Spark 2.1.0, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder2.1/3751/

Build Success with Spark 2.3.2, Please check CI http://<IP_ADDRESS>:8080/job/carbondataprbuilder2.3/12027/

Build Success with Spark 2.2.1, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder1/3963/

Build Success with Spark 2.1.0, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder2.1/3800/

Build Success with Spark 2.2.1, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder1/4011/

Build Success with Spark 2.3.2, Please check CI http://<IP_ADDRESS>:8080/job/carbondataprbuilder2.3/12078/

Build Success with Spark 2.1.0, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder2.1/3808/

Build Success with Spark 2.1.0, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder2.1/3821/

Build Success with Spark 2.3.2, Please check CI http://<IP_ADDRESS>:8080/job/carbondataprbuilder2.3/12094/

Build Failed with Spark 2.2.1, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder1/4026/

Build Failed  with Spark 2.1.0, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder2.1/3826/

Build Success with Spark 2.1.0, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder2.1/3829/

Build Success with Spark 2.3.2, Please check CI http://<IP_ADDRESS>:8080/job/carbondataprbuilder2.3/12102/

Build Failed with Spark 2.2.1, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder1/4034/

Build Success with Spark 2.1.0, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder2.1/3842/

Build Success with Spark 2.3.2, Please check CI http://<IP_ADDRESS>:8080/job/carbondataprbuilder2.3/12115/

Build Failed with Spark 2.2.1, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder1/4047/


modify for benchmark purpose.

Update the codes for benchmark purpose:

Loosen the mmcv version check
Add Env BEVT_EARLY_STOP for controlling the training process.
Add reduced image data file list reduced.ILSVRC2012_name_train_list.txt.
Add sample run script, configs are better modified in the --cfg-options field.
Exclude more outlier datapoints from the beginning.

Sorry, meant to create in the forked repo.


Minor changes made to improve syntax

I'm Samantha Mills, from the University of Waterloo with the Google projects!


Add X509_STORE_get1_objects

X509_STORE_get0_objects returns a pointer to the X509_STORE's storage, but this function is a bit deceptive. It is practically unusable in a multi-threaded program. See, for example, RUSTSEC-2023-0072, a security vulnerability caused by this OpenSSL API.
One might think that, if no other threads are mutating the X509_STORE, it is safe to read the resulting list. However, the documention does not mention that other logically-const operations on the X509_STORE, notably certifcate verifications when a hash_dir is installed, will, under a lock, write to the X509_STORE. The X509_STORE also internally re-sorts the list on the first query.
If the caller knows to call X509_STORE_lock and X509_STORE_unlock, it can work around this. But this is not obvious, and the documentation does not discuss how X509_STORE_lock is very rarely safe to use. E.g. one cannot call any APIs like X509_STORE_add_cert or X509_STORE_CTX_get1_issuer while holding the lock because those functions internally expect to take the lock. Conversely, if a function happens not to take the lock, but then later it does, this becomes a breaking change for anyone using it with X509_STORE_lock! X509_STORE_lock is another such API which is not safe to export as public API.
Rather than leave all this to the caller to figure out, the API should have returned a shallow copy of the list, refcounting the values. Then it could be internally locked and the caller can freely inspect the result without synchronization with the X509_STORE.

Checklist

[x] documentation is added or updated
[x] tests are added or updated

CIFuzz failure seems to be unrelated.
I probably should mention, given the issues with X509_STORE_get0_objects, as well as X509_STORE_lock and X509_STORE_unlock listed above, those APIs really should be deprecated at the earliest available release. They're quite dangerous.
Beyond the thread-safety and double-locking flaws listed above, X509_STORE_get0_objects actually constrains you all to keep the X509_STORE in a STACK_OF(T). However, a hash table would probably be a better representation, as you need something that supports efficient lookup by name, as well as insertion. As currently implemented, the wrong pattern of certificate verifications on a hash_dir will cause OpenSSL behave quadratically in the size of the store. To fix that, you need to first remove X509_STORE_get0_objects.

I would also tend to make this a function that takes a parameter that indicates which objects you want included (certs or crls or both) and then the X509_STORE_get1_all_certs becomes a trivial convenience function and we don't have two different ways of implementing things - X509_STORE_get1_all_certs sorts, X509_STORE_get1_all_objects doesn't - and their internal paths are different and these sorts of differences I think will be unexpected for the user.
When cleaning up a mess (which is from usage of X509_STORE rather than the intended X509_STORE_CTX functions I think we need to look around the other APIs and see if we can clean things up as well so we don't end up with slightly different ways of doing this which is only "obvious" when looking at the source.

Taking a type parameter would make it harder for OpenSSL to introduce new X509_OBJECT types in the future. The X509_LU_* constants are not suitable for a bitmask. You could introduce X509_LU_*_MASK constants and then have the code internally convert between them, but considering that all these objects are refcounted (so including it in the result is cheap), and that the caller may want to do more complex filtering anyway, it seems cleanest to simply return all of them and let the caller decide what they want.
Sorting is interesting because these values do not inherently have a sort order. The sorting is actually an internal implementation detail of how OpenSSL optimizes lookups. Except that OpenSSL does not optimize lookup very well because, as discussed above, a hash table would actually be the better structure. (You all need both insertions and deletions.) So while returning some sorted order is certainly technically possible, and you could always take your hash table order and sort afterwards, it seems something we should not be encouraging applications to rely on and instead document that the order is unspecified. That would be the most future-proof, presuming OpenSSL wishes to address X509_STORE performance in the future.

which is from usage of X509_STORE rather than the intended X509_STORE_CTX functions

This mess doesn't have anything to do with X509_STORE_CTX. There aren't any X509_STORE_CTX functions for the use case this API serves, nor would X509_STORE_CTX help with the situation. The mess is simply that this use case inherently accesses data shared across threads, and that OpenSSL did not take threading into account when designing the API.

24 hours has passed since 'approval: done' was set, but as this PR has been updated in that time the label 'approval: ready to merge' is not being automatically set.  Please review the updates and set the label manually.

I agree that a get0 on the entire content of the store is a poor API and should be deprecated promptly.
But, I'd go further, and would suggest that even a get1 on the entire store content is perhaps not desirable.
Perhaps the store should only provide keyed search and and a stateful iterator that can traverse the store returning one certificate (or CRL) at a time.

There already are APIs to search by key (namely name). There are projects that specifically want the whole list. Now, X509_LOOKUP's rather weird caching semantics make this use case slightly odd, but they're part of the public APIs of projects like CPython, so it's a bit late to do something else now. CPython needs to know all the certs and CRLs in the store. I think a CRL counterpart of X509_STORE_get1_all_certs would work for CPython, if you prefer to paint the bikeshed that color. I don't particularly care. X509_STORE_get1_objects is a bit easier to port X509_STORE_get0_objects callers, though, and only hits the lock once.
What sort of iterator did you have in mind? A pull-based iterator (i.e. one where the caller gets an object and iteratively calls "next") would still need to worry about locking. Locking around each call to "next" would be tricky because the store may be modified in between calls. If it internally saved a snapshot of the contents, it just becomes the get1 function under the hood.
Also keep in mind that get1_objects doesn't preclude writing an iterator API later. You can always implement get1_objects in terms of the iterator by collecting the iterator into a list. If there is already a preferred iterator pattern, happy to evaluate it against the open source projects that need it and, if suitable, adopt it in this PR. But, as you say, OpenSSL needs to provide a replacement for get0_objects promptly. Unless you all have a concrete preferred pattern already, we should start with get1_objects and expand to other patterns later as the needs arise.

Merged to the master branch. Thank you for your contribution.

There is nothing wrong with the X509_STORE_get0_objects API itself.
It is clearly unsafe if not called within X509_STORE_lock() but ref counting should be properly taken into account by the user.
For instance, we implemented X509_STORE_get1_all_certs() ourselves in our OpenSSL wrapper, because oldest API does not publish it.
This is the whole ref counting API of OpenSSL which is confusing.
But it is at least clear that any code calling _get0_ methods should properly acquire the reference via _up_ref().
I don't know what is the current state of memory leaks of OpenSSL, but last time I checked initializing the library just made some memory leaks at shutdown. Before trying to rewrite the API or deprecate anything which is used everywhere, we could first prioritize to make the library itself without leak.
And don't forget that OpenSSL is used outside of plain C, with other languages, and we need access to the raw information via low-level helpers, since direct access to the C structs have been deprecated. Linking to several versions of OpenSSL is perhaps not possible in plain C with its .h headers, but it is manageable to link and adapt to OpenSSL 1.1 or 3.x at runtime, from other languages.