Feedback on topic detection

This issue is about collecting feedback on the quality of topic detection. We want to find out if the topic detection implemented by InfAI can solve the requirements of WRIPL when WRIPL asked for a topic detection.
This issue is a fresh start of the long discussion in #50.

I've tested following simple text
http://api-dev.freme-project.eu/current/e-entity/freme-ner/documents/?informat=text&input=IBM shares fell more than 5 percent in after-hours trading Monday after the company announced third-quarter revenues that missed expectations, and offered weaker than expected guidance for the year. The tech giant reported earnings of $3.34 per share on $19.28 billion in revenue. Analysts had expected IBM to report earnings of about $3.30 a share on $19.62 billion in revenue, according to a consensus estimate from Thomson Reuters. IBM's revenue figure came in below the Wall Street low: The lowest revenue estimate of 17 analysts for the quarter was $19.292 billion. Monday's announcement marked the 14th straight quarter that IBM's revenues fell. Still, the company said its revenue change — a 19 percent decline from the same time last year — was only a 1 percent fall adjusting for currency and other factors. A few things to note...within the revenue we report we have a pretty substantial currency headwind we continue to deal with and as we transform our business we continue to move out of areas where we don't see long term value, so across our revenue base that's about 13 points of impact so excluding those two in the third quarter we reported a down about 1 percent revenue," IBM CFO Martin Schroeter told CNBC after the earnings report&outformat=turtle&language=en&dataset=dbpedia&enrichement=dbpedia-categories
As output I get:
@prefix dbpedia-fr: http://fr.dbpedia.org/resource/ .
@prefix dbc:   http://dbpedia.org/resource/Category: .
@prefix dbpedia-es: http://es.dbpedia.org/resource/ .
@prefix xsd:   http://www.w3.org/2001/XMLSchema# .
@prefix itsrdf: http://www.w3.org/2005/11/its/rdf# .
@prefix dbpedia: http://dbpedia.org/resource/ .
@prefix rdfs:  http://www.w3.org/2000/01/rdf-schema# .
@prefix nif:   http://persistence.uni-leipzig.org/nlp2rdf/ontologies/nif-core# .
@prefix dbpedia-de: http://de.dbpedia.org/resource/ .
@prefix dbpedia-ru: http://ru.dbpedia.org/resource/ .
@prefix freme-onto: http://freme-project.eu/ns# .
@prefix dbpedia-nl: http://nl.dbpedia.org/resource/ .
@prefix dcterms: http://purl.org/dc/terms/ .
@prefix dbpedia-it: http://it.dbpedia.org/resource/ .
dbc:Thomson_Reuters  rdfs:label  "Thomson Reuters"@en ;
freme-onto:info  "13.705798510344026" .
dbc:1911_establishments_in_the_United_States
rdfs:label       "1911 establishments in the United States"@en ;
freme-onto:info  "13.914385132155443" .
http://freme-project.eu/#char=474,485
a                     nif:RFC5147String , nif:Phrase , nif:Word , nif:String ;
nif:anchorOf          "Wall Street"^^xsd:string ;
nif:beginIndex        "474"^^xsd:int ;
nif:endIndex          "485"^^xsd:int ;
nif:referenceContext  http://freme-project.eu/#char=0,1252 ;
itsrdf:taClassRef     http://nerd.eurecom.fr/ontology#Location ;
itsrdf:taConfidence   "0.6404511836029554"^^xsd:double ;
itsrdf:taIdentRef     dbpedia:Wall_Street .
dbc:Forts_of_New_Netherland
rdfs:label       "Forts of New Netherland"@en ;
freme-onto:info  "15.406238228485117" .
http://dbpedia.org/resource/Category:S&P/TSX_60_Index
rdfs:label       "S&P/TSX 60 Index"@en ;
freme-onto:info  "13.475500890922232" .
dbc:Computer_storage_companies
rdfs:label       "Computer storage companies"@en ;
freme-onto:info  "12.624878514960459" .
http://freme-project.eu/#char=1222,1226
a                     nif:String , nif:RFC5147String , nif:Word , nif:Phrase ;
nif:anchorOf          "CNBC"^^xsd:string ;
nif:beginIndex        "1222"^^xsd:int ;
nif:endIndex          "1226"^^xsd:int ;
nif:referenceContext  http://freme-project.eu/#char=0,1252 ;
itsrdf:taClassRef     http://nerd.eurecom.fr/ontology#Organization ;
itsrdf:taConfidence   "0.9769373255376529"^^xsd:double ;
itsrdf:taIdentRef     dbpedia:CNBC .
http://freme-project.eu/#char=0,1252
a               nif:String , nif:Context , nif:RFC5147String ;
nif:beginIndex  "0"^^xsd:int ;
nif:endIndex    "1252"^^xsd:int ;
nif:isString    "IBM shares fell more than 5 percent in after-hours trading Monday after the company announced third-quarter revenues that missed expectations, and offered weaker than expected guidance for the year. The tech giant reported earnings of $3.34 per share on $19.28 billion in revenue. Analysts had expected IBM to report earnings of about $3.30 a share on $19.62 billion in revenue, according to a consensus estimate from Thomson Reuters. IBM's revenue figure came in below the Wall Street low: The lowest revenue estimate of 17 analysts for the quarter was $19.292 billion. Monday's announcement marked the 14th straight quarter that IBM's revenues fell. Still, the company said its revenue change — a 19 percent decline from the same time last year — was only a 1 percent fall adjusting for currency and other factors. A few things to note...within the revenue we report we have a pretty substantial currency headwind we continue to deal with and as we transform our business we continue to move out of areas where we don't see long term value, so across our revenue base that's about 13 points of impact so excluding those two in the third quarter we reported a down about 1 percent revenue," IBM CFO Martin Schroeter told CNBC after the earnings report"^^xsd:string .
dbc:Electronics_companies_of_the_United_States
rdfs:label       "Electronics companies of the United States"@en ;
freme-onto:info  "10.795213431177766" .
dbpedia:Thomson_Reuters
dcterms:subject  dbc:Companies_established_in_2008 , dbc:Companies_based_in_Manhattan , dbc:Media_companies_based_in_New_York_City , dbc:Companies_listed_on_the_Toronto_Stock_Exchange , dbc:Bibliographic_database_providers , dbc:2008_establishments_in_Ontario , dbc:Media_companies_of_Canada , dbc:Thomson_Reuters , http://dbpedia.org/resource/Category:S&P/TSX_60_Index , dbc:Companies_listed_on_the_New_York_Stock_Exchange , dbc:Financial_data_vendors , dbc:Publicly_traded_companies_based_in_New_York_City , dbc:Multinational_companies_based_in_New_York_City .
http://freme-project.eu/#char=0,3
a                     nif:RFC5147String , nif:Phrase , nif:Word , nif:String ;
nif:anchorOf          "IBM"^^xsd:string ;
nif:beginIndex        "0"^^xsd:int ;
nif:endIndex          "3"^^xsd:int ;
nif:referenceContext  http://freme-project.eu/#char=0,1252 ;
itsrdf:taClassRef     http://nerd.eurecom.fr/ontology#Organization ;
itsrdf:taConfidence   "0.9955540309317645"^^xsd:double ;
itsrdf:taIdentRef     dbpedia:IBM .
http://freme-project.eu/#char=418,433
a                     nif:String , nif:RFC5147String , nif:Word , nif:Phrase ;
nif:anchorOf          "Thomson Reuters"^^xsd:string ;
nif:beginIndex        "418"^^xsd:int ;
nif:endIndex          "433"^^xsd:int ;
nif:referenceContext  http://freme-project.eu/#char=0,1252 ;
itsrdf:taClassRef     http://nerd.eurecom.fr/ontology#Organization ;
itsrdf:taConfidence   "0.8978024142458758"^^xsd:double ;
itsrdf:taIdentRef     dbpedia:Thomson_Reuters .
dbc:Digital-only_radio_stations
rdfs:label       "Digital-only radio stations"@en ;
freme-onto:info  "11.784186409028742" .
dbc:U.S._Route_9W  rdfs:label  "U.S. Route 9W"@en ;
freme-onto:info  "14.598883306427513" .
dbc:Semiconductor_companies
rdfs:label       "Semiconductor companies"@en ;
freme-onto:info  "13.102457480308015" .
dbc:Publicly_traded_companies_based_in_New_York_City
rdfs:label       "Publicly traded companies based in New York City"@en ;
freme-onto:info  "14.821275727763961" .
dbc:Media_companies_of_Canada
rdfs:label       "Media companies of Canada"@en ;
freme-onto:info  "15.598883306427513" .
dbc:Companies_based_in_Manhattan
rdfs:label       "Companies based in Manhattan"@en ;
freme-onto:info  "12.452041918098242" .
dbc:Companies_listed_on_the_New_York_Stock_Exchange
rdfs:label       "Companies listed on the New York Stock Exchange"@en ;
freme-onto:info  "8.830698981650588" .
dbc:Media_companies_based_in_New_York_City
rdfs:label       "Media companies based in New York City"@en ;
freme-onto:info  "13.406238228485119" .
dbc:Cloud_computing_providers
rdfs:label       "Cloud computing providers"@en ;
freme-onto:info  "11.733812886513624" .
dbc:Television_stations_in_New_Jersey
rdfs:label       "Television stations in New Jersey"@en ;
freme-onto:info  "13.406238228485119" .
dbpedia:Wall_Street  dcterms:subject  dbc:Colonial_forts_in_New_York , dbc:Wall_Street , dbc:Occupy_Wall_Street , dbc:Forts_of_New_Netherland , http://dbpedia.org/resource/Category:Financial_District,_Manhattan , dbc:Streets_in_Manhattan .
dbc:Peabody_Award_winners
rdfs:label       "Peabody Award winners"@en ;
freme-onto:info  "10.878761222424721" .
dbc:Computer_hardware_companies
rdfs:label       "Computer hardware companies"@en ;
freme-onto:info  "12.102457480308015" .
dbc:Companies_listed_on_the_Toronto_Stock_Exchange
rdfs:label       "Companies listed on the Toronto Stock Exchange"@en ;
freme-onto:info  "10.918398194662066" .
dbc:Foundry_semiconductor_companies
rdfs:label       "Foundry semiconductor companies"@en ;
freme-onto:info  "15.158310715041532" .
dbc:Companies_established_in_2008
rdfs:label       "Companies established in 2008"@en ;
freme-onto:info  "10.726758128979672" .
dbpedia:CNBC  dcterms:subject  dbc:CNBC_global_channels , dbc:Digital-only_radio_stations , dbc:English-language_television_stations_in_the_United_States , dbc:24-hour_television_news_channels_in_the_United_States , dbc:NBCUniversal_networks , dbc:Business-related_television_channels , dbc:Peabody_Award_winners , dbc:Television_stations_in_New_Jersey , dbc:U.S._Route_9W , dbc:NBCUniversal , dbc:Television_channels_and_stations_established_in_1989 .
dbc:Point_of_sale_companies
rdfs:label       "Point of sale companies"@en ;
freme-onto:info  "14.158310715041532" .
dbc:Colonial_forts_in_New_York
rdfs:label       "Colonial forts in New York"@en ;
freme-onto:info  "14.705798510344026" .
dbc:Financial_data_vendors
rdfs:label       "Financial data vendors"@en ;
freme-onto:info  "14.276955211540152" .
dbc:Companies_established_in_1896
rdfs:label       "Companies established in 1896"@en ;
freme-onto:info  "13.256491108980436" .
dbc:Occupy_Wall_Street
rdfs:label       "Occupy Wall Street"@en ;
freme-onto:info  "14.361844109126665" .
http://dbpedia.org/resource/Category:Companies_based_in_Westchester_County,_New_York
rdfs:label       "Companies based in Westchester County, New York"@en ;
freme-onto:info  "14.361844109126665" .
http://dbpedia.org/resource/Category:Financial_District,_Manhattan
rdfs:label       "Financial District, Manhattan"@en ;
freme-onto:info  "12.821275727763961" .
dbc:1896_establishments_in_the_United_States
rdfs:label       "1896 establishments in the United States"@en ;
freme-onto:info  "14.452041918098244" .
http://freme-project.eu/#char=435,438
a                     nif:String , nif:RFC5147String , nif:Phrase , nif:Word ;
nif:anchorOf          "IBM"^^xsd:string ;
nif:beginIndex        "435"^^xsd:int ;
nif:endIndex          "438"^^xsd:int ;
nif:referenceContext  http://freme-project.eu/#char=0,1252 ;
itsrdf:taClassRef     http://nerd.eurecom.fr/ontology#Organization ;
itsrdf:taConfidence   "0.9960635494338839"^^xsd:double ;
itsrdf:taIdentRef     dbpedia:IBM .
dbc:CNBC_global_channels
rdfs:label       "CNBC global channels"@en ;
freme-onto:info  "15.499347632876601" .
dbc:NBCUniversal  rdfs:label  "NBCUniversal"@en ;
freme-onto:info  "12.97997347378302" .
dbc:News  rdfs:label     "News"@en ;
freme-onto:info  "15.406238228485117" .
http://freme-project.eu/#char=1192,1195
a                     nif:RFC5147String , nif:Word , nif:String , nif:Phrase ;
nif:anchorOf          "IBM"^^xsd:string ;
nif:beginIndex        "1192"^^xsd:int ;
nif:endIndex          "1195"^^xsd:int ;
nif:referenceContext  http://freme-project.eu/#char=0,1252 ;
itsrdf:taClassRef     http://nerd.eurecom.fr/ontology#Organization ;
itsrdf:taConfidence   "0.9729965656552476"^^xsd:double ;
itsrdf:taIdentRef     dbpedia:IBM .
dbc:NBCUniversal_networks
rdfs:label       "NBCUniversal networks"@en ;
freme-onto:info  "13.882676272428105" .
dbc:Collier_Trophy_recipients
rdfs:label       "Collier Trophy recipients"@en ;
freme-onto:info  "12.97997347378302" .
dbc:Display_technology_companies
rdfs:label       "Display technology companies"@en ;
freme-onto:info  "12.97997347378302" .
http://freme-project.eu/#char=303,306
a                     nif:RFC5147String , nif:Word , nif:String , nif:Phrase ;
nif:anchorOf          "IBM"^^xsd:string ;
nif:beginIndex        "303"^^xsd:int ;
nif:endIndex          "306"^^xsd:int ;
nif:referenceContext  http://freme-project.eu/#char=0,1252 ;
itsrdf:taClassRef     http://nerd.eurecom.fr/ontology#Organization ;
itsrdf:taConfidence   "0.9918151685372821"^^xsd:double ;
itsrdf:taIdentRef     dbpedia:IBM .
dbc:Bibliographic_database_providers
rdfs:label       "Bibliographic database providers"@en ;
freme-onto:info  "14.048686223867035" .
dbc:Business-related_television_channels
rdfs:label       "Business-related television channels"@en ;
freme-onto:info  "14.762382038710392" .
dbc:American_brands  rdfs:label  "American brands"@en ;
freme-onto:info  "11.748026745733323" .
http://freme-project.eu/#char=1200,1216
a                     nif:RFC5147String , nif:String , nif:Phrase , nif:Word ;
nif:anchorOf          "Martin Schroeter"^^xsd:string ;
nif:beginIndex        "1200"^^xsd:int ;
nif:endIndex          "1216"^^xsd:int ;
nif:referenceContext  http://freme-project.eu/#char=0,1252 ;
itsrdf:taClassRef     http://nerd.eurecom.fr/ontology#Person ;
itsrdf:taConfidence   "0.8597548963180837"^^xsd:double .
dbc:Wall_Street  rdfs:label  "Wall Street"@en ;
freme-onto:info  "14.361844109126665" .
dbc:Streets_in_Manhattan
rdfs:label       "Streets in Manhattan"@en ;
freme-onto:info  "12.158310715041532" .
dbpedia:IBM  dcterms:subject  dbc:Cloud_computing_providers , dbc:Point_of_sale_companies , dbc:Computer_storage_companies , dbc:Collier_Trophy_recipients , dbc:Software_companies_based_in_New_York , dbc:UML_Partners , dbc:1911_establishments_in_the_United_States , dbc:Outsourcing_companies , dbc:IBM , dbc:Semiconductor_companies , dbc:Foundry_semiconductor_companies , dbc:News , dbc:Electronics_companies_of_the_United_States , dbc:Computer_companies_of_the_United_States , dbc:Companies_established_in_1896 , dbc:Companies_listed_on_the_New_York_Stock_Exchange , dbc:Display_technology_companies , dbc:Multinational_companies_headquartered_in_the_United_States , dbc:National_Medal_of_Technology_recipients , dbc:1896_establishments_in_the_United_States , dbc:Computer_hardware_companies , dbc:American_brands , http://dbpedia.org/resource/Category:Companies_based_in_Westchester_County,_New_York , dbc:Companies_in_the_Dow_Jones_Industrial_Average .
dbc:National_Medal_of_Technology_recipients
rdfs:label       "National Medal of Technology recipients"@en ;
freme-onto:info  "12.361844109126665" .
dbc:Software_companies_based_in_New_York
rdfs:label       "Software companies based in New York"@en ;
freme-onto:info  "13.276955211540152" .
dbc:UML_Partners  rdfs:label  "UML Partners"@en ;
freme-onto:info  "15.406238228485117" .
dbc:Television_channels_and_stations_established_in_1989
rdfs:label       "Television channels and stations established in 1989"@en ;
freme-onto:info  "11.798907914735507" .
http://freme-project.eu/#char=631,634
a                     nif:String , nif:RFC5147String , nif:Phrase , nif:Word ;
nif:anchorOf          "IBM"^^xsd:string ;
nif:beginIndex        "631"^^xsd:int ;
nif:endIndex          "634"^^xsd:int ;
nif:referenceContext  http://freme-project.eu/#char=0,1252 ;
itsrdf:taClassRef     http://nerd.eurecom.fr/ontology#Organization ;
itsrdf:taConfidence   "0.9915816574782368"^^xsd:double ;
itsrdf:taIdentRef     dbpedia:IBM .
dbc:Outsourcing_companies
rdfs:label       "Outsourcing companies"@en ;
freme-onto:info  "12.361844109126665" .
dbc:IBM  rdfs:label      "IBM"@en ;
freme-onto:info  "13.428958304985203" .
dbc:2008_establishments_in_Ontario
rdfs:label       "2008 establishments in Ontario"@en ;
freme-onto:info  "13.499347632876601" .
dbc:English-language_television_stations_in_the_United_States
rdfs:label       "English-language television stations in the United States"@en ;
freme-onto:info  "11.651350726321649" .
dbc:Companies_in_the_Dow_Jones_Industrial_Average
rdfs:label       "Companies in the Dow Jones Industrial Average"@en ;
freme-onto:info  "14.499347632876601" .
dbc:Computer_companies_of_the_United_States
rdfs:label       "Computer companies of the United States"@en ;
freme-onto:info  "11.053091402987036" .
dbc:Multinational_companies_headquartered_in_the_United_States
rdfs:label       "Multinational companies headquartered in the United States"@en ;
freme-onto:info  "12.791528384369911" .
dbc:24-hour_television_news_channels_in_the_United_States
rdfs:label       "24-hour television news channels in the United States"@en ;
freme-onto:info  "13.475500890922232" .
dbc:Multinational_companies_based_in_New_York_City
rdfs:label       "Multinational companies based in New York City"@en ;
freme-onto:info  "14.882676272428105"

This is a earning report from IBM. Following questions:

The topics listed on the top:

dbc:Thomson_Reuters  rdfs:label  "Thomson Reuters"@en ;
freme-onto:info  "13.705798510344026" .
dbc:1911_establishments_in_the_United_States
rdfs:label       "1911 establishments in the United States"@en ;
freme-onto:info  "13.914385132155443" .
Are these topics that express the whole document based on their occurance in the topics of each entity?

The topics of the entities. Take the first one:

http://freme-project.eu/#char=474,485
a                     nif:RFC5147String , nif:Phrase , nif:Word , nif:String ;
nif:anchorOf          "Wall Street"^^xsd:string ;
nif:beginIndex        "474"^^xsd:int ;
nif:endIndex          "485"^^xsd:int ;
nif:referenceContext  http://freme-project.eu/#char=0,1252 ;
itsrdf:taClassRef     http://nerd.eurecom.fr/ontology#Location ;
itsrdf:taConfidence   "0.6404511836029554"^^xsd:double ;
itsrdf:taIdentRef     dbpedia:Wall_Street .
dbc:Forts_of_New_Netherland
rdfs:label       "Forts of New Netherland"@en ;
freme-onto:info  "15.406238228485117" .
http://dbpedia.org/resource/Category:S&P/TSX_60_Index
rdfs:label       "S&P/TSX 60 Index"@en ;
freme-onto:info  "13.475500890922232" .
dbc:Computer_storage_companies
rdfs:label       "Computer storage companies"@en ;
freme-onto:info  "12.624878514960459" .

why are there two ways of expressing this one with dbc: and the other with a namespace/URL?
it seems to me that all three categories are not very useful. How do they relate to Wallstreet? Should we not be seeing something like: Stock Exchange, S&P500 etc. Especially the first and the third seem of context.

I didnt look at others yet but I am assuming this will be similar in most cases and most likely due to the domain specfic question. If I am looking for historical topics related to 'Wall Street' the first topic might be spot on. I will send on some ideas in the folder Jan prepared.

@m1ci @jnehring quick question: what github issue relates to the idea of using the TYPES to filter the returns a bit more. We simply still get way too many entities. They may all be correct but based on the use case are not needed.
My idea here is to hit it will all we have which is using general purpose (as is now), adding domain specific taxonomies (which looks the same as the wikipedia categories just that the terminology is from the taxonmy not from wikipeda) and finnally TYPE.
The enduser can set flags either see it all or just variations of the three options above.
Let me know what you think

This is a earning report from IBM. Following questions:
The topics listed on the top:
dbc:Thomson_Reuters rdfs:label "Thomson Reuters"@en ;
freme-onto:info "13.705798510344026" .
dbc:1911_establishments_in_the_United_States
rdfs:label "1911 establishments in the United States"@en ;
freme-onto:info "13.914385132155443" .

dbc:Thomson_Reuters is topic assigned to the dbpedia:Thomson_Reuters entity
dbc:1911_establishments_in_the_United_States is topic assigned to the dbpedia:IBM entity

Are these topics that express the whole document based on their occurance in the topics of each entity?

No, they relate to the entities occurring to the document. If the entity is central in the document, then with high probability the categories will also be relevant for the document. Note that those are categories assigned to the entities occurring in the document.

I didnt look at others yet but I am assuming this will be similar in most cases and most likely due to the domain specfic question. If I am looking for historical topics related to 'Wall Street' the first topic might be spot on. I will send on some ideas in the folder Jan prepared.

Let me one more time stress out one important point: topic detection (or document classification) won't work if you rely only on entities. You need to consider also terms. My suggestion is that you build a document classification system on top of the results provided by e-Entity and e-Terminology. To implement this, 1) you'll need training data - that is documents with assigned topics, 2) decide what information from e-Entity (e.g., entity types, or entity categories) and e-Terminology you are going to use for training. IMO, this is the only and the right way to go.

Thanks for your reply @m1ci
Related to the document classification system how much data is required and what kind of data.
In this finance example we get over 1000 topics in a hirarchical list. I assume we need to add training data to each topic? Related to this how much training data and what quality (can we use weblinks to fr example the articel I am using above)?
thanks

@m1ci @jnehring quick question: what github issue relates to the idea of using the TYPES to filter the returns a bit more. We simply still get way too many entities. They may all be correct but based on the use case are not needed.

My idea here is to hit it will all we have which is using general purpose (as is now), adding domain specific taxonomies (which looks the same as the wikipedia categories just that the terminology is from the taxonmy not from wikipeda) and finnally TYPE.

How will you link an entity with a taxonomy entry? Via the Wikipedia categories? Note that there are more than 900K Wikipedia categories.
What do you mean by TYPE? Filtering out entities from a specific domain? For example, spot entities only from the Sports or Politics domain?
There is no such issue. After 0.4 is done, we will continue working on that.

Yes filter a specific domain. In the dbpedia spotlight demo there is a list one can select.

Related to the document classification system how much data is required and what kind of data.

Very valid question.

how much data is required

Hard to say, depends on the data. Maybe you can first train with lets say some hundreds of docs, see how it performs, and then increase the training size.

what kind of data.

Well, for training you'll need some hundreds of documents which will be processed with e-entity and e-terminology. Also you will need topics assigned to each document.
The results from e-entity and e-terminology will be used as features for training, while the topics will be used as classes for learning.

Yes filter a specific domain. In the dbpedia spotlight demo there is a list one can select.

With DBpedia Spotlight you can specify entity types and not domains. Just to have it clear.

ah okay thats what I mean Entity types
We then get three enrichments (please correct me if I am wrong):

current general purpose (categories and entities)
selection of entity types to narrow the results on a domain
the use of domain specific taxnomies via document classification

I have to confess the third is not clear to me exactly. Especially the latter part. My understanding currently:

For each domain we source a domain specific taxonomy
We enrich the taxonomy with data (at least 100 docs per topic which means we need approx. 10.000 documents for a taxnomy with 1000 categories)
Each traning document then has topics assigned to it

What then? Do when then get document classification and NER? I am still not sure how this will connect.
I am worried about the data requirement. Is there a simpler (but not as specise approach) such as semantic matching which only tries to count words in a document that are similar as the terms in a taxonomy and takes the term with the most hits (not sure if that exisits)

it seems to me that all three categories are not very useful. How do they relate to Wallstreet?

I understood the algorithm that you have to sort all categories according to the score in freme-onto:info and take the top-n. With this algorithm the top 3 categories in your example text are
dbc:Media_companies_of_Canada
rdfs:label "Media companies of Canada"@en ;
freme-onto:info "15.598883306427513" .

dbc:CNBC_global_channels
rdfs:label "CNBC global channels"@en ;
freme-onto:info "15.499347632876601" .

dbc:Forts_of_New_Netherland
rdfs:label "Forts of New Netherland"@en ;
freme-onto:info "15.406238228485117" .

But still I cannot see a relation to the text.

This issue is no longer up to date and can be closed.


impossible to connect

Hello,
I follow 3 first steps to get youtube data Analytics, but I can't connect after choosing (in powerbi) your youtube Analytics (beta) connector

In google console I write the right redirection url

But I have the following message when I enter my gmail account (this is not a supported browser...)

Thanks

Hey!
Unfortunately, I don't have any control over how the Webapp works or how it's being handled on a per account basis. This is something that might be related to your app being not a verified one as mentioned here:
https://support.google.com/cloud/answer/7454865?hl=en
Again, I don't control this part of the process as it's completely handled by Google so you might need to get in touch with them or your developer to set up your webapp.
I can tell you that the Custom Connector is still working and it doesn't have any issues. Even the code used for the OAuth 2.0 in this repo is being used in other custom connectors on the web and it's working for other Google services such as Google Drive and more.
If you do happen to find out how to fix this issue or any way to bypass it, please let me know.

Hello  migueesc123,
I used your link and advices but I always have the same problem with the pop-up security message in Powerbi...
I read a lot of information to fix this problem and asked to Google and Powerbi communities without good responses.
Your connector would be very usefull for me but I don't have any idea to fix this problem
Here's all what I did :

restart a test project in google console with a new gmail account

I fill input form in oauth autorisation screen as mentionned in your link

create an oauth 2.0 credential  with redirect URI

See a new entry in select form "desktop application"(compare with your video tutorial)

I see a user with the same problem on the web
https://support.google.com/accounts/thread/22475808?hl=en

Same problem with powerbi and google connexion since 2019
https://community.powerbi.com/t5/Service/Cannot-sign-in-to-Google-Account-when-connecting-to-Google-Big/td-p/870032

I activated a less secure apps options
https://support.google.com/accounts/answer/6010255
https://myaccount.google.com/lesssecureapps

import json file and rebuild new connector

Can you help me to fix this problem ?
Thanks

hey @noliverte
My best suggestion would be to hire a developer to help you setup the Google Web App and debug any issues caused by the Authentication flow. I would've said that you could get in touch with my company to get support from us but, unfortunately, my developer is fully committed for the next few months and we don't have the bandwidth to take any support requests around new Web App configurations.
As mentioned before, I have zero control over how things work or are configured on the Google Web App - what I do have control over is on the Power BI Custom Connector code which you can see here:
https://github.com/migueesc123/YoutubeAnalytics/blob/YoutubeAnalyticsConnector/YoutubeAnalytics/YoutubeAnalytics.pq
The license of this repo does enable you to change the code of the connector as you see please should there be any changes needed to comply with the way that you've set up your Webapp.
Best of luck and if you find the fix, please share it with us!


can't run with super_drag_and_drop launcher configration

like occuring a type error, list to utf8list
Launching lib\main.dart on Windows in debug mode...
main.dart:1
../../super_clipboard/lib/src/format_conversions.dart(85,15): error G44692867: A value of type 'List' can't be returned from a function with return type 'Uint8List'. [C:\Users\songsongcai\projects\super_native_extensions\super_drag_and_drop\example\build\windows\flutter\flutter_assemble.vcxproj]
format_conversions.dart:1
../../super_clipboard/lib/src/format_conversions.dart(89,15): error G44692867: A value of type 'List' can't be returned from a function with return type 'Uint8List'. [C:\Users\songsongcai\projects\super_native_extensions\super_drag_and_drop\example\build\windows\flutter\flutter_assemble.vcxproj]
format_conversions.dart:1
../../super_clipboard/lib/src/reader_internal.dart(221,45): error GC2F972A8: The argument type 'List' can't be assigned to the parameter type 'Uint8List'. [C:\Users\songsongcai\projects\super_native_extensions\super_drag_and_drop\example\build\windows\flutter\flutter_assemble.vcxproj]
reader_internal.dart:1
../lib/src/drag_internal.dart(157,41): error GC2F972A8: The argument type 'HitTestResult' can't be assigned to the parameter type 'HitTestResult Function()'. [C:\Users\songsongcai\projects\super_native_extensions\super_drag_and_drop\example\build\windows\flutter\flutter_assemble.vcxproj]

Every example will show above tips when i want to debug this plugin

Which Flutter version are you using? You need to be at least on 3.16 (latest stable) to build super_native_extensions.

Which Flutter version are you using? You need to be at least on 3.16 (latest stable) to build super_native_extensions.

thanks for answering, i will try


Deploy to Heroku (or Netlify worst case scenario)

Looks like the free tier for Heroku is sunsetting/no longer available. have to come up with a different deployment tool or have someone one else assigned:

Netlify is actually pretty easy to use and I think we can still deploy a ful;l stack app for free.


Bug fixes for save and continue & check your answers

Removed change link for unincorporated role
Fixed bug where name persists on unincorporated check your answers
Fixed bug where data was not saving on other type of business

CI: No security warnings found


Broken image link

🏷 WebCrate Version
v?
⚙ Environment
Chrome
🐞 Describe the bug
image of a link is broken
📚 To Reproduce
I add a link via extension
in this case webcrate.app itself
when we click to preview this link

💡 Expected behavior
image is not shown
📋 Additional context
No response

That's wierd, it doesn't show an image for me too.
I think the problem is on webcrate.app, it should work for most other links!
It's using another OSS library of mine (metadata-scraper) to retrieve the title, description and image for a link.

Closing this for now, please reopen it if you find other links that don't work!


Accessible icon labels

I've posted this on Hacker News already, but I think it's better to have this in the GitHub repository as well.

I've also tested an example icon with Firefox + NVDA (inline SVG), which leads to the following screen reader announcement:

Add Icon of a plus sign enclosed in a circle  graphic

This has multiple issues from the accessibility perspective:

IF you are using a title + description, use aria-labelledby for the main label (= title) and aria-describedby for the description. Right now there is no separation and both labels will be read without a pause, making no sense (what is an "add icon of a plus sign .."?).

I would advice against using a description altogether. A screen reader user does not care about how the icon looks. He/she cares about the action it performs. So here, "Add" (depending on the context) is more than enough. As a general tip: Screen reader users should have access to the same information as sighted users. That's why we don't describe decorative images for example (alt=""), because there is no information behind it.

"Icon of" is unnecessary. As you can see in the NVDA output, when using "role=img" the user already knows it's an graphic. Hence, "Icon of" or "Image of" should not be used in image descriptions.

Keep in mind, there are still some issues with SVGs and screen readers to think about. Therefore I also prefer to use the labels on the enclosing elements (buttons, links) instead.

As discussed in the HN thread, wrong or false labels do in fact cause more harm than good. I understand that you want to provide sane default, but I would rather encourage people to edit the labels themselves. For example, you could add an explanation with some examples somewhere on the page.
I hope, you find my tips helpful. Keep up the good work!

Thanks a lot for tips, very appreciated! After consulting this with a few more people I will try to improve this as soon as I can, although may take a while as it's quite a lot of icons :)


Changed directory name in Installation

Changed directory name in Installation guide :
- cd reactjs.org
+ cd gu.reactjs.org

It doesn't help to just change the directory name as there are multiple references that point to the original repo name (as discussed in another PR #80). Let's just leave README.md as it is since we pull quite a few changes from upstream regularly and it would be better to have as less points of conflicts as we can.

Ok. I can understand that. thank you for quick reply. and sorry to bother you. I just started working and found this so I thought of mentioning it. I should have discussed with you first. I am closing this pull request.

Oh don't worry about that. We don't have much activity on this repo currently. So feel free to open any PRs if you find improvements. I'd be happy to discuss and move forward. :slightly_smiling_face:


update to 0.2.1

percy 0.2.1
Destination channel: distro-tooling

Linter check found the following problems:
ERROR conda.cli.main_run:execute(125): `conda run conda-lint /tmp/abs_68_ywdneo_/clone` failed. (See above for error)
The following problems have been found:
===== WARNINGS =====

clone/recipe/meta.yaml:17: avoid_noarch: noarch: python packages should be avoided
===== Final Report: =====
0 Errors and 1 Warning were found

Linter check found the following problems:
ERROR conda.cli.main_run:execute(125): `conda run conda-lint /tmp/abs_43um4gyghe/clone` failed. (See above for error)
The following problems have been found:
===== WARNINGS =====

clone/recipe/meta.yaml:17: avoid_noarch: noarch: python packages should be avoided
===== Final Report: =====
0 Errors and 1 Warning were found


Key value store

did a quick test because I can't resist a nerd snipe apparently 😅 (even unintended ones), and the test does fail, and my suggestion does fix the fail (once as usize is added because of the whole, can't add differently sized numbers 😅)


Scrollbar is always shown in MUI V5

I have started to look into MUI v5, and transition my own project, however I couldn't help but notice that scrollbars behave differently.

[x] The issue is present in the latest release.
[x] I have searched the issues of this repository and believe that this is not a duplicate.

Current Behavior 😯

Right now, anywhere throughout next.material-ui, a scrollable area's content is shifted by a ~15px scrollbar that is always shown.

Expected Behavior 🤔

I was hoping that scrollbars would look visually the same as the current stable release, where a scrollbar is overlaid on top of the content and only shown when you scroll.

Steps to Reproduce 🕹

I have just compared next.material-ui.com and material-ui.com.
Your Environment 🌎
Operating System: macOS Catalina 10.15.7 (19H15)
Browser: Safari 14.0.1 (156<IP_ADDRESS>.10, 15610)

Duplicate of #23520

Duplicate of #23520


spruce up app page

nice looking hero section with title, subtitle, downloads
use feature blocks
better screenshots
use 3 column view for featured torrents
add more links to third party references

I wanted to note here that we're calling it WebTorrent.app in the repo and WebTorrent Desktop on the site (with path of /app). Would be good to pick one and stick with it in both places.
preview:

Looks amazing!
For this app, here's what I think we should use:

WebTorrent Desktop on the website and in GitHub issues – distinguishes it from WebTorrent CLI, the webtorrent npm package, and the WebTorrent protocol
WebTorrent throughout the app itself. It would be redundant to write WebTorrent Desktop within the desktop app, IMO.

I just renamed the main repo to webtorrent-desktop.

Alright, I'll fix links in here to point to webtorrent-desktop

@ungoldman Sounds good to me. I added you to the repo as collaborator. Go ahead and self-merge this once you've updated the links to webtorrent-desktop.

Also note: Merges to this repo automatically deploy to https://webtorrent.io, so be careful :)

oh boy! I'll try to be careful :)

LGTM! nice design

Okay I'm pushing the button

Weeee looks like I didn't break anything: https://webtorrent.io/desktop


Fix Service Bus live test breaks

Description
WIP.
All SDK Contribution checklist:

[x] The pull request does not introduce [breaking changes]
[ ] CHANGELOG is updated for new features, bug fixes or other significant changes.
[x] I have read the contribution guidelines.

General Guidelines and Best Practices

[x] Title of the pull request is clear and informative.
[x] There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, see this page.

Testing Guidelines

[ ] Pull request includes test coverage for the included changes.

API change check
API changes are not detected in this pull request.

/azp run java - servicebus - tests

I'm sorry I broke them - let me send another PR to update ServiceBus to new tracing changes that would fix tests and implement some other features.

I'm sorry I broke them - let me send another PR to update ServiceBus to new tracing changes that would fix tests and implement some other features.

Awesome! Thank you @lmolkova! Please link to that PR when you are done, I would also like to gain some knowledge about the tracing tests.

Liudmila cleanup the integration test and is in a good state now, so we can close this pr.


May be useful to have some examples e.g. the get apr interactive method, and some others directly callable?

Not sure if this is hte only way to do it, but specifying a entry_point seems like a way we could then make the getapr method into a CLI tool?
@joeljonsson what do you think?

There seems to be two simple ways to do this. I think the only question is how we'd want to handle input arguments, e.g. some parameters or the input/output file paths. It would be nice to be able to circumvent the popups that we currently have in the demos


MyTriumph app interferes

Hi,
The other day I had trouble with aaidrive (the apps connection was not functioning so no spotify integration). After a long time of trying to troubleshoot I noticed that the mytriumph app was trying to connect to the bmw (or atleast the mytriumph notification said so). It should not do that, as it's an app for the connected head unit of my triumph motorcycle. Uninstalling mytriumph resolves and reinstalling it brings the issue back.
Not sure why this is happening, but I just want to leave the info here in case it might benefit someone

Fascinating! I bet it's because both MyBMW and MyTriumph see that the car has the SPP option and they both try to connect.
I saw that the MyTriumph app does check that the name starts with TRI, but I can't tell how it would skip that check and try to connect anyways. You should report this bug to the Triumph developers.
Instead of uninstalling and losing authentication and garage information, you could revoke the Local Devices permission from MyTriumph, which should prevent it from trying to connect and be fast enough to grant when you want to ride your motorcycle.

Thanks! There are loads of issues with the mytriumph app so it's not surprising, but I will take your info here and make a bug report to triumph
Thanks for the pointers on revoking local devices permission, I have force stopped it so far but this seems like an easier way :)

Did you hear back from them yet? I'm very curious :)


Let Prune Interval be configured

Since pruneOldGames is already called every hour
I thought it would be nice to make this configurable for each guild / server.
Though sadly i cannot test anything, this was done compeltely in browser, so the syntax might even be off.
The pruneOldGames starts by collecting all guildConfigs (or just using the one that initiated a prune command) and iterates over those before fetching the games for each of the guilds in the iteration.
I have no clue if the MongoDB drive is used correctly cause i never even did a NodeJS project.
I just wanted this and wanted to provide a starting point
THX for the nice Bot though
Hope this helps

If I were to implement this feature, I would like to do it myself. The purpose of purging old games was to prevent the data from exceeding free tier limits on MongoDB. I set the purge time as 2 days from the time of an event to give DMs a chance to reschedule the event if they needed to.
I'm not going to say this will never happen. I've wanted to allow this for some time. I will add it to the list of ideas for future features. For now, I'm going to close this pull request.

"The purpose of purging old games was to prevent the data from exceeding free tier limits on MongoDB" - I figured
"I set the purge time as 2 days from the time of an event to give DMs a chance to reschedule the event if they needed to" - I figured
This PR don't change any of the above
I've wanted to allow this for some time - here's a chance to do it with minimum effort
Anyways... if its not gonna happen... its not gonna happen
😭


Fixed the slider design to prevent overlapping of texts.

Fixed the style issue by adding line Height of 1 .
Also added padding to center the text for better readability
,

Closing in favor of https://github.com/code100x/cms/pull/15


Remove ioPath

Remove references to ioPath (stemming from using PathManager in https://github.com/facebookresearch/metaseq/blob/main/metaseq/file_io.py).  ~No longer needed.~ TBD on where https://github.com/facebookresearch/iopath/pull/17 goes

Just merged: https://github.com/facebookresearch/metaseq/pull/441


Dockerize the frontend app

Create a Dockerfile which contains instructions for building the Docker image

This work was done as part of https://github.com/CDLUC3/dmsp_frontend_prototype/pull/24, and was PR reviewed and merged


add missing redirect

Customer reported that an answer on SO would result in a 404 for the URL https://docs.microsoft.com/en-us/nuget/reference/packages-config
I've noticed that the file was renamed in this commit https://github.com/NuGet/docs.microsoft.com-nuget/commit/5cfa9b9f891af4505eb894f50699fe6ac9f0f82f#diff-d99b07c5c17aff7907086006735dce3a but the article was not redirected so fixing that
FYI @dasMulli @GuardRex

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

.openpublishing.redirection.json
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

Thanks for adding that!


Desktop: networking

Proposed changes
Update the documentation of Docker for Desktop networking.  Steal the Mac doc to start the Windows one.
I am unable to make snapshots of the Windows proxy setting pane, so I can't write the section ATM.  I will address this later (unless someone beats me :).
Related to https://github.com/docker/desktop-experience-backlog/issues/37.

Hi @gbarr01.  Sorry for the mistakes, I tried to rush before finishing my day, never a good idea...
Since then I have found that I could address the missing documentation about proxies in Networking by harmonizing the documentations of for-Mac and for-Windows.  So there's a lot of movement here, but it's basically just that: moving things around, to reach a clearer structure (hopefully).

Hi @gbarr01!  I believe this is ready to be installed.

@gtardif PTAL.

Hi @gbarr01.  I have fix the "searching" issue.   I have also updated the Troubleshooting part.
I can hardly touch anything until my PRs are merged, further work depends on this.
Cheers!


ObjImporter can import obj files from the local disk as well as from the web.

The public import function does now first of all check whether the file is present on the current local file system. If so it will use the local import function. If not it will use the web URL based one.

As proposed I removed the duplicated code. Now there is only one function that handles all the imports for local and web-based files. As @BenediktHensen proposed, this function uses a string as input instead of an uri. This allowed handling local and web-based files in the same way. At first, I started working on the Contentloader class that handles local files differently than web-based ones, but after some research, I found out that the Unity Web request is already capable of doing so. Therefore the pushed code still uses the Unity Web request as a Content loader.
The import of local and web-based files has been tested manually.


Show/explain spot instance recovery lifecycle

Simple flowchart/diagram

"simple" :see_no_evil:

https://en.wikipedia.org/wiki/Black_Square_(painting)


selected star rotation rotates from the name label center instead of the star position.

selected star rotation rotates from the name label center instead of the star position.

fixed (changed to a blink)

fixed (changed to a blink)


The starting model if never used is not exact

Strange one
Difficult to figure how to associate with Output tab

Solved,
It corresponded to an older version where there were less different keys for input.
Destination numbers now correspond directly to those used in the Output tab.


.netrc

machine github.com
login vikumchathuranga
password maduvkperera123

You don't want to contribute your personal credentials to an open source project. I'll close this one.


summary vs fivenum

The R summary is a fivenum summary + most common items counts for non numeric cols + count of NAs
A ddf fivenum is a fivenum summary + drop non-numeric cols + ignore NAs
A ddf summary is a method for a R base package generic and as such should be semantically close and if possible identical to the method for data.frames, particularly in this case where data frames in memory and distributed are implementation of the same abstraction (summary for vectors is by necessity a little different). Instead a ddf summary has: mean, min, max and count of NAs in common with R summary, stddev, count of rows, repeated for each column,  and returns NAs for string columns (not even the rows that make sense, like count an cNA)
My suggestion is: keep fivenum what it is, since everybody knows the five num summary. Make summary a true method for base::summary results should be identical.
Add a function for momenta like mean, stddev, skewness, kurtosis etc
If the changes in the definition of summary should apply to other languages is a bit more subtle.  I guess no one has the monopoly on the word summary. Unless there are specific expectation in Java or Python it'd be simpler to make them all the same. In R there are clear expectations for what summary should do.

@binhmop please look into this.


fix simplify_valid

the simplex should compare with valid bound, not its vmin

beam resnet works on green too


Extending Application and Activity

@bagnos commented on Sat Nov 17 2018
How Can I extend Application and Activity in a code-sharing project? There is no documentation about this kind of project, using the official documentation we get a ClassNotFoundException.

@bagnos the only thing that is different if that you might need to change the path to your extended application and activity files in the webpack.config.js. If using TypeScript to extend the application/activity you should also enable the experimentalDecorations in the tsconfig of the NativeScript app.
Here are the steps I've taken to extend the application in shared project:

Create new shared project (or use your already created one)
in src/app/home create the extended Application file application.android.js (using JavaScript file). Additional details here

const superProto = android.app.Application.prototype;

// the first parameter of the `extend` call defines the package and the name for the native *.JAVA file generated.
android.app.Application.extend("org.myApp.Application", {
    onCreate: function() {
        superProto.onCreate.call(this);
        console.log("Overwritten application");
        // At this point modules have already been initialized

        // Enter custom initialization code here
    },
    attachBaseContext: function(base) {
        superProto.attachBaseContext.call(this, base);
        // This code enables MultiDex support for the application (if needed)
        // android.support.multidex.MultiDex.install(this);
    }
});

In the webpack.config.js introduce the entry property in the config section

entry: {
    bundle: entryPath,
    application: resolve("./src/app/application.android.js"),
},

Remove the platforms folder and rebuild with --bundle

rm -rf platforms
tns run android --bundle

Overall the same steps are applied when extending activity but the activity is added in appComponents in webpack.config.js (just as the instructions given in the article) and with the modified path.
Here is how I've added the extended activity from activity.android.js in webpack.config.js
const appComponents = [
    "tns-core-modules/ui/frame",
    "tns-core-modules/ui/frame/activity",
    resolve(__dirname, "./src/app/activity.android.js"),
];

All of the above can be seen in this test project

hi,
I make the similiar typescript file application.android.ts, when I run the
project I get the following error:
ERROR in src/app/application.android.ts(4,2): error TS2304: Cannot find
name 'JavaProxy'.
Before that error I got this one fixed by the below configuration:
ERROR in ./app/application.android.ts
Module build failed (from ../node_modules/@ngtools/webpack/src/index.js):
tsconfig.tns.json
,
"files": [
"./src/app/application.android.ts",
]
kind regards,
Simone
On Tue, Nov 20, 2018 at 2:49 PM Nick Iliev<EMAIL_ADDRESS>wrote:

Closed #155
https://github.com/NativeScript/nativescript-schematics/issues/155.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/NativeScript/nativescript-schematics/issues/155#event-1977390402,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AGBQqhoIe0MUtZrgJkoB0q6zW0CkWKIcks5uxAhhgaJpZM4Yo-u6
.


formula in table with table-layout:fixed;

mathjax formulas don't respect table cell padding when using table-layout:fixed; and width:100%;
example works to show issue in both firefox and chrome:
https://codepen.io/sean1138/pen/pwJwLB
after reading here:
https://css-tricks.com/fixing-tables-long-strings/
it seems to me that this might be expected behavior but not sure so still posting this.
Can be solved if setting a width (style="width:80px;" works in my example linked above) on the first cell of the first row is acceptable.  Setting a width on the first cell of the second row (the one with the formula) does not work because table-layout = fixed in the CSS I assume.

I think you are correct and this is expected behavor. table-layout:fixed fixes the layout by the first row, i.e., each column has the same width as the first cell.
You might want to enable automatic line-breaking in this case, http://docs.mathjax.org/en/latest/output.html#automatic-line-breaking,  or make the .formula wrapper scrollable.


Decompose no longer works in Azure Devops

Been working for a while. Now all of a sudden if I click on Decompose and enter a few tasks in a PBI the "Create" button is still enabled but clicking on it doesn't produce any results.
Happens to all users in my org.

It should work now, I think there was an actual product issue that impacted extensions across the product.


[v2.0.0-alpha.73] autogenerated sidebars: have a stripNumberPrefixes option in config file?

Hi,
I just upgraded my Docusaurus to alpha.73, and noticed https://github.com/facebook/docusaurus/issues/3464, https://github.com/facebook/docusaurus/pull/4582 and https://github.com/facebook/docusaurus/commit/db79d462abd0fb04423a8a43b2e04a1dc643ad6d.
My site has its Markdown files named as yyyy-mm-dd.md, and alpha.73 tries to strip the number prefix for all the files.
Screenshot from when I try to start Docusaurus, because the prefixes got stripped out.
I'd like to propose that plugin-content-docs have a stripNumberPrefixes config option, so that I am able to disable this option for the entire plugin instance, without having to manually add the front matter to every Markdown file.
Alternatively, maybe some regex could be done to check if an ISO8601 date (e.g. yyyy-mm-dd or yyyymmdd) is the title or filename, and automagically disable the feature if so?
Also, it would be really cool if autogenerated sidebars could be generated in reverse alphabetical/chronological order (i.e. the newest is on top). Please let me know if I should start a separate issue for this!
Thanks!
Edit: thinking about it some more, I think prefixes should not be stripped if the user has explicitly created a non-autogenerated sidebar file. That seems like too much magic.

I'd like to propose that plugin-content-docs have a stripNumberPrefixes config option, so that I am able to disable this option for the entire plugin instance, without having to manually add the front matter to every Markdown file.

Agree we should have a global docs plugin option for this in addition to the existing frontmatter.
I'd like the config to allow you to pass a custom function parseNumberPrefix to parse file/folder names as position+rest the way you want, using false to disable this feature. Would it work for you?

Alternatively, maybe some regex could be done to check if an ISO8601 date (e.g. yyyy-mm-dd or yyyymmdd) is the title or filename, and automagically disable the feature if so?

Agree, as using dates in filenames is probably a common pattern.

Also, it would be really cool if autogenerated sidebars could be generated in reverse alphabetical/chronological order (i.e. the newest is on top). Please let me know if I should start a separate issue for this!

Agree.
You can write a custom sidebar items generators for this but it's not very convenient as it's not so easy to implement.
https://docusaurus.io/docs/sidebar#customize-the-sidebar-items-generator
We could allow that custom generation function to use the default docusaurus sitebar items generator, so that you can post-process it somehow.
module.exports = {
  plugins: [
    [
      '@docusaurus/plugin-content-docs',
      {
        sidebarItemsGenerator: async function ({defaultSidebarItemsGenerator,...rest}) {
          const sidebar = await defaultSidebarItemsGenerator(rest);
          return changeSidebarItemsOrder(sidebar);
        },
      },
    ],
  ],
};

It would be your responsibility to write the changeSidebarItemsOrder function.
It may not be the simplest API for this specific usecase but I think it's nice as it's flexible for many usecases and does not introduce a new API. Does it make sense?

Edit: thinking about it some more, I think prefixes should not be stripped if the user has explicitly created a non-autogenerated sidebar file. That seems like too much magic.

Unfortunately, it would be a bit complicated to do that, as Docusaurus reads the docs and strip prefixes even before handling anything related to the sidebars, so it would involve quite a complex refactoring that is probably not worth it. If this number prefix feature becomes annoying for a lot of users we could simply disable it by default.

I'd like the config to allow you to pass a custom function parseNumberPrefix to parse file/folder names as position+rest the way you want, using false to disable this feature. Would it work for you?

Yes, this would be great. It sounds like it'll at least revert back to the behaviour from alpha.72.

It would be your responsibility to write the changeSidebarItemsOrder function.

It may not be the simplest API for this specific usecase but I think it's nice as it's flexible for many usecases and does not introduce a new API. Does it make sense?

I think choosing between either the batteries-included or flexible API approach might depend on how many other users end up requesting to sort stuff by ascending/descending order. I think ascending/descending sort, at the very least, could be a reasonable complement to the new autogenerated sidebars feature.
If there are other fancy use cases that you might be able to think of, exposing it as a separate API might make sense then.
Personally, as someone looking to adopt Docusaurus, I'd like it if I could just drop in a couple of Markdown files, configure everything in docusaurus.config.js without having to write functions myself (or hunt around for code snippets), and get a docs site up and running in a few minutes.

Configurable parser and ignoring date patterns by default will be in https://github.com/facebook/docusaurus/pull/4655
For sorting the sidebars, for now I'll only document this use-case pattern in the docs plugin doc, and if this becomes requested quite often we'll try to design an API for this.
Designing this API may not be the easiest, there are multiple solutions to solve this use-case, and I'd like to avoid rushing on implementing something until I know better the use-case of other users.

Sidebar ordering will be solved with a low-level API for now, introduced in https://github.com/facebook/docusaurus/pull/4658
// Reverse the sidebar items ordering (including nested category items)
function reverseSidebarItems(items) {
  // Reverse items in categories
  const result = items.map(item => {
    if (item.type === "category") {
      return { ...item, items: reverseSidebarItems(item.items) };
    }
    return item;
  });
  // Reverse items at current level
  result.reverse();
  return result;
}

module.exports = {
  plugins: [
    [
      "@docusaurus/plugin-content-docs",
      {
        sidebarItemsGenerator: async function({
          defaultSidebarItemsGenerator,
          ...args
        }) {
          const sidebarItems = await defaultSidebarItemsGenerator(args);
          return reverseSidebarItems(sidebarItems);
        }
      }
    ]
  ]
};

This is now the most straightforward but is flexible. It is a good enough workaround until we see if there is traction for a proper sorting API, and gives time to design it. As autogen sidebar is now, we'll see if there is demand for such an API in the near future.


502 web server invalid response on attempt to create a new patient using the PatientPost Function

Deployed the quickstart sample as per the guide. However when trying to create a new patient using the patient.json file content under the tests folder , getting the below error

This should be fixed with the last PR, thanks!


Context Caching is not working anymore [High Impact BUG]

Description of the bug:
Context caching seems to be impacted by PermissionError and cannot be used now.
Actual vs expected behavior:
Below is the error from one of your cookbooks, which was supposed to work

Context caching so far was working until today, but it no longer allow us to create a model with context caching.
Any other information you'd like to share?
This I believe impacting a lot of developers and production loads wherever context caching is used, and it must be a very high impact bug.  But i'm really shocked such a fundamental production feature is down for so long and nobody notices in google.


Restore target environments in common & browser

Some parts in workbench dragged in dependencies to upstream environments (common => browser, browser => electron-browser).
Original:
First of all thank you for making a standalone version of monaco available. It is the greatest online editor and most people don't need more than that. But I was using monaco-workbench, its services and UI infrastructure in a custom web project, similar to vs online.
Thanks to great source structure my implementation was working very good until a recent change to https://github.com/Microsoft/vscode/blob/master/src/vs/workbench/browser/workbench.ts#L47 which references from electron-browser and prevents it to be used in web.
I know it has not been the intent to make everything reusable, but it would be greatly appreciated if the team maintain the code in a way to keep browser modules available in web for use cases like this.

Also according to https://github.com/Microsoft/vscode/wiki/Code-Organization#target-environments browser may not use from node, electron-browser and electron-main.

Good catch, this should not be the case. Have to look into it, but only for July.

Thank you, also there is another reference to vs/editor/node/model/modelBuilder in vs/workbench/parts/files/browser/textFileServices.

@bpasero I found more instances. Do you want me to add them here or you will review them all when you get time for working on it?

@malekpour that would be great. It is too bad we do not have a linter to give us a warning for this. I am sure we have many more cases throughout our code.
May I ask where and how you use the workbench standalone?

@bpasero I am using workbench and monaco for an online IDE to manage server side repositories, similar to Kudu and VS Online but for enterprise environment. I was using an angular app and ace editor but found monaco a great alternative. Currently waiting for release clearance before I can publish it open source.
I can report workbench issues in web environment here or wherever it is appropriate, please let me know.
I found the following references by regex searching for (/electron-browser/|/node/) in src/**/browser/** and excluding src/**/electron-browser/**.

That is pretty cool, thanks 👍

To be clear, I can not make a statement if workbench.ts stays in browser land. I will try, but eventually we might have to move it to electron-browser land. Using the workbench as such standalone was never intended nor planned with VS Code.

Good to know. In my case moving workbench.ts is not important because I have re implemented it in my repo anyway but please try to keep the rest sanitized from being mixed with electron.

I fixed some issues in workbench land and as expected workbench had to move into electron-browser.
Since the related issues are in @isidorn and @alexandrudima land, I am moving this issue to them.

Are you moving workbench.ts file only or it may affect other files in the browser folder like layout.ts?

@malekpour just workbench.ts

I fixed all the issues in my land #8806 #8802 #8807 #8803

@isidorn thanks dude!

@malekpour should be good now, let us know otherwise 👍

It works perfectly. Thank you :+1:


Linked queues GC nepotism issue

@normanmaurer @nitsanw
There has been an issue reported, re-produced and fixed for the Linked queues that were originally copied from JCtools:
Issue and discussion: https://github.com/akka/akka/issues/19216#issuecomment-194798879

This can be resolved by #4960

Closing as this is being discussed at #4960


Rewritten M3U8 URL does not work with Safari

Possible fix:
Check if user-agent is Safari, and if it is, provide original M3U8 URL

3e855ca almost solves the problem, only issue is that the string 'safari' is included in most browsers on OS X.


[view][xs]: Changed recline spec to simple spec since it did not show…

Changed views  property, recline spec to simple spec, because it did not show graph in the showcase page.

Seems fine to me


Headings should have meaningful content

Headings should not be empty
Headings should be reachable by ATs

Types of changes

[ ] Bug fix (a non-breaking change which fixes an issue)
[x] New feature (a non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Description
Checks that headings (h1...h6) are not empty and that they don't have aria-hidden. I did not check for image as an only-child as, after running some tests, the :only-child selector does not count text nodes as children, so it would get false positives.
Resolves #33
Link(s)

MDN: :empty pseudo-class
MDN: :only-child pseudo-class

Screenshot(s)

Checklist:

[x] I have thoroughly read the CONTRIBUTING guidelines.
[x] I understand my pull request will be thoroughly reviewed at high detail.
[x] I understand the work in my pull request will only be available in the next version release of Checka11y.css and not in the current version release.
[x] I confirm the work in this pull request is valid according to my findings and is not something for anything personal.
[x] I have updated the README where and if applicable (still put an x if you have considered this but thought there was nothing to add or modify).
[x] I have added myself to the contributors section in package.json (still put an x if you have considered this but decided not to add yourself).
[x] I have checked I have not committed any accidental files.
[x] I have tested all the main modern browsers (I.e. Chrome, Firefox, Edge, Safari - please leave this unchecked if there were any browsers listed you could not test and list them in the help section with details why you couldn't test that browser)
[x] All new and existing a11y checks still work correctly (compare your local test/index.html to the test/index.html in the master branch).

Help
Only tested on Mac (Chrome, Firefox, Safari, and chromium-based Edge). May need testing on IE/Edge on Windows.

@danspratling you were involved a lot with this conversation 🙂

Thanks for reviewing and approving so fast :)


Shopware Commercial throws error when password recovery detects inactive user

Description: When a user is inactive and tries to send himself a password recovery mail, the shop throws an EmployeeManagementException (customerNotFoundByEmail). Usually the sendRecoveryMail method always returns a success message, saying that you'll get an email if the mail address is connected to a user.
Environment:
Steps to reproduce: Set a user to inactive and fill+submit the password recovery form with that users mail address.
Expected result: Show the same success message as if the Shopware Commercial plugin was not active.
Actual result: You get an exception (depending on your env settings you'll see the whole exception or just the "something went wrong" message).

[public] Shopware automated response: This issue is linked to the internal issue: NEXT-31030
[created from NEXT-31030, comment 529065]


OverflowError: Python integer -1 out of bounds for uint64

I am getting above error when I run:
python simple_trainer.py --data_dir nerf_data/data/garden/ --data_factor 4 --result_dir ./results/garden

any more error log and env info you can share?

@liruilong940607 I pip installed this torch wheel: https://download.pytorch.org/whl/cu117/torch-2.0.0%2Bcu117-cp310-cp310-linux_x86_64.whl#sha256=f6e26492d214edab5b407e903ed3c7b190ac5709330bd72060d1be01b354c198
Then pip installed gsplat from source: pip install git+https://github.com/nerfstudio-project/gsplat.git
Then pip install -r requirements.txt (in examples folder)
error log:
(env_gsplat) :~/Gaussian_splatting/gsplat_studio/gsplat/examples$ python simple_trainer.py --data_dir /nerf_data/data/garden/ --data_factor 4 --result_dir ./results/garden
Traceback (most recent call last):
File "/home/ard/Gaussian_splatting/gsplat_studio/gsplat/examples/simple_trainer.py", line 16, in
from datasets.colmap import Dataset, Parser
File "/home/ard/Gaussian_splatting/gsplat_studio/gsplat/examples/datasets/colmap.py", line 8, in
from pycolmap import SceneManager
File "/home/ard/Gaussian_splatting/gsplat_studio/env_gsplat/lib/python3.10/site-packages/pycolmap/init.py", line 4, in
from .scene_manager import SceneManager
File "/home/ard/Gaussian_splatting/gsplat_studio/env_gsplat/lib/python3.10/site-packages/pycolmap/scene_manager.py", line 21, in
class SceneManager:
File "/home/ard/Gaussian_splatting/gsplat_studio/env_gsplat/lib/python3.10/site-packages/pycolmap/scene_manager.py", line 22, in SceneManager
INVALID_POINT3D = np.uint64(-1)
OverflowError: Python integer -1 out of bounds for uint64
Data folder structure:

Hi,
I think it's the latest numpy deprecate the support of conversion of out-of-bound Python integers, which is required in pycolmap at here.
We use numpy==1.26.4 in our development in a Linux environment. Maybe you can try this numpy version? Hopefully it will behave the same way in windows.

@liruilong940607 Thank you!!
using numpy==1.26.4 solved this.(i was using numpy==2.0.0)


Roll engine 4aaa1a948828..5ed1414e564c (1 commits)

https://github.com/flutter/engine/compare/4aaa1a948828...5ed1414e564c
git log 4aaa1a948828bf2c322d10fb5c1bf4e954e1c228..5ed1414e564cf78a8026a1081e22dab5823dea4c --no-merges --oneline
5ed1414e5 Roll fuchsia/sdk/core/mac-amd64 from 6WJ2NCb9uaOzVw20XC4kJqNcD4EP2VxT-PBocGsA6JsC to 80DiQjMLrywJCY71q8_dXRFGwj8mszVpnwWHqqU1IZMC (flutter/engine#9569)
The AutoRoll server is located here: https://autoroll.skia.org/r/flutter-engine-flutter-autoroll
Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+/master/autoroll/README.md
If the roll is causing failures, please contact the current sheriff (chinmaygarde@google.com), and stop
the roller if necessary.

Auto-roller completed checks. About to merge.


Collect information also directly from ANSSI/BSI pages

For the Common Criteria certificates we currently collect information from:

the csv from the Common Criteria portal at https://www.commoncriteriaportal.org/products/certified_products.csv,
the html from the Common Criteria portal at https://www.commoncriteriaportal.org/products/,
the certificate report documents (PDF) linked from 1. and 2., and
the security target documents (PDF) linked from 1. and 2..

We should probably also collect information directly from the pages of big members of CC that produce the certifications (https://www.commoncriteriaportal.org/ccra/schemes/) like ANSSI and BSI. We can then cross-check this data with the data we collect using our existing method and possibly augment it using this new data source if we see some improvement.
The steps in this task are:

[ ]  Examine the pages of the CC members (e.g. ANSSI, BSI) that produce certifications (linked from https://www.commoncriteriaportal.org/ccra/schemes/) and see which ones have some sort of a listing of products they certified which has at least some minimal amount of information about the certificates.

Example for ANSSI: https://www.ssi.gouv.fr/en/products/certified-products/
Example for BSI: https://www.bsi.bund.de/EN/Topics/Certification/certified_products/certified_products_node.html

[ ]  Implement functionality that parses interesting data about the certificates out of the aforementioned pages.

Start with ANSSI and BSI pages.
Get inspired by the existing codebase and how it works with Certificate objects (but no need to be completely like the existing codebase at the start).
Also have the ability to export the results to JSON (like the current datasets and certificates).

[ ] Compare the extracted data from the aforementioned pages with data collected using our current methods.

Do we correctly match the certificate id for the certificates?
Are the PDFs linked from the pages of the CC members the same as the ones linked from Common Criteria directly?
Is there some data that we are missing?

[ ] Consider a way of enriching our current dataset collected from the CC with the data collected from the aforementioned pages.

Only makes sense if there is something we are missing or that we have wrong.

@KeleranV the first step could be to compare what information about certificates is available on BSI webpage and what information is available on CommonCriteria.org. Would these sources provide (nearly) identical info, I would suggest just to create new constructor similar to from_html_row().
In fact, even the certificates constructed from CommonCriteria webpage are fetched from two distinct sources:

from_html_row()
from csv.

We are then able to merge 2 partially parsed record of single certificates into one: merge()
Would there be a drastic difference (e.g. BSI providing only few pieces of information), I suggest to create all new class to parse the BSI pages and then create a method of CCDataset that would merge these objects into CC certificates.
Regarding branching, I suggest you work with dev branch. But you may want to take a look at the folder structure of cc-feature-parity. Practically, I just split multiple classes in one file into more files, nothing else changed. Your implementation should be easy-to-merge, but I guess that won't be difficult.

@KeleranV I won't be splitting the issues in the end, I'll just write the subtasks for ANSSI webpage here:

[ ] Retreive dictionary of certificates for each category of https://www.ssi.gouv.fr/en/products/certified-products/
[ ] For each certificate, e.g., https://www.ssi.gouv.fr/certification_cc/etravel-essential-1-2-bac-and-aa-activatedrelease-0300/ retreive all possible information
[ ] Retrieve also maintenance reports
[ ] Manually compare hashes of at least 3 different certificates (certificate report, security target) and report whether they match (by cryptographic hash) their twins on commoncriteria.org or not

The data does not need to be stored in fancy objects, just use dictionaries.

Here are all the pages of the schemes analyzed for the interesting lists.
Australian Certification Authority (ACA)
Has a list of "products currently in evaluation" at:
https://www.cyber.gov.au/acsc/view-all-content/programs/australian-information-security-evaluation-program
No obvious list of all certified products.
Canadian Common Criteria Scheme
Products in evaluation:
https://www.cyber.gc.ca/en/tools-services/common-criteria/products-evaluation
Certified products list:
https://www.cyber.gc.ca/en/tools-services/common-criteria/certified-products
ANSSI
Certified products:
https://www.ssi.gouv.fr/en/products/certified-products/
No obvious list of products in evaluation.
BSI
Certified products:
https://www.bsi.bund.de/EN/Topics/Certification/certified_products/certified_products_node.html
Has sub pages for product categories.
Indian Common Criteria Certification Scheme (IC3S)
(has an expired TLS cert)
Certified products:
https://www.commoncriteria-india.gov.in/product-certified
Archived products:
https://www.commoncriteria-india.gov.in/archived-prod-cer
OCSI - Organismo di Certificazione della Sicurezza Informatica
Certified products:
https://ocsi.isticom.it/index.php/elenchi-certificazioni/prodotti-certificati
Products in evaluation:
https://ocsi.isticom.it/index.php/elenchi-certificazioni/in-corso-di-valutazione
JISEC - Japan IT Security Evaluation and Certification Scheme
Certified products:
https://www.ipa.go.jp/security/jisec/jisec_e/certified_products/certfy_list_e31.html
Archived products:
https://www.ipa.go.jp/security/jisec/jisec_e/certified_products/certfy_list_e_archive.html
Products in evaluation:
https://www.ipa.go.jp/security/jisec/jisec_e/prdct_in_eval.html
CyberSecurity Malaysia
Certified products (archived marked but included):
https://www.cybersecurity.my/mycc/mycprA.html
Products in evaluation:
https://www.cybersecurity.my/mycc/mycprC.html
NSCIB
Certified products:
https://www.tuv-nederland.nl/common-criteria/certificates.html
Products in evaluation:
https://www.tuv-nederland.nl/common-criteria/ongoing-certifications.html
Australasian Certification Authority (ACA)
Same as Australia.
SERTIT
Certified products:
https://sertit.no/certified-products/category1919.html
Only publishes products in evaluation as "articles" on its page.
IT Security Certification Center(ITSCC)
Certified products:
https://itscc.kr/certprod/list.do?product_class=1
Suspended certified products:
https://itscc.kr/certprod/list.do?product_class=2
Archived products:
https://itscc.kr/certprod/list.do?product_class=4
Cyber Security Agency of Singapore
Certified products:
https://www.csa.gov.sg/Programmes/certification-and-labelling-schemes/csa-common-criteria/product-list
Organismo de Certificación de la Seguridad de las Tecnologías de la Información
Certified products:
https://oc.ccn.cni.es/productos-certificados/productos-certificados
Swedish Certification Body for IT Security FMV/CSEC
Certified products:
https://www.fmv.se/verksamhet/ovrig-verksamhet/csec/certifikat-utgivna-av-csec/
Products in evaluation:
https://www.fmv.se/verksamhet/ovrig-verksamhet/csec/pagaende-certifieringar/
Archived products:
https://www.fmv.se/verksamhet/ovrig-verksamhet/csec/arkiverade-certifikat-aldre-an-5-ar/
TSE (Turkish Standards Institution) Common Criteria Certification Scheme
Certified products (yes, it is a PDF):
https://statik.tse.org.tr/upload/tr/dosya/icerikyonetimi/3300/03112021143434-2.pdf
National Information Assurance Partnership
Certified products:
https://www.niap-ccevs.org/Product/index.cfm
Products in evaluation:
https://www.niap-ccevs.org/Product/PINE.cfm
Archived products:
https://www.niap-ccevs.org/Product/Archived.cfm


No reason to use soon to be deprecated jquery apis.

No reason to use soon to be deprecated jquery apis.

Looks good, thanks!


Scrolling loses inertia when rendering more items from data source?

New issue checklist

[x] I have reviewed the README and documentation
[x] I have searched existing issues and this is not a duplicate

General information

IGListKit version:
iOS version(s): 11.2
CocoaPods/Carthage version: 3.2.0
Xcode version: 9.2
Devices/Simulators affected: All that I tested with: Phone 6 (device), iPhone X (device), iPhone SE (simulator)
Reproducible in the demo project? (Yes/No): https://github.com/achan/hesijimbo-ios
Related issues: Possibly similar to https://github.com/Instagram/IGListKit/issues/1004

Debug information
# Please include debug logs using the following lldb command:
po [IGListDebugger dump]

I'm still new to IGListKit so forgive me if I have this all wrong.
In two separate apps, one developed by me and another developed by a co-worker, we've seen scrolling inertia abruptly stop when trying to load more items to our UICollectionView (a la infinite scroll).
They're both implemented similarly to this:
// VideoFeedController.swift
override func scrollViewWillEndDragging(_ scrollView: UIScrollView, withVelocity velocity: CGPoint, targetContentOffset: UnsafeMutablePointer<CGPoint>) {
  let distance = scrollView.contentSize.height - (targetContentOffset.pointee.y + scrollView.bounds.height)
  if !viewModel.isLoading && distance < 200 {
      loadMore()
  }
}

Where loadMore() is ultimately performing a network request, converting the request into ListDiffable view models, appending to the data source and telling the adapter to perform updates.
UICollectionViewController:
private func load(request: Promise<Void>) {
  adapter.performUpdates(animated: true, completion: nil)
  _ = request.done { [weak self] listing in
    guard let strongSelf = self else {
      return
    }

    strongSelf.adapter.performUpdates(animated: false, completion: nil)
    strongSelf.refresher.endRefreshing()
  }
}

View Model:
@discardableResult
func loadMore() -> Promise<Void> {
  isLoading = true
  return service.perform(pagination: pagination).done { [weak self] listing in
    self?.loaded(listing: listing)
  }
}

private func loaded(listing: VideoFeedListing) {
  isLoading = false
  items.append(contentsOf: listing.items)
  pagination = listing.pagination
}

I've played around with moving loadMore() to a background thread with similar outcome, though I believe network requests from URLSessionDataTask do that automatically?
Here's a screen capture of the bug in action. I've added a print statement for emphasis.

Thanks for your time and all the hard work on this library 👏

My best guess to what's going on is that the target offset after scrolling finished is relative to the content size before the page finishes loading. Then the load finishes before the scrolling animation is done, but the resting offset has already been determined. So your new content loads but the scrolling just ends.
One idea to fix this is to make your loading trigger distance way larger (on Instagram its like 2x your screen height, pretty large).

@achan Did you find a solution? I have the same problem.
@rnystrom I often get stuck when scrolling very quickly and adding new objects
        model.append(contentsOf: newElements)         listAdapter?.performUpdates(animated: false, completion: nil)

I did not, @szubiszon. It was a side-project that eventually got dropped 😢

I've solved this issue by using
let oldItem = model.items
olditem.append(newsItems)
model.items = olditem

//then
listAdapter?.performUpdates(animated: false, completion: nil)


After creating a Model overwritten a simple array to an array of objects

After creating a Model overwritten a simple array to an array of objects, this is answer from the server :

and what we have after in Model :

How can I get a simple array in the Model?

That is not bug of mobx-model. Bug in mobx-model-json-api wrapper library. Close this issue here.

@Staltec ok, thanks


Conflicting documentation about wpa_supplicant.conf

The options documentation in nixos/modules/services/networking/wpa_supplicant.nix says two contradictory things:

NixOS currently does not generate wpa_supplicant.conf.
If userControlled.enable is true, be sure not to create wpa_supplicant.conf

Probably the first message should be updated to say under what conditions wpa_supplicant.conf will be auto-generated, but I don't know how this works.
Paging @edolstra, who seems to be the only one editing wpa_supplicant.nix (sorry!)

The userControlled.enable option was actually added by @bluescreen303 :smiley:


Fix application of pagination options on ListCopilotSeats endpoint

The pagination options were previously being applied as the Request body, instead of applied to the URL as in other List endpoints. This PR ensures that these options are correctly applied to the URL and introduces additional parameters in the test case to ensure this.

Thank you, @ryanskidmore ! LGTM.
Awaiting second LGTM+Approval from any other contributor to this repo before merging.

Hey @gmlewis just wanted to follow up on this. I noticed codecov is still failing, do I need to add any more tests to this?

Hey @gmlewis just wanted to follow up on this. I noticed codecov is still failing, do I need to add any more tests to this?

No, codecov has been pretty unreliable lately. You can ignore it in this case.

Thank you, @be0x74a !
Merging.


Unclear error encountered attempting to deploy app to local device.

I have a smallish app working properly in the emulator.  Following the react docs on device deployment, option 2 for offline js package mgmt, getting an error i'm unclear on.

Working code base is https://github.com/jcdavison/bio-stream-native/tree/deploy-to-device
and SO post is http://stackoverflow.com/questions/33639542/what-error-is-prohibiting-my-react-native-build-for-on-device-app-execution
I appreciate this probably isn't a library bug but I generally get low activity on SO about react native questions and was hoping for some polite flash-light shining into a direction I should be thinking about going.
Cheers,
JD

@facebook-github-bot answered


Differentiate bus station from bus stop

Probably bus stop looses most of it's glow / gets smaller?


Visual separation between staged and unstaged files in Source Control window

When viewing the Source Control window in "Tree View" mode, the folder structure is shown as an indented heirachy.  When some files are staged and some are not, the staged files are "grouped" and displayed in (visually at least) another folder.  This makes it difficult to identify quickly

Which files are staged and which are not
Where the boundary between the staged and not-staged files lies.

It would be easier if their was either a differentiation between the "actual code" folders and the "Staged Changes" and "Changes" Folders, or a space between the two staged and not staged sections.
For example:

A heading bar like the "GROUP" bars on the "OPEN EDITORS" section of the Explorer window may be good:

IIRC, prior to 1.47 the 'Staged Changes' and 'Changes' headers were rendered as 'STAGED CHANGES' and 'CHANGES'. This happened because SourceControlResourceGroup items were always forced to UPPERCASE. I think it's good that this no longer happens, since some SCMs use ResourceGroups for purposes where case can be important. But it ought to be easy enough for the (built-in) Git extension to uppercase its ResourceGroup labels.

Thanks for the input, merging with https://github.com/microsoft/vscode/issues/102118


Support a --log-format short cut

Migrated from GitLab: https://gitlab.com/meltano/meltano/-/issues/3070
Originally created by @pandemicsyn on 2021-11-17 20:53:23

Per @rabidaudio in https://gitlab.com/meltano/meltano/-/merge_requests/2395#note_731245620

Would it be possible to configure the log format from CLI args? It seems like the way to configure it as designed now is through the log handler files. It seems clunky to ask users to turn on structured logs everywhere just so they show up nicely in Dagster. I suppose our Dagster pipelines could generate an alternate logging.yaml file and pass with --log-config, would this be the recommended way?

We could definitely add a basic --log-format=[json|keyvalue|uncolored-console] flag that switches meltano to use one of our other built-in formatters for the console logger if there's no logging config present.
It would be a nice shortcut for scenarios where folks don't want to supply a more elaborate logging config, and really just want to be able to switch from a human-friendly format to a machine-friendly format.

View 7 previous comments from the original issue on GitLab

Still relevant


Add blacklist option for paths to Firebase::Client (with spec)

See Readme Update for why

Can you explain why you wouldn't just use Firebase security rules?
https://www.firebase.com/docs/security/guide/

@vincentwoo I would be happy to!
When you authenticate with a secret key on firebase, it basically totally disregards the security rules. In our case, every user has to be authenticated with a UID  to access their node under the users node, but if i need to write a script to manipulate many users, then i have to use secret key authentication.
I did test if putting false under users for .read and .write would work, and sent a request to /users for our test firebase account, and it did indeed crash the firebase account. This addition is meant to give peace of mind when using secret key authentication that certain locations will never get a request sent to them.

Vincent is correct here in that you should just use security rules to prevent access to certain nodes. Authenticating with a secret is generally regarded as a bad practice because it will cause you to skip all rules, including validate rules which enforce your schema. You should instead mint a custom token for your server with a custom uid, write rules against that uid, and then authenticated with that custom token. This is a much safer option and gives you the intended behavior without any changes to this library. See our custom authentication docs for more information.

@jwngr. That seems better indeed. Thanks!

I guess, if someone is going to use a secret token though, this is still a security feature. But I'll be making the change to use custom auth for us.


Docs build improvments

Note: This builds on #1210, which cleans up all the issues the new make docs docs-lint code will catch. Please review that first.
Summary
This PR introduces a new make target docs-lint which runs milv -ignore-external on all of our docs. As well, the regular make docs and make run-docs now use the --strict flag to catch issues.  Both of these changes are building towards enforcement of these targets on all pull requests.
Why?  We had tens to hundreds of broken internal links in our customer facing documentations that @benarent and I cleaned up in #1210. Providing tooling to catch link rot and enforcing that will prevent issues like this from creeping back in.  This also establishes an engineering norm that docs quality is enforced by automatic tools.
In addition to the necessary changes, I also refactored our docs Makefile substantially, to better use partial builds and caching.  See individual commit messages for more information about those changes.
I will rebase out Placeholder for #1210." once #1210 lands--this commit is the minimal amount of @benarent's work needed for the rest of my changes.
Contributes to fixing #1220.
Testing Done
make docs and make docs-lint on this branch:
docs-build-dirty.txt
make docs and make docs-lint on a branch based on top of #1210:
docs-build-clean.txt
I also have a PR job basically ready to run these new targets against every PR to gravity.  See https://jenkins.gravitational.io/job/gravity-pr-docs/ and the test PRs here:
https://github.com/wadells/gravity/pull/1
https://github.com/wadells/gravity/pull/2
https://github.com/wadells/gravity/pull/3
We just need to flip it over from my personal repo to the main repo and configure webhook pushes to make it go live.

Macro question: Should the docs-lint target be separate from the docs target?  Or should docs depend on docs-lint to make this easier to use.


Create a screen for legal information

Point to include:

a screen which has only text in it

Notes:

for the imprint and privacy screen we want to use the same screen, but different data in it

:tada: This issue has been resolved in version 1.0.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Ensure that broker's API hostname is retrieved properly

Ensure that hostnames of brokers starting with one of h,p,s,t letters are retrieved correctly.

That made me chuckle!
/approve

That made me chuckle!

Indeed, I debugged failure of Submariner deployment on ROKS clusters, GW pod complain it could not resolve hostname of Broker's API server.
Comparing the apiServerURL hostname from the infrastructure/cluster resource to the brokerK8sApiServer hostname from submariner CR noticed that the 's' was dropped :-)
sd579c61a6bedc821faa3-6b64a6ccc9c596bf59a86625d8fa2202-ce00.jp-tok.satellite.appdomain.cloud:30263
vs
d579c61a6bedc821faa3-6b64a6ccc9c596bf59a86625d8fa2202-ce00.jp-tok.satellite.appdomain.cloud:30263

/lgtm

/cherrypick release-2.11


Critical regression introduced in Mapster 7.3.0 when mapping to existing objects

There are numerous issues that have been reported since the release of 7.3.0 that seem to have a common theme -- performing a map to an existing object has a tendency to create a new object instance instead of preserving the instance being mapped. So far it seems that the following issues have reported this:

#427
#430
#498
#485
#482
#524

Other possibly related issues:

#546

I'm working on investigating which chance in 7.3.0 that might have introduced this issue. I will update this issue when I have new information to share.

Hello.
In this case, should not be version 7.3.0 marked as deprecated because of critical bugs in nuget.org?

hi, is there any progress?

Hello, new instanse always created if TDestination does not have a public constructor without parameters. Maybe this has something to do with the problem.

Thanks to @DocSvartz this issue has been partially fixed. See #634 for details.

Hello @andrerav , have you had problems with dictionaries ?
The generic KeyValuePair has always been treated as a record.

@andrerav  I open PR #646  When  2 Step of Fixing this problemm :)


Display Flash/RAM Percentages like web IDE

When code is compiled/flashed in the web IDE, it displays something along the lines of
Output of arm-none-eabi-size:

text    data    bss dec hex
77280   1312    11856   90448   16150

In a nutshell:
Flash used  78592 / 110592  71.1 %
RAM used    13168 / 20480   64.3 %

I think this would be very handy for the CLI as well.  I'm not sure if this might break expected behavior for some since I could see parsing the usual output as some sort of automated/scripted process.  Perhaps a --percent flag could be used to get the extra information.
For those with access, there was discussion about this in the web IDE for the Spark Core a long time ago -- https://community.particle.io/t/show-ram-usage-in-ide/4207

This is implemented in the latest version at  least:
Compiling code for photon

Including:
    GPS_HardwareSerial_Parsing.ino
    ../../library.properties
    ../../src/Adafruit_GPS.cpp
    ../../src/Adafruit_GPS.h
attempting to compile firmware
downloading binary from: /v1/binaries/5888936c41af1650add20d4b
saving to: photon_firmware_1485345641505.bin
Memory use:
   text	   data	    bss	    dec	    hex	filename
  21324	    172	   1808	  23304	   5b08
Compile succeeded.


Auto-generated names when moving resources between stacks

I am trying to refactor my stacks a bit, and so have moved some resources from the main project to a new project. I did this by adding import options for the resources in the new project, and then did pulumi state delete on them in the old project. However, the crux is that most of the resources had auto-generated names, meaning that I had to explicitly name them in the new project, just copy/pasting the original generated names into the code, to get the import to go through. I was hoping to be able to remove these explicit names after the import by using the aliases option, however this does not seem to work (I get a diff for the name property on pulumi up). I tried both aliases: [{name: "old-name" }], aliases: [{stack: "old-stack", project: "old-project"}] and aliases: [{name: "old-name", stack: "old-stack", project: "old-project"}].
The reason I want to get rid of the name tags is that I have prod/dev stacks set up, and the names are of course different in the two, so then I'd need some kind of list with all the prod+dev names from the old project and look them up in the new project, which will get really ugly.
Is there something I can do at this stage to get Pulumi to match the resources correctly? Or is there something I can do at import time to avoid this issue? I'm using an S3 bucket as backend, btw, if that has any bearing.

When you refer to name do you mean:

The logical name of the resource, which is then used to auto-generate a physical name
An explicit physical name:  passed to resource
A Name tag on a resource like an EC2 instance?

Also - what specific resource are you working with?

@lukehoban Thanks for the quick reply! I mean the physical name. The logical names (i.e. first argument to the resource constructor) are the same in both new and old stacks. This concerns some AWS resources, so while most are called name:, there are also a bucket and a statementId´. To be specific, I have this issue with aws.iam.Role, aws.s3.Bucket, aws.dynamodb.Table, aws.iam.RolePolicy, aws.lambda.Function, aws.lambda.Permission, aws.ses.ReceiptRule, aws.iam.User, aws.iam.UserPolicy`. In practice, I only really care about the bucket and dynamodb table, since the others are cheap to recreate.

I ran into a similar issue. When importing an s3 bucket, it requires that I set some values that would otherwise not be required by me to set (default provided by the provider), which are the arn and the hostedZoneId.
Looking at the hostedZoneId, the terraform provider hard codes a table of these hostedzones:
https://docs.aws.amazon.com/general/latest/gr/s3.html
https://github.com/hashicorp/terraform-provider-aws/blob/722c1f1fc8fb9fe4371d63d51a21df6397f6a5fd/internal/service/s3/hosted_zones.go#L40
What I don't understand is why does the code actually have to match all attributes when some of the attributes are computed and only need to be stored in state.

Auto-naming uses data that is not in the cloud, so pulumi import won't work. Before this is fixed, you can do manual state surgery to copy in the full state of the resource. This will get auto-naming to work as expected.
Ultimately, the solution to this issue is for Pulumi to natively support transferring resources between stacks/projects. We have an open issue for that in pulumi/pulumi: https://github.com/pulumi/pulumi/issues/3389.


Unable to login without using SSL or localhost

When the application is deployed using docker or dist packages and opened from a non-localhost IP address or using a domain but on http(i.e. http://wg-ui.local) you're unable to login with the following error being presented:

The login works only when it's accessed via localhost or when SSL is used.
Reading the error it would appear that is the case due to the usage of Secure Cookies.
Tested with version 0.0.13 from https://github.com/UnAfraid/wg-ui/releases/tag/v0.0.13

You can work around this by copying your token (eyJxxxxxxx) and pasting the following into the Developer console:
document.cookie = 'apollo:default.token = eyJxxxxxxx';


How can I send println output to vscode terminal not debug console?

Character corruption occurs for Japanese text while launching debug.
I heard I can avoid this by sending ouput to vscode terminal not debug console at following page.
https://github.com/Microsoft/vscode/issues/3550
How can I switch to terminal?
I cannot find such option in launch.json sample.
For example in Python launch.json, I can find "console" option.

"configurations": [
    {
        "name": "Python: Current File (Integrated Terminal)",
        "type": "python",
        "request": "launch",
        "program": "${file}",
        "console": "integratedTerminal"
    },

Please help to popularize kotlin and vscode in non-English world!

Sending the output to the integrated terminal is not yet possible.
I could imagine this being implemented by running the gradle command directly through the terminal and then attaching the debug server.
Still, I am unsure whether the encoding is an issue with the debug console or the debug server. UTF-8 support should be available throughout VSCode.