Is it possible get shell information from setting file?

Hi. I love your script. It's really useful about my shell life with windows. I never thought without it. Although, I need a little bit more feature. I really want to use with Anaconda shell also. I have several shells like below image.

And I want to run anaconda shell with context menu. I try to edit your code myself. Unfortunately, It's too difficult to me. So, I have an idea if is it possible making context to menu from Terminal setting. It's really good for me.
Thanks again!!!

If you want extra shells, you should go and edit Windows Terminal settings first, and then rerun install.ps1.
I don’t think editing this script in the first place will help.

WOW~~!!! It's already work with setting config file. I try to install again and it's work perfectly! Thanks!! 🍺

Aha, I see what you meant now.
Right. This install script is one time, so it won't be able to automatically update menu items when you update anything in Windows Terminal.
But rerun it and the new settings are picked up :)


Fix issue with language specific certificate trust

And ensure that template calls test-proxy.

/check-enforcer override
Ignoring core as it will succeed.


Add shorthand for HEAD request

In the same way that we have shorthands for get, post etc. it would be nice to add another shorthand for a HEAD request. I can't seem to define a route that will handle this request and thus it breaks my acceptance tests when that request is sent.
Tested on ember-cli-mirage 0.1.13.

Same with Beta.

https://github.com/samselikoff/ember-cli-mirage/commit/222a4b0815161de038942954f78922388193d234 closes


c\c++ static&global variable label  is reversed in debug panel

OS: <macos 12.1 (21C52)>
VSCode version:  <1.63.2
899d46d82c4c95423fb7e10e68eba52050e30ba3
arm64>
CodeLLDB version: <v1.6.10>
Compiler: <clang-13<IP_ADDRESS>>
Debuggee: <a.out>
this is my code
int this_is_global; // !! this is  a global var
void fun()
{
   static int this_is_static; //this is a static var
   this_is_static = 1;
}
int main()
{
   fun();
   return 0;
}

but the VARIABLES label in RUN AND DUBUG panel will show:
Static:
this_is_global:0
Global:
this_is_static:0
so what I want to express is that the variable type is wrong in debug panel

Verbose log

 oh i think i'd better attach this picture

 oh i think i'd better attach this picture


Take 3D shape into account in examples in README.md

Fixes https://github.com/donmccurdy/ndarray-pixels/issues/155
The examples in the README.md iterated only over 2 of the 3 shape dimensions, causing a currupted image to be generated.
This is the minimal fix.
I'd lean towards describing in more detail what's happening there, either in the TSDoc of the functions themself or as inlined comments in the example, like
// shape[0] is the width of the image
// shape[1] is the height of the image
// shape[2] is always 4, for the RGBA channels of the pixels

But I didn't want to mess around beyond the main fix. Just drop me a note if further comments should be added.

Thanks! I've merged this and added a bit more clarification to the example. Would welcome other ideas if you think anything is still missing.


[Bug]: Expected server HTML to contain a matching

Which Remix packages are impacted?

[ ] remix (Remix core)
[ ] create-remix
[X] @remix-run/architect
[ ] @remix-run/cloudflare-workers
[ ] @remix-run/dev
[ ] @remix-run/express
[ ] @remix-run/netlify
[ ] @remix-run/node
[ ] @remix-run/react
[ ] @remix-run/serve
[ ] @remix-run/server-runtime
[ ] @remix-run/vercel

What version of Remix are you using?
1.0.6
What version of Node are you using? Minimum supported version is 14.
14.17
Steps to Reproduce

Start a new remix project
Select architect deployment target
Run npm run dev & arc sandbox
Sometimes the following error shows up in the console:

react-dom.development.js:67 Warning: Expected server HTML to contain a matching <script> in <body>.
    at script
    at LiveReload (http://localhost:3333/_static/build/_shared/chunk-R5U63JRH.js:3422:3)
    at body
    at html
    at Document (http://localhost:3333/_static/build/root-5H2DJAZU.js:66:3)
    at App
    at RemixCatchBoundary (http://localhost:3333/_static/build/_shared/chunk-R5U63JRH.js:1476:10)
    at RemixErrorBoundary (http://localhost:3333/_static/build/_shared/chunk-R5U63JRH.js:1415:5)
    at RemixRoute (http://localhost:3333/_static/build/_shared/chunk-R5U63JRH.js:2905:3)
    at Routes (http://localhost:3333/_static/build/_shared/chunk-R5U63JRH.js:2888:7)
    at Router2 (http://localhost:3333/_static/build/_shared/chunk-R5U63JRH.js:457:21)
    at RemixCatchBoundary (http://localhost:3333/_static/build/_shared/chunk-R5U63JRH.js:1476:10)
    at RemixErrorBoundary (http://localhost:3333/_static/build/_shared/chunk-R5U63JRH.js:1415:5)
    at RemixEntry (http://localhost:3333/_static/build/_shared/chunk-R5U63JRH.js:2785:12)
    at RemixBrowser (http://localhost:3333/_static/build/_shared/chunk-R5U63JRH.js:3467:42)

Expected Behavior
Clean console.
Actual Behavior
Sometimes the following error shows up in the console after setting up a new remix-architect project:
react-dom.development.js:67 Warning: Expected server HTML to contain a matching <script> in <body>.
    at script
    at LiveReload (http://localhost:3333/_static/build/_shared/chunk-R5U63JRH.js:3422:3)
    at body
    at html
    at Document (http://localhost:3333/_static/build/root-5H2DJAZU.js:66:3)
    at App
    at RemixCatchBoundary (http://localhost:3333/_static/build/_shared/chunk-R5U63JRH.js:1476:10)
    at RemixErrorBoundary (http://localhost:3333/_static/build/_shared/chunk-R5U63JRH.js:1415:5)
    at RemixRoute (http://localhost:3333/_static/build/_shared/chunk-R5U63JRH.js:2905:3)
    at Routes (http://localhost:3333/_static/build/_shared/chunk-R5U63JRH.js:2888:7)
    at Router2 (http://localhost:3333/_static/build/_shared/chunk-R5U63JRH.js:457:21)
    at RemixCatchBoundary (http://localhost:3333/_static/build/_shared/chunk-R5U63JRH.js:1476:10)
    at RemixErrorBoundary (http://localhost:3333/_static/build/_shared/chunk-R5U63JRH.js:1415:5)
    at RemixEntry (http://localhost:3333/_static/build/_shared/chunk-R5U63JRH.js:2785:12)
    at RemixBrowser (http://localhost:3333/_static/build/_shared/chunk-R5U63JRH.js:3467:42)

Removing the preferences.arc file in favour of .env fixed the issue:
NODE_ENV=development

@d3vhound This error in console can also happen if we have extension injecting html in the dom. Try open your app in incognito window to see if the error disappears.

@macjabeth that worked. Thanks guys.

Removing the preferences.arc file in favour of .env fixed the issue:
NODE_ENV=development

I tried this workaround with Remix 1.1.1 and Node 16.13.2, and it did not work.
Should this be reopened anyway given that the preferences.arc file is still present in the architect template in create-remix?

I was able to get rid of the error by reading in the .env file as a environmental variables like
// package.json
...
 "scripts":  {
    "start": "env $(cat .env | tr \"\\n\" \" \") arc sandbox"

...and 2 more cents from me 🤠
For some reason, the markup variable in app/entry.server.tsx doesn't contain <LiveReload />. Looking at the LiveReload declaration, the problem is in the environment variable NODE_ENV.
Unfortunately, playing with that variable doesn't help me, so I've found a workaround (for development only) wrapping <LiveReload /> by <div> that has the suppressHydrationWarning attribute.
P.S. I'm not sure should we reopen this issue or leave it as it is 🤓


Getting a "302 Found" error when accessing superset shared dashboard through an iframe or object-html-tag

Make sure these boxes are checked before submitting your issue - thank you!

[X] I have checked the superset logs for python stacktraces and included it here as text if there are any.
[X] I have reproduced the issue with at least the latest released version of superset.
[X] I have checked the issue tracker for the same issue and I haven't found one similar.

Superset version
0.20 ?
Flask 0.12.4
Python 3.7
Expected results
When I put a shared dashboard into an IFRAME or an HTML Object tag, superset should load the dashboard or a login page.
Actual results
When I try to embed superset into an Iframe or Object tag (HTML) a "302 Found" error (HTTP protocol) is thrown.
Steps to reproduce
Create an html page with an Iframe or an Object html-tag, like this:
<iframe src="http://myhost.com:8080/r/13" height="800" width="800"></iframe>

or this:
<object id="dashboardObj" type="text/html" data="http://myhost.com:8080/r/13" style="width: 100%; height: 800px;"></object>

Here "http:/myhost.com:8080/r/13" was got from SuperSet "Share dashboard" (The real URL is from an AWS EC2 server)
I've been searching this behavior in google and in this issue list but I've not found anything relevant. Maybe I'm doing something wrong, or I have superset not properly installed. If you need more
Thank you for your help.

If you need more information I can explain more detailed or share files. Thank you.

Hi, I'm getting the same issue, how did you solve it? Thanks in advance.


service as attribute

Use Case:
I'd like to have the service options for :start and :enable as an attribute so I can modify them within my wrapper cookbook. The reason for that is I can then control credentials/secrets via ChefVault on a bot server rebuild (I rebuild in our private cloud at least once a month to validate it can be done - self-imposed disaster recovery).
This PR enables this. The default values remain unchanged as to remove the option affecting others who don't care ( :smiley: )
I define the attribute as an array of symbols and then remove the symbol notation in the action property of the service resource.
Extra Stuff:

attributes/default.rb - small indent cleanup of a case statement
Spec tests now lean on SoloRunner

Spec Tests

default_spec: added a let statement to override group value for platform specific options. This would also allow a company/team/person to update local tests based on their standards that might be different than an OS standard (... could happen). When I ran tests locally, they were failing ... Had to fix them first before adding something new.
added bundler spec to ruby
added service spec tests to account for variations to the acceptable service offerings confined to :enable and :start (note: the extra converges did add almost a second for rspec on my machine :disappointed: ) < -- I'm down for a more preferred approach but this did the needful

Nice addition! Looks good to me. Thank you!

I apologize for the unacceptable delay. This was bumped to v1.0.5 and released to the Supermarket.


Tests attempt to bind to same IP/port

Both of the tests (TestTCPGOB and TestJSONRPC) attempt to bind to the same IP/port: <IP_ADDRESS>:5000. This works fine if the tests are run individually, but if run in parallel there is a race condition that one test may try to concurrently bind to an already-in-use port and fail.
Changing the port used by one of the tests to something different, like 5001, resolves this issue.
(Seen on a Debian builder while packaging this library for use.)

Thanks for reporting @gibmat . I have fixed this issue in v1.0.1 .


diff: use attrs

Codecov Report

Merging #132 (2fca184) into main (1583879) will increase coverage by 0.02%.
The diff coverage is 91.66%.

@@            Coverage Diff             @@
##             main     #132      +/-   ##
==========================================
+ Coverage   51.34%   51.36%   +0.02%
==========================================
  Files          40       40
  Lines        2271     2266       -5
  Branches      339      310      -29
==========================================
- Hits         1166     1164       -2
- Misses       1032     1037       +5
+ Partials       73       65       -8

Impacted Files
Coverage Δ

src/dvc_data/cli.py
32.55% <50.00%> (ø)

src/dvc_data/diff.py
78.57% <95.45%> (+2.70%)
:arrow_up:

src/dvc_data/hashfile/hash.py
74.76% <0.00%> (-0.24%)
:arrow_down:

src/dvc_data/db/index.py
0.00% <0.00%> (ø)

src/dvc_data/hashfile/state.py
35.34% <0.00%> (ø)

tests/hashfile/test_hash_stream.py
100.00% <0.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


GraphQL ID Conversions

Hi, I have a few questions about ID type from async_graphql.

How to convert to and from uuid::Uuid? I tried a few things into() but it wasn't working
How to enable support for ID when using cursor pagination? I get a trait bound error across the board for this.
Is it possible to have connection be Result<Connection<ID, User, EmptyFields, EmptyFields>> Where ID is used instead of String?

You can convert uuid to ID with ID::from(uuid).


feat: Added filtering ability to supabase

Added filtering ability to supabase. With the following function defined in your supabase postgres db:
CREATE FUNCTION match_documents_with_filters (
  query_embedding vector(1536),
  match_count int,
  filter jsonb DEFAULT '{}'
) RETURNS TABLE (
  id bigint,
  content text,
  metadata jsonb,
  similarity float
)
LANGUAGE plpgsql
AS $$
#variable_conflict use_column
BEGIN
  RETURN QUERY
  SELECT
    id,
    content,
    metadata,
    1 - (documents.embedding <=> query_embedding) as similarity
  FROM
    documents
  WHERE
    -- Check for user_id filter
    jsonb_exists(metadata, 'user_id') AND metadata->>'user_id' = filter->>'user_id'
    -- Add additional filters here using the same pattern
  ORDER BY
    documents.embedding <=> query_embedding
  LIMIT
    match_count;
END;
$$;

You should be able to filter the documents based on fields in your document metadata:
export const query = async (query) => {
  const chat = new ChatOpenAI({
    modelName: "gpt-3.5-turbo",
    apiKey: OPEN_AI_API_KEY,
  });

  const vectorStore = await SupabaseVectorStore.fromExistingIndex(
    new OpenAIEmbeddings(),
    {
      client,
      tableName: "documents",
      queryName: "match_documents_with_filters",
    }
  );

  const chain = ConversationalRetrievalQAChain.fromLLM(
    chat,
    vectorStore.asRetriever(null, { user_id: "2" }),
    { returnSourceDocuments: true }
  );

  const res = await chain.call({
    question: query,
    chat_history: [],
  });

  console.log(res.text);
  console.log({ docs: res.sourceDocuments });

  return res;
};

@mishkinf Here's an alternate implementation, let me know what you think?
In addVectors, we take in additional fields to write to in the table. So, we get to take advantage of Supabase db schema constraints.
In  similaritySearchVectorWithScore these extra fields an be passed in to the rpc call. The rpc function will have to be defined by the user with the additional fields in the args.
If they want to have different querying methods completely, they can have different matcher functions with different names, each with the fields being passed in as args.

@ShantanuNair no strong opinions on my end, I merely need the functionality. One thing to note is that you could start with this implementation which essentially creates a RPC friendly way to pass filters to a supabase function, and then later on build in support to create new supabase database columns (with whatever schema constraints and functionality). The arguments of filters to the pgsql function is agnostic of the underlying data you are filtering the documents by. So in this case I am filtering data that is in metadata, but you could take this approach and use the same interface to filter the documents based on whatever db fields you have.

@mishkinf Makes sense, soon I will create a PR with the functionality I suggested as well, you can take a look if you have the time

I think that would be great! @ShantanuNair

Looking forward to this!
The filter param could also be generalized to accept any metadata field with WHERE metadata @> filter as follows:
CREATE FUNCTION match_documents_with_filters (
  query_embedding vector(1536),
  match_count int,
  filter jsonb DEFAULT '{}'
) RETURNS TABLE (
  id bigint,
  content text,
  metadata jsonb,
  similarity float
)
LANGUAGE plpgsql
AS $$
#variable_conflict use_column
BEGIN
  RETURN QUERY
  SELECT
    id,
    content,
    metadata,
    1 - (documents.embedding <=> query_embedding) as similarity
  FROM
    documents
  WHERE
    metadata @> filter
  ORDER BY
    documents.embedding <=> query_embedding
  LIMIT
    match_count;
END;
$$;

with usage:
...
const chain = ConversationalRetrievalQAChain.fromLLM(
    chat,
    vectorStore.asRetriever(null, {
        user_id: "2",
        repo: "langchain"
    }),
    { returnSourceDocuments: true }
  );
...

etc.
Hope this helps!

Honestly this is so fricken cool! I hope this happens!

Let's do this! Thanks for the PR @mishkinf


[QUERY] Managing event consumption from EventHub in batch mode with multiple consumers

Library name and version
Azure.Messaging.EventHubs.Processor 5.11.5
Query/Question
In my usage scenario, I need to consume events from an EventHub with 4 partitions.
The goal is to process the events in batch mode to optimize the underlying business logic by aggregating queries to handle 'batches' of events rather than individual events.
To achieve this, I created a CustomEventProcessor by extending the EventProcessor class because the EventProcessorClient does not allow processing multiple events at once.
The issues I am currently facing are as follows:
When I kill a consumer and restart it, there is a moment when it seems that multiple consumers read the same data from the same partition. This forces me to perform a check to verify whether the event has already been processed or not.
[Currently, this check is done in the database by verifying a unique property of the message.] Is this approach correct, or am I managing it incorrectly?
When the situation described in point 1 occurs, I skip that event and process only the events that have not been processed. At the end, I update the checkpoint using UpdateCheckpointAsync for the event [not skipped] with the highest offset.
This approach seems to work, but occasionally, I have noticed that some events are 'lost,' as if a checkpoint for a subsequent offset was performed, causing some events to not be correctly processed.
This is the code of Consumer
EventBatchProcessor.txt
The goal is to create a robust consumer that can scale with multiple replicas of the consumers (always a maximum equal to the number of partitions) and to correctly manage checkpoints and duplicate control.
Thanks in advance for your help.
Environment
No response

@davidedg87:  Thanks for reaching out and we regret that you're experiencing difficulties.   Event Hubs has an at-least-once delivery guarantee; your application must be tolerant of duplicates and idempotent in its processing.
General information
When you "kill" a processor - whether by graceful stop or terminating the process - any partitions that it had owned will be claimed by other processors in the group and restart processing from the last recorded checkpoint.   When a partition moves between processors, there is a potential for 1-2 batches of overlap in which the new owner has taken control, but the old owner is not yet aware and has a batch held in memory that it is being dispatched for processing.  When old owner's load balancing loop runs (every 30 seconds by default) or it attempts to read the next batch from the partition, it recognizes the new owner and updates its state to reflect the change.
During this period of overlap, there will be two processor instances processing data from the same partition.  Either the old or new owner may write a checkpoint during this time.
Your application must be tolerant of that when the count of processors in the group changes, such as during scaling operations or when a node crashes.
Checkpointing guidance

I update the checkpoint using UpdateCheckpointAsync for the event [not skipped] with the highest offset.

Offsets are opaque data, and they do not change in a predictable pattern from one event to another.   You cannot safely reason about the highest offset being later in the stream than lower.  It is quite possible that the opposite is true.   Sequence numbers, on the other hand, do change in a predictable pattern and are safe to infer a relationship between.
Snippet analysis

I have noticed that some events are 'lost,' as if a checkpoint for a subsequent offset was performed, causing some events to not be correctly processed.

The Event Hubs clients prioritize data integrity above all else; they will always resend events unless your application has explicitly created a checkpoint.  There is no client scenario where data loss takes place.  Unless your application is creating checkpoints for events that it has not yet processed or has not fully processed, the stream will always rewind for ownership changes or recovery, and you would see duplicates.
In the snippet that you shared, your error handling seems problematic when processing events.   On L119, you're catching all exceptions as you process the payload of an event.  If any exception takes place, you ignore it and move on.  You don't account for this later in the logic and will create a checkpoint for the batch (L139) and cache entry for every event in the batch - including those with errors.  (L148-152)     As a result, you will skip any events that triggered an exception and would not see an entry in your database for them.
Likewise, when an event does not have a payload, you'll explicitly skip over that event (L106) and write the checkpoint and cache entry.   Those will also not appear in your database.
I'm going to assume that your publisher is explicitly setting the MessageId property on events, as that would otherwise be null and cause additional issues with the cache logic.
Next steps
There's not much else that I can offer with the available context.   If you'd like to collect a +/- 5-minute slice of Azure SDK logs around the behavior that you're asking about, we'd be happy to take a look and offer thoughts.   You'll want to capture logs at the "Verbose" level and filter to the ids discussed in this section of the Troubleshooting Guide.  Discussion of capturing logs can be found in this sample and in the article Logging with the Azure SDK for .NET.
I'm going to mark this as addressed.  If you'd like us to take a look at a logs, please unresolve once logs are available.

/unresolve

Hi @jsquire first of all thank you for time dedicated to my issue.
If I've well understood what you suggest is to maintain my logic to remove already elaborated events but to update the checkpoint searching the effective last one through the sequence number and not by the offset.
Furthermore I have to do a better managing of the exception in order to always update the checkpoint unless for some internal error related to the consuming of the event and not related to the specific business logic right? For example in case of empty payload the event must be checkpointed. I will take a look at the exception guidelines you wrote on the chat.
Regarding the logs I will try taking some logs for the range you suggested me and I will send you asap.
Thanks


Nested Functions: Allow for function declarations inside block statements.

Background and Motivation
We need to introduce this concept before moving to OO, it'll make the underlying work for OO-Support (#55) much more simpler as we'll just the BlockStatement API for class bodies.
What should this do
I think it's pretty self-explanatory... Of course the functions declared inside the BlockStatement will stay in the statement's scope.

Implemented here: #66.


Changes to CTMM script proposed by PG after review

Issue:
Missing validations for T2T license
Missing descriptions for X500 addresses check (already present on the code)
Missing validations for AAD app consent and logic for if the sourceIsOffline
Bug in EXO where SubstrateHolds folder in Archivembx\RecoverableItems have items (unpextected), cause the T2T migration to fail (expected)
Reason:
Changes are needed due to service changing and avoid customers hitting these on the code.
Fix:
Added validation for T2T license based on persistedCapabilities of the objects (source Mailbox and Target MailUser)
Added description to reflect the X500 addresses sync are being checked
Added code for the AzureADServicePrincipals to be checked on both Source and Target including for SourceIsOffline mode, and reflected it on the documentation.
Added validation for scenarios where source mailbox object has an Archive, checks if there's a SubstrateHolds folder in it, and if there's any content.
Validation:
Validated on my test environment where 2 tenants are configured for T2T migrations and also with another tenant where it isn't.

@guruxp please address build pipeline failures:

@guruxp because this is a forked branch, we can't make any changes to this PR. You must address the issues with the build pipeline.

@dpaulson45 done

@dpaulson45 next steps on this one? is it pending merge only?


Keybase automatically starts on macOS, despite user setting to not start with system launch

Keybase GUI Version: 1.0.40-20180205183337+269845275
Keybase starts automatically after macOS was restarted, despite the user removed Keybase from the launch menu.

@Core-UX This may be because it is running when you shutdown and you have "restore window state" set. macOS will reopen all apps and windows to a restorable state when this is enabled.


feature/bootstrap: start from

What has been done? Why? What problem is being solved?
I didn't forget about (remove if it is not applicable):

[ ] Changelog (see documentation for changelog format)

Related issues:

:warning: Please install the  to ensure uploads and comments are reliably processed by Codecov.
Codecov Report
Attention: Patch coverage is 90.76923% with 6 lines in your changes missing coverage. Please review.

Project coverage is 70.33%. Comparing base (22c57dd) to head (6ec02e6).
Report is 1 commits behind head on master.

Files with missing lines
Patch %
Lines

vshard.go
68.42%
4 Missing and 2 partials :warning:

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@            Coverage Diff             @@
##           master     #105      +/-   ##
==========================================
- Coverage   72.66%   70.33%   -2.34%
==========================================
  Files          11       13       +2
  Lines        1105     1244     +139
==========================================
+ Hits          803      875      +72
- Misses        258      322      +64
- Partials       44       47       +3

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


common patterns module for SPADE and CAD

The build fails because it relies on the changes in CAD in https://github.com/NeuralEnsemble/elephant/pull/386
Once the PR is merged, the build will pass again.


Statuspage service is still vulnerable .

On May 21, 2019 statuspage realised DNS Configuration Requirements according to what to use a Custom Domain with statuspage users have to do ownership verification by pointing their subdomains to [unique_string].stspg-customer.com .
So no more subdomain takeover ? According to #65 Statuspage no longer vulnerable . But while testing a bug bounty program site I was able to takeover their unclaimed subdomain what was pointing to [unique_string].stspg-customer.com . The issue is Statuspage is serving contents to a domain before doing full proper DNS config validation .
In case of my testing with company subdomain status.site.com was pointing to CNAME xxxz3xqnrnmx.stspg-customer.com but when I added it to a page's Custom domain in Statuspage service it asked me to update your DNS for it to work & DNS config page Expected value was yyybgwgbwg25.stspg-customer.com .

Clicking on Record revalidate says It doesn't look like the correct record has been set yet. as status.site.com was pointing to CNAME xxxz3xqnrnmx.stspg-customer.com what is completely different from Expected value yyybgwgbwg25.stspg-customer.com . But ignore it ;)
But when I visited status.site.com in browser it redirected me to https://takeovered-by-prial261.statuspage.io . So without proper validation of ownership of the domain I got ability to share contents on it .
curl -I "http://status.site.com"
HTTP/1.1 302 Found
Vary: Accept,Accept-Encoding,X-Forwarded-Host,X-Forwarded-Scheme,X-Forwarded-Proto,Fastly-SSL
Cache-Control: no-cache
X-Cache: MISS
Content-Type: text/html; charset=utf-8
X-Request-Id: eaf9fc9f-2baa-4df1-8076-9a343d45b48f
Date: Tue, 02 Jul 2019 14:02:41 GMT
X-Download-Options: noopen
Location: https://takeovered-by-prial261.statuspage.io
X-XSS-Protection: 1; mode=block
X-Runtime: 0.015781
Transfer-Encoding: chunked
X-Permitted-Cross-Domain-Policies: none
X-Content-Type-Options: nosniff
X-StatusPage-Skip-Logging: true
Connection: Keep-Alive
X-StatusPage-Version: 38aad01002854afe2672ef5c81d01153423444e7
X-Frame-Options: SAMEORIGIN
Referrer-Policy: strict-origin-when-cross-origin
Age: 0

So attacker can claim a subdomain of a user without proper validation and serve contents on the subdomain .
Best Regards
Prial

Thank you for the pull request, @Prial261. Please update the issue ticket with these details , link directly to your comment in the table reference, and then please add an actual fingerprint if possible in the "Fingerprint" column. I am trying to keep the table as uniform as possible; thank you for your understanding.

Thank you, @Prial261.

Has someone informed Statuspage about this?

@JLLeitschuh , Informed . No replay from them :')

Looks no more vulnerable (maybe in some old specific cases, or maybe in cases where some box share same dns pointing..)

Recently, I've come across a subdomain "xyz.program.com" pointing to statuspage services. I'm able to add the subdomain to my statuspage account.
This was not working for couple of other programs, and I would get the message, the Custom domain is already in use.
In the past, on completion of setting up the custom domain to your page, when visiting the custom domain (without activating) would redirect you to your page, hence confirming the takeover. The POC would required a $29 plan to redirect to work for the public.
Now, for the "xyz.program.com" it is still redirecting to the statuspage homepage. Anyone aware if activating the account, would ensure the POC to be hosted. I do not want to spend $29, if it won't work.
Thanks
sumgr0

Can stspg-customer.com subdomain still be taken over?

@daxin09pp , This issue was fixed from their side , so No more Takeover Possible . I will push update soon on this repo .

Thank you for your quick reply. @prial261

Status page pushed a DNS verification in order to prevent malicious takeovers what they mentioned in  https://support.atlassian.com/statuspage/docs/configure-your-dns/
However when I created this Pull request I was able to bypass this DNS verification as there was no mechanism what verifies if the expected value for customers CNAME record matches with the statuspage account what was fixed later after my report to their program.
So no more takeover here until any genius find any other way :D
Happy hacking <3


Request: isdb.pw (Instagram (maybe Snapchat) stories database)

Could you add isdb.pw please. Its an archive of celebrity instagram (but I think snapchat) stories. Files are saved as mp4 and jpg but its time consuming to rip manually.

Please request in #38. @cyian-1756 Please close this


Make encoders/profiles available to a scripting language

I have an application in which I am using a walking path (using Graphhopper (Awesome!)) to figure out the distance to a nearest gas main from a person's house.  It is to calculate how much it would cost to connect that person up to the network.  Been working fabulous for over a year now but then a request came in from a person on a private drive.  "access" = "private". And suddenly the routine didn't work.  So I tracked it down to the line in FootFlagEncoder.
    restrictedValues.add("private");

I have forked the code, commented that above line out, recompiled, reran the data import and voila it works now on private drives!
But I would love to submit a pull in which this is configurable through say the config.properties, but the problem is you use reflection to create this class and I don't see how I can read the props from FootFlagEncoder.  Wonder if you could ponder how to make this happen?
Cheers and fantastic work!!
Ken

I thought a bit about a more detailed design for such a scripting feature. This is my current conclusion:
I would start with implementing a brand new flagEncoder and configure it by something like this:
graph.flagEncoders=script|scriptpath=FullQualifiedPathToScript.js
Then I would try to implement such a new script encoder, duplicate one of the existing tests (e.g. for one of the bicycle types) and attempt to pass the existing tests by putting as much of the configuration logic into the JS file and in parallel implement the scripted encoder.
I'm sure many more questions about a good interface between the script and the script encoder will arise and need to be answered during the implementation.
One problem is the deployment of such server sided java scripts to servers hosted on the Internet. The coolest feature would be to offer users the possiblity to provide their own scripts. But in this case one needs to be very cautious about the security issues as I guess that some people might start hacking the server with all the capability java script provides. But maybe this could be solved by some very restrictive sophisticated parsing of the script. But I'm not sure if it eventually would not be better to invent a dedicated own simple syntax (and an interpreter for such a syntax) similar as to what brouter does in its profiles (http://brouter.de/brouter/costfunctions.html), because in this case you don't need to care that much about security issues. Anyhow I guess the implementation effort for such a solution would be higher and the long-term flexibility much lower. What do you think about the approach?

@ratrun What you think about Nashorn or Groovy? With one of them you can just extend existing encoders and override speed's definition or "accept node-way" logic or create new.

Thanks for pointing out the usage of Nashorn (http://www.oracle.com/technetwork/articles/java/jf14-nashorn-2126515.html).  Its convenient way of extending Java types from JavaScript would be beneficial for the Java script approach. But it does not help with the security aspects, please correct me if I'm wrong.
I did not know Groovy and having read its high level decription I do not get the point what benefits it would bring in our use-case.
Extending just one of the existing encoders would be the easiest. Actually I have strated with this playing around a bit. But I see following drawbacks:

You need to implement the extension capability in every single encoder
It will be hard and next to impossible to maintain the same extension capabilities in every encoder.
In case that you choose to provide different extension possibilities per encoder, it well be next to impossible to document and explain the feature set for a sprecific encoder to the users. If you provide feature X for "bicycle", then it is quite sure that somebody else wants to use this feature also for "foot".
I'm sure we want to keep the existing none flexible encoders because of better runtime. If you move all configurations to the Java Script, then tehy do not work without extensions any longer. In case that you only modifiy the current behaviour via the script, then the overall behaviour will is very complicated because you need to know both implementations. And if we change something in the existing Java encoders the influence on the Java script extensions maintained by useres is very hard to predict.

There is way to restrict scripting access in Nashorn javadoc

The way we plan to integrate this into GraphHopper is more high level so it could theoretically work for data which is not OSM:

implement a generic FlagEncoder which stores max-height, max speed for several vehicles and directions, access properties for various vehicles, surface, etc
then provide certain properties one could configure like access to max-speed for car or preferring route relations for big etc. This would be done within a custom ScriptedWeighting class
Finally allow passing parameters to the ScriptedWeighting class OR writing such classes via server-side groovy or JS scripts. We would not allow client side scripts for now (see below) but as we allow the params to change this is not that bad I think

The coolest feature would be to offer users the possiblity to provide their own scripts.

Yes, but a big risc. ElasticSearch has done this and tried this with Groovy as it has a sandbox, but currently no safe solution: http://www.elastic.co/guide/en/elasticsearch/reference/1.x/modules-scripting.html also JS seems to not have a sandbox not sure if the classfilter mentioned from @dos65 could solve this (as the guys from ES have looked into JS too)

Anyhow I guess the implementation effort for such a solution would be higher and
the long-term flexibility much lower. What do you think about the approach?

I've emailed with the author of brouter and he is willing to put this under the Apache license. Although I would find this a powerful solution and it would be very valueable for the GraphHopper community it has the drawback of a relative complex scripting languages (polnish notation etc) and the dependency on the OSM notation etc.

I've emailed with the author of brouter and he is willing to put this under the Apache license.

Very interesting news!

Any progress with this?
here is how I imagined it before reading this thread:

A user will be able to create an XML or JSON or something that can be read easily (not sure what's native to Java) defining the properties in the encoder flag.
Implement a FileFlagEncoder that can use this data in order to define everything it needs.
Define in the config the file names to use - each file name will represent the name of the flag encoder.
define a folder in the config so that GH will know where to look for the files.

This way you can implement any type of routing. no security. and you can change it without compiling GH.
I'm currently testing the current profiles and I feel that I need to be able to tweak them without recompiling every change - just delete the cache and refresh the server.
What do you think?
I think it will be easier to implement...
Here's an example of a json file:
{
   turnCosts: true,
   restrictions: ["motorcar"],
   restrictionsValues: ["private", "agricultural"],
   intendedValues: ["yes", "permissive"],
   trackTypeSpeedMap: [{"grade1": 20}, {"grade2": 15}],
   ...
}

Yes, something like this is planned. It goes even further that you'll be able to send these json's over HTTP and the profile is completely configurable even per request.
See https://discuss.graphhopper.com/t/more-flexibility-in-gh/71

I'd love to try it out as I really need to fine tune the profiles before releasing the routing to production.
If you have something I can tryout it will be great! (the sooner the better).

Any updates on this issue? I'm having troubles with fords now... :-/

Sorry, not yet. Too many things on the table although this is very exciting.
Regarding fords: what is your problem? You can enable them already. When reading the referenced issue:

As you said, this will probably require forking the GH repository here and
creating propiotary FlagEncoders.

then there seems to be a misconception. Just create the FlagEncoder and enable fords ...

This issue needs to be split into several sub issues:

define a vehicle profile via yaml/json config
define a vehicle profile via scripting, which requires making GH running with a SecurityManager
make it possible to specify such a profile per-request, i.e. a new POST endpoint => include ideas from #437
make it possible to specify such a profile on import (this likely requires adding the jackson dependency and the scripting languages like janino to core, which we should avoid to keep it lean)

The work for this was started in flex_vehicleprofile branch but the most recent work (not all features yet) happens in https://github.com/graphhopper/graphhopper/compare/flex_vehicleprofile2

Closing in favor of #1776

For later reference: instead of a "full" scripting language like janino that comes with security challenges we can try exp4j that can also support boolean operators.


[3.x] Make GLTF module togglable when compiling release templates

The GLTF module is excluded from release templates by default. This PR adds a build flag to enable/disable the GLTF when compiling Godot and release templates.
This change was needed for my project on 3.x openseeface-gd, which loads in gltf/glb models at runtime.
Associated PRs:

master

godot
godot-docs

3.4

godot
godot-docs

Making it possible to import resources at runtime is not as simple as enabling the module during the build.
See https://github.com/godotengine/godot-proposals/issues/2509 and https://github.com/godotengine/godot-proposals/issues/1632

Fortunately, importing glb files does not rely on any Importer. The code to import glb files is self-contained within the gltf module. I'm confident this works, at least for the 3.x branch, because this is how openseeface-gd works.

Well even in this PR you've inadvertently made a module that can be exported but relies on an editor include with #include "editor/import/resource_importer_scene.h". Now, resource_importer_scene.h itself doesn't presently rely on other editor code from what I can see, but it's still in the editor namespace, so it can rely on editor-specific classes if we need it to and that would translate into them becoming a part of the exported code. Which is problematic.

If the ask is to wrap all editor-specific code in preprocessor checks, that's doable. I have made a change to modules/gltf/editor_scene_importer_gltf.h that wraps the aformentioned #include "editor/import/resource_importer_scene.h" in a #ifdef TOOLS_ENABLED check.
Again, I have tested the release template by compiling with the following options:

scons platform=windows target=release tools=no -j6

runtime loading works

scons platform=windows target=release tools=no j6 module_gltf_enabled=no

program crashes on start as expected

Updated to wrap all editor includes behind an #ifdef TOOLS_ENABLED check in the GLTF module.
Everything seems to work fine when recompiling and using the new release template.

@you-win I'm consolidating this work into a proposal https://github.com/godotengine/godot-proposals/issues/3273
Not sure what to do on the 3.x branch. Probably backport?

@you-win It looks like you rebased incorrectly, which means lots of unrelated commits are now included.

Closing as this is being worked on by fire, i guess. I'll just maintain my own template


Release proposal: v1.22.0

In order to get https://github.com/libuv/libuv/commit/4f43a8673b1e1ae6a5a02c77ee83d2af003b45bb out the door, I'd like to cut a release tomorrow (Sunday in the US). If anyone objects, please say so here.

libuv-in-node CI looks good: https://ci.nodejs.org/view/libuv/job/libuv-in-node/40/

I just released this. Sorry I was a little late - I was on airplanes for ~24 hours and didn't have the wifi access I was planning on.


[Feature request] dynamically catch exceptions in TensorFlow as part of the graph execution

Via this StackOverflow question:
E.g. the QueueBase.dequeue function can raise an OutOfRangeError exception which I will receive in Python from the Session.run call. It would be nice to catch the exception inside the graph, similar as tf.cond. E.g. something like:
result = tf.on_exception(queue.dequeue(), lambda: 42)

Maybe also the first argument would need to be a lambda such that it can properly set the context.
To make this work, like in tf.cond, the result from both arguments would need to be of the same type.

This would be a very radical change to TensorFlow. What is the use case?

I was thinking about having some special logic inside my graph which does something different depending on whether there was such an exception or not.
Also, as I have multiple queues in my graph, I could do some more fine-grained handling.
But I see that this requires quite radical changes, and I can also solve my tasks in other ways, so maybe just let's close this.

Sounds good. Glad to hear you're able to solve your problem in other ways.

Can this be reopened? I have a use case. In my case, I am trying to use cholesky decomposition to solve a system, however sometimes it is not pos semi definite in which case it throws an error. I would like in this case to use SVD.
I need to do this check on each sub batch, i.e. using tf.unstack and doing the solve on each sub matrix.
It would be nice to be able to do
result = tf.stack([tf.on_exception(_with_cholesky, _without)(...) for ... in tf.unstack(...)],axis=0)

@Joshuaalbert Would it be possible to solve this problem with tf.cond?

This is possible if there are a few conds and if the number of conds is static. But what I need to do is unstack along batch and perform the solve for each batch with a possible exception for each.

Yes but even if an exception catching API was provided, it would most likely be designed in a way where you would need to say which specific error type and/or message regex you would want to catch, rather than catch-all. If you know what the error could be in advance, then it would most likely be possible to perform an expression on the input to see if it would result in an error, and if so, branch.
In your case, since you're working with batches, is it possible to maybe break the problem up into multiple sess.run calls?

Yes in my case (and in all cases that I can imagine using this API) I know what the exception would be.
Indeed, one could sequentially do multiple sess.run calls with a try/catch around the sess.run pointing to different implementations, but this would, firstly, unparallelize the procedure completely, and also obfuscate the program structure. Ideally, it would maintain the python principles of readability so that collaborators can easily understand the code.

There is another use case. The team who is creating GPflow then TF version of GPy (Gaussian processes for python) has an issue when cholesky fails/doesn't give numpy equivalent (https://github.com/GPflow/GPflow/issues/78).

While I'm still not sure if in-graph exception handling is something we can do, your recent comments suggest you might be interested in Eager execution mode. It's also possible @josh11b, @asimshankar, or @clattner might want to weigh in on this issue.

@jart Eager execution mode sounds like https://github.com/yaroslavvb/imperative but more full featured. I was actually hoping something like this would come along. Indeed this gives access to pythonic control flow. But is there not a pretty large efficiency penalty as there can be no cse optimization?

I'm not sure how graph optimizations work in Eager. It's possible something like @tf.defun would be able to apply those sorts of optimizations to your critical sections of code. StackOverflow would be a better place to ask (I'm just a triager.)
TensorFlow graphs are turing complete (example) and have data flow ops like queues. So it should be possible to do what you want to do, today, using a high performance pure graph without exceptions. While obtaining this kind of performance generally requires making tradeoffs on elegance, there's actually a lot of people on the team working on much more radical solutions that will let us eat our cake and have it too. They will take time.

@Joshuaalbert : At this point, depending on the precise computation there may be efficiency penalties with eager execution (it really depends on the model. For example, see the eager example benchmarks, some of which are are competitive with graph execution, some of which are not), and we're working towards addressing those.
As @jart pointed out, we're unlikely to have the bandwidth to design or pursue in-graph exception handling in the near future.

Here's another use-case. I'd like to loop, reading from a dataset until that dataset is exhausted. I need to do this in the sub-graph initializing a variable in my model. AFAIK, dataset iterator signals the end by throwing an exception.
Perhaps, this can be more easily solved, if the iterator API would allow to test end-of-range?


Network Edge Provisioning - Internal Server Error when using unavailable SW version

Problem
The provisioning of a Network Edge instance fails with a generic error when using the software version that is not available via the Portal.
terraform apply -auto-approve
data.equinix_network_account.metro: Refreshing state... [id=SV-equinix]
equinix_network_device.network-edge: Creating...

Error: Equinix REST API error: Message: "Internal Server Error", HTTPCode: 500, ApplicationErrors: [Code: "IC-NE-IF-008", Property: "", Message: "", AdditionalInfo: ""]

  on main.tf line 13, in resource "equinix_network_device" "network-edge":
  13: resource "equinix_network_device" "network-edge" {

Community Note

Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request.
Please do not leave +1 or me too comments, they generate extra noise for issue followers and do not help prioritize the request.
If you are interested in working on this issue or have submitted a pull request, please leave a comment.

Terraform Version
Terraform v0.13.6

provider registry.terraform.io/equinix/equinix v1.8.0

Affected Resource(s)

equinix_network_device

Terraform Configuration Files

provider "equinix" {
  request_timeout = 60
  client_id = "xxxx"
  client_secret = "xxxx"
}

data "equinix_network_account" "metro" {
  metro_code = "SV"
  status     = "Active"
  name       = "equinix"
}

resource "equinix_network_device" "network-edge" {
  name               = "test-nre"
  throughput         = 500
  throughput_unit    = "Mbps"
  type_code          = "CSR1000V"
  metro_code         = "SV"
  package_code       = "SEC"
  notifications      = ["xxx"]
  hostname           = "test-nre"
  term_length        = 1
  account_number     = data.equinix_network_account.metro.number
  version            = "16.09.05"
  core_count         = 2
}

Debug Output
https://gist.github.com/abudilovskiy/1fba260800bd6f821f262040e84f9d6f

Expected Behavior
The provider should validate the available versions and offer the options similar to how it does for other attributes e.g. term length
Actual Behavior
Generic error is thrown with no indication of what went wrong
Steps to Reproduce

terraform apply

@rling-equinix I believe you had some insight into which parameters may have been invalid in this resource definition. IIRC, it was based on the version of the device?

Hi @abudilovskiy,
The issue is caused by software version, an informative error message will be needed for such validation. I will work with our API team to enhance those error messages.
For your suggestion under the expected behavior section, software versions are vendor based, we cannot enforce similar static validation from the terraform side like what we did for the term length field.
From terraform, you can get the latest version for each package from our existing equinix_network_device_software data source.
Here is the example:
data "equinix_network_device_software" "csr1000V" {
  device_type = "CSR1000V"
  packages = ["IPBASE"]
  most_recent = true
}

Under the same data source documentation page, you can find this Network Edge Vendors and Devices page. It provides all different combinations of available versions for each vendor along with their release notes.
Thanks for pointing out this issue and making our product better!


Test Coverage: Cannot run swift test via cp.execFile on Windows

If you run swift test via Javascript command cp.execFile on Windows it fails to run the tests. It returns an error of the following form. There seems to be an issue with the generated test executables.
<unknown>:0: error: PCH was compiled with module cache path 'C:\Users\User\Developer\libs\swift-collections\.build\x86_64-unknown-windows-msvc\debug\ModuleCache\2TGCAFOH5KUFD', but the path is currently 'c:\Users\User\Developer\libs\swift-collections\.build\x86_64-unknown-windows-msvc\debug\ModuleCache\2TGCAFOH5KUFD'
<unknown>:0: error: missing required module 'SwiftShims'

The only difference between the two paths is one begins with c:\\ the other begins with C:\\.
This means we cannot run the test coverage code on Windows as this is run with swift test --enable-code-coverage.

This doesn’t se like an error of the generated executable.  Paths are case insensitive on windows, and it seems that the drive is getting normalized to lower case.  This is equivalent but will fail the strcmp that occurs.

I've had success running tests with code coverage ever since https://github.com/swiftlang/vscode-swift/pull/942 went in. I'm not sure this still applies, so I'm going to close it. @adam-fowler feel free to reopen if its still an issue.


croc-hunter-jenkinsx to 0.0.134

Promote croc-hunter-jenkinsx to version 0.0.134

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by:
To fully approve this pull request, please assign additional approvers.
We suggest the following additional approvers:
If they are not already assigned, you can assign the PR to them by writing /assign  in a comment when ready.
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment


Install BASH to enable and support globstar (**)

Description

Q
A

Bug fix?
Yes

New feature?
Kinda

Issue
globstar doesn't work with the current container setup.
Background
Node Alpine ships with ash as a default shell. The globbing behaviors for ash don't include globstar, which is handy linting many files. Globstar is supported in glob, upon which the underlying linter depends.
Repro steps
From my understanding in ash, ** is resolved as * and doesn't search recursively. You can observe this by creating a nested directory structure and the command over it:
my-files/
├── one/
│   └── linted.md
│   ├── two/
│   │   └── not-linted.md

$ docker run --rm \
    -v "$(pwd)/my-files:/my-files:ro" \
    avtodev/markdown-lint:v1 \
    '/my-files/**/*.md'

With the markdownlint-cli running on a more robust shell, the expected behavior is that both files would be linted, but with ash only the first is.
Proposed fix

install bash in the dockerfile via apk.

pass no-cache to keep the size small.

run the entrypoint with bash and enable globstar.

With these changes, the above example will lint both markdown files.
Cost
This increases container size by ~2MB from my tests.
Checklist

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my own code
[x] I have commented my code, particularly in hard-to-understand areas (commit history)
[x] I have made changes in CHANGELOG.md file

@ahtierney did you test it locally?

Hey @tarampampam ! I did test locally. You can also test my minimum reproducible example locally using the "Repro steps" above. You should see that the production container only lints the file one.md and if you build a container locally with these changes it will lint both one.md and two.md.

@ahtierney Great!


Update Blog Post “2020-05-recruiting-first-—-being-social-while-distancing”

Automatically generated by Netlify CMS

Deploy preview for dds-mil ready!
Built with commit 522ef479f90d0adbbc26cb66067f43eb6a2406c6
https://deploy-preview-264--dds-mil.netlify.app

Deploy preview for dds-mil ready!
Built with commit 97dfdb2aa19b2f79b5832633e32a41efb9299321
https://deploy-preview-264--dds-mil.netlify.app


feat: add featureGates optimization

Describe what this PR does / why we need it
When merging the kubeadm.yml file, remove featureGates that have been removed in the current version of kubernetes to prevent cluster initialization failures.
Like this:

Does this pull request fix one issue?
Link: https://github.com/sealerio/sealer/issues/2226

Describe how you did it
Describe how to verify it
Special notes for reviews

Codecov Report
Patch coverage has no change and project coverage change: -12.02 :warning:

Comparison is base (d83ead0) 19.98% compared to head (67e0bcc) 7.97%.

:exclamation: Current head 67e0bcc differs from pull request most recent head f89c0c3. Consider uploading reports for the commit f89c0c3 to get more accurate results

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.
Additional details and impacted files
@@            Coverage Diff             @@
##             main   #2229       +/-   ##
==========================================
- Coverage   19.98%   7.97%   -12.02%
==========================================
  Files          98     165       +67
  Lines        9281   13543     +4262
==========================================
- Hits         1855    1080      -775
- Misses       7172   12316     +5144
+ Partials      254     147      -107

Flag
Coverage Δ

e2e-tests
7.97% <ø> (?)

unit-tests
?

Flags with carried forward coverage won't be shown. Click here to find out more.
see 263 files with indirect coverage changes

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

@fangzhengjin , i think it’s better to bound kubeadm.yaml to the specific image version, not included in our code.

@fangzhengjin , i think it’s better to bound kubeadm.yaml to the specific image version, not included in our code.

I think this function makes sense. Regardless of whether part of the kubeadm.yaml is in the sealer code or not, it can delete parameters that should not be used according to the invalid parameters listed by Kubernetes to prevent the cluster from being able to start.


High memory usage when returning results

When superset returns results it converts nested fields to json with this line of code
This results in excessive amount of memory used and kills celery worker. The problem manifests itself for large enough number of records. I noticed it on Presto with big highly nested records. I suspect it may show on other databases.
I realize that more records means more memory but in my tests selecting 200k records (this value will vary based on data itself) resulted in megabytes of memory used until  SupersetResultSet is created and this explodes to gigabytes and kills celery worker.
There is a limit to how much memory one can reasonable expect to allocate to celery worker.
How to reproduce the bug
I encountered the problem on Presto with big highly nested records.

Create a dataset with many records and at least one big nested field, so that this line is executed: https://github.com/apache/superset/blob/f3b289d3c333fe2351e9fbac6fa85b875cb1897c/superset/result_set.py#L142
For high enough number of records selected superset will OOM  (in our case celery worker so query fails but superset itself lives on)

Error Stack trace
celeryworker_1  | [2022-07-12 12:42:15,512: INFO/ForkPoolWorker-1] Query 5: Polling the cursor for progress
celeryworker_1  | [2022-07-12 12:42:40,194: ERROR/MainProcess] Process 'ForkPoolWorker-1' pid:12 exited with 'signal 9 (SIGKILL)'
celeryworker_1  | [2022-07-12 12:42:41,037: ERROR/MainProcess] Task handler raised error: WorkerLostError('Worker exited prematurely: signal 9 (SIGKILL) Job: 3.')
celeryworker_1  | Traceback (most recent call last):
celeryworker_1  |   File "/opt/superset/billiard/pool.py", line 1265, in mark_as_worker_lost
celeryworker_1  |     raise WorkerLostError(
celeryworker_1  | billiard.exceptions.WorkerLostError: Worker exited prematurely: signal 9 (SIGKILL) Job: 3.

Expected results
I expect that a result set that takes several megabytes of memory before converting to SupersetResultSet will not run out of memory when there are several gigabytes of memory available.
Actual results
OOM on celery worker
Environment
(please complete the following information):

browser type and version: any
superset version: 1.5.1
python version: 3.8.12

Checklist
Make sure to follow these steps before submitting your issue - thank you!

[x] I have checked the superset logs for python stacktraces and included it here as text if there are any.
[x] I have reproduced the issue with at least the latest released version of superset.
[x] I have checked the issue tracker for the same issue and I haven't found one similar.

I ran into the same issues in Superset 2.0.1 when the results contained a cell with an array of ~30,000 integers.

Is anyone still experiencing this in Superset 3.x? We no longer support earlier versions, so I would normally just close this, but I want to take this seriously if it's still a problem today.

Closing as stale. Holler if this needs a revisit.


Remove StorageType from DebugTypeInfo::getErrorResult().

Error results are always indirect so passing in the llvm storage type (which is always a pointer) is entirely pointless.
rdar://103416237

@swift-ci smoke test

@swift-ci test and merge

@swift-ci test and merge


Many concurrent requests

Description
Nancy can not serve many(<10) concurrent requests at once.
Steps to Reproduce

Add a StaticContentsConventions to serve files from a directory.
Copy a long video file to the directory.
Open the video in your browser in many tabs(>10) by pointing all to e.g. http://localhost/myvideo.mp4.
Observe: Video is not displayed on all tabs, instead they wait for a connection till you close other tabs.

System Configuration

Nancy version: 1.4.1
Nancy host: OWIN
Browser: Chrome

This screams of a common issue with full iis on non-server windows OS, what version of windows/iis are you running in (if at all)?

Forgot to mention: I am using Selfhosting with Microsoft.Owin.Host.HttpListener.
Maybe thats the Problem?
OS is Windows 10.
What would be the best Option for Selfhosting?

The best option to use nginx for static content(or another http server).

I agree with @Kiri-rin  nginx is perfect for static content and then let nancy handle api related stuff.

Well, the problem is that I also have nonstatic content that is large or takes some time to generate.
I understand that this is no common use case though.
I will investigate this further. If someone can give me a hint where the problem could be it would be great.

@cody82 if you have long running routes then you should make them async so they do not block up the request threads

Yes. So does that mean that the problem is not in the general HTTP request handling in Nancy but in the handler for static files that does not properly use async?
I also experienced the same problem in ServiceStack that does most its handling asynchronous but then it calls one synchronous Socket.Write function that blocks everything.

I have tracked the problem to GenericFileResponse.GetFileContent:
        private static Action<Stream> GetFileContent(string filePath, long length)
        {
            return stream =>
            {
                using (var file = File.OpenRead(filePath))
                {
                    file.CopyTo(stream, (int)(length < BufferSize ? length : BufferSize));
                }
            };
        }

So File.CopyTo blocks the thread while the file/video is transfered.
(Also this class does not seam to handle partial responses but thats another issue.)
I doubt this can be just converted to an async function but I may be wrong?

(Also this class does not seam to handle partial responses but thats another issue.)

@cody82 I created a PartialFileResponse for video/audio streaming applications: https://gist.github.com/danbarua/0fd9fcad5ec85e0c02dc
Dan


obconf: add libSM to fix build

Motivation for this change
obconf didn't install
Things done

[ ] Tested using sandboxing
(nix.useSandbox on NixOS,
or option build-use-sandbox in nix.conf
on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] Linux

[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[x] Fits CONTRIBUTING.md.

I'm not sure why it's suddenly necessary.

Confirmed and tested. Thanks!


Smart backend aggregations expressions

Support aggregations from CARTO Maps API. Points sources/layers should have expressions to take advantage of those aggregations:

[x] max(numeric).
[x] min(numeric).
[x] avg(numeric).
[x] sum(numeric).
[x] mode(category).

@rochoa This is already done :confused:

Done!


Template updates

Simplify and improve template. Now it can be used with this tool by just typing this in your terminal:
swift new-framework <REPO_NAME>

What were done regarding template:

Clean it. Remove workspace and bloated project structure. Now project structure is determined by swift package init, and xcodeproject generate by xcodegen
Improve Example. Add AppDelegate and dummy ViewController
Make it fully compatible with swift package
Fix storyboard requirements for Example

@ntunin everything except "Automatically choose team" is implemented. Something in this repo, something in this

@ntunin everything except "Automatically choose team" is implemented. Something in this repo, something in this


Unable to Sign Out

Ran into this today with v2.17.0 in the Brave browser. My wallet is on the "Enter your password" screen and when I click the three dots then Sign Out, nothing happens.

Nothing in the console logs either. I do see the URL changed at the top to:
chrome-extension://ldinpeekobnhjjdofggfgjlcehhmanlj/index.html#/sign-out
Completely removed it, reinstalled it, logged back in and tried again -  now I see there's a new modal! Maybe that's why I couldn't directly sign out?

Good find. It only works when you're in the unlocked state, as the sign-out route is a child of the home screen.

@kyranjamie Tested the issue in Brave and Chrome.Test passed


Export not detected (edge case)

:warning: This is not real-world code. It's technically a bug, but no real program will notice it. Feel free to close this issue!
Consider this non-strict mode code: (GitHub's syntax highlighting is broken)
function fn() {
    yield / "/ //" /*
}
/*/
}

module.exports.foo = 2;

// */

The tokens are:
[function] [Identifier: fn] [paren left] [paren left] [brace left]
[Identifier: yield] [division] [String: "/ //"] [Comment: \n}\n/ ]
[brace right]

[Identifier: module] [dot] [Identifier: exports] [dot] [Identifier: foo] [equal] [Number: 2] [semicolon]

However, cjs-module-lexer returns { exports: [], reexports: [] }.

Improving the lexing ambiguity cases is always a goal so thanks for posting, but yes there isn't a rush to fix this :)
I wasn't aware the this would be parsed as division in this expression position... what is it that makes yield act differently to return here?

I've posted a potential fix in https://github.com/guybedford/cjs-module-lexer/pull/21, interestingly it's a negative diff and thankfully doesn't require any extra work :)
Would be grateful if you could review when you can.


ERC20:Should not approve to self

I don't see any need why one would want to approve his own address. So approve function should have additional check of :
require(spender != msg.sender, "ERC20: cannot approve to self");

Emmm, I am not sure whether there is a necessary to do this, but I think it is OK.

Thanks for the suggestion @prashantprabhakar!
However, I don't agree that we should do this. Some users may want to use this mechanism and there's no reason to disallow it. It's not something that would result in an error in any way.

@frangio I do agree this does not result in an error. But if called accidentally wastes gas. I  don't find any reasons why anyone will want to approve to himself. approve and transferFrom were not intended to handle this.
So this is more of a precaution  an enforces intend of approve and transferFrom


Would be nice to have a homebrew formula

I really believe this miss here :) I can try open a pull request to make this happen.

I just noticed #8 where there's someone else who's created one. It'd be nice to have an official one, but in the meantime...


Azure search price confusion

I bumped up my search tier to allow for more documents, but I assumed that I would only be charged when the search was utilised (i.e. a search is performed). Instead I seem to be charged at a flat rate of 0.076 per hour irrespective of whether the search is used or not. Is this right? Seems quite expensive if it is, especially for the standard tiers which is what we'd be looking to use with our customers.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 8b62d38a-cace-8b96-a56d-e5dfadc8192b
Version Independent ID: 21c3de87-8adb-aa2b-2fc7-f7db10315bee
Content: QnA Maker Limits - Azure Cognitive Services
Content Source: articles/cognitive-services/QnAMaker/limits.md
Service: cognitive-services
GitHub Login: @nstulasi
Microsoft Alias: saneppal

@stenoid Hi, thanks for your feedback here. I will investigate it and get back to you as noon as possible.

@stenoid There are choices for hour/day/month, I recommend you to use the calculator to estimate it first:
https://azure.microsoft.com/en-us/pricing/calculator/?service=search Thanks a lot!

@stenoid We will now proceed to close this thread. If there are further questions regarding this matter, please reopen it and we will gladly continue the discussion.


Possibility for chrome extension ?

Awesome extension I would always have this and one of the main reasons I like firefox, but what is stopping you to port it to chrome ? or to make a similar extension for chromium based browsers ?

I don't use Chrome.

neither am I ... but I do use brave ;) and an extension support will add it to a lot of browsers.


Java: CppProxy.destroyed is never set to true

Each CppProxy declares a field:

private final AtomicBoolean destroyed = new AtomicBoolean(false);

That field is used to verify that objects haven't been destroyed when using, like this:
assert !this.destroyed.get() : "trying to use a destroyed object";

However, I am missing the code, where destroyed is actually set to true.

Hi derolf,
I think the destroyed field is a historic relic that existed before I rewrote the lifetime management mechanism with phantom references.  As far as I can see there really isn't a way to call a proxy method after the nativeDestroy method is called, because in order for that method to be called, the JVM has already dropped all references to the proxy object.
This field, as well as the assertion on it,  should just be removed.

In theory, a dead proxy could be called if someone does “finalizer resurrection”.

The cpp proxy objects do not have finalises and there is no way to add one as these classes are final.

Thanks for clarifying!


(PUP-5991) Add a failing test for [drive]:\DEV on Windows

Although C:\Dev.... is a valid path on Windows, some other code and test
may regard it as a path to be ignored. e.g. /dev/null resolves to
C:\dev\null on Windows.  The unit test fails are ambiguous (e.g. expected
nil) and do not convey the underlying issue.  This commit adds a test that
fails if the working directory has a root directory of 'dev'

Oddly, AppVeyor failed with
[00:37:29] Failures:
[00:37:29]
[00:37:29]   1) Puppet::Util::Windows::Registry#values when reading values should return REG_MULTI_SZ values
[00:37:29]      Failure/Error: expect(written).to eq(pair[:value])
[00:37:29]
[00:37:29]        expected: ["string1", "string2"]
[00:37:29]             got: ["string1", "string2", "\u6E00"]
[00:37:29]
[00:37:29]        (compared using ==)
[00:37:29]      # ./spec/integration/util/windows/registry_spec.rb:222:in `block (6 levels) in <top (required)>'
[00:37:29]      # ./spec/integration/util/windows/registry_spec.rb:213:in `block (5 levels) in <top (required)>'
[00:37:29]

Kicked it off again and it passed.   A bit concerning that that test failed though.

FYI - merged a slightly different variant to improve the failure message.  With the code in this PR, the error message is:
  1) Puppet::Settings::FileSetting when being converted to a resource should have a working directory with a root directory not called dev
     Failure/Error: expect(path =~ /^[A-Z]:\/dev/i).to eq(nil)

       expected: nil
            got: 0

       (compared using ==)
     # ./spec/unit/settings/file_setting_spec.rb:175:in `block (3 levels) in <top (required)>'

With the expectation written as expect(path).to_not match(/^[A-Z]:\/dev/i) the error message is instead:
  1) Puppet::Settings::FileSetting when being converted to a resource should have a working directory with a root directory not called dev
     Failure/Error: expect(path).to_not match(/^[A-Z]:\/dev/i)

       expected "C:/dev/puppet/somefile" not to match /^[A-Z]:\/dev/i
       Diff:
       @@ -1,2 +1,2 @@
       -/^[A-Z]:\/dev/i
       +"C:/dev/puppet/somefile"
     # ./spec/unit/settings/file_setting_spec.rb:175:in `block (3 levels) in <top (required)>'


feat: add per-rule granular error suppression

Fixes #1818
This does slightly change some behaviours, specifically by suppressing errors for suppressed rules. I'm torn as to whether this is a sufficiently large behavioural change to cause an issue, though as a rule I feel it is a better behaviour and cant think of a scenario where someone would have been relying on a suppressed rule throwing an error.

though as a rule I feel it is a better behaviour and cant think of a scenario where someone would have been relying on a suppressed rule throwing an error.

Agreed! Thanks for the contribution. Can you add an example for suppressing validation failures to the README?

Updated the readme, and while I was at it realised that I should probably still respect Suppression Ignore Conditions when suppressing validation failures, so slightly refactored to ensure that occurs and added some tests to that effect.


Error thrown if page itself loads prosemirror-dev-toolkit

Visiting https://www.suggestcat.com results in the following error.
DOMException: Failed to execute 'define' on 'CustomElementRegistry': the name "prosemirror-dev-toolkit" has already been used with this registry

Yes that was fixed in couple patches back but they haven't updated their bundled toolkit so it won't check for registered web components before execution. And since the extension code is run before the page's, can't really retroactively prevent it

Makes sense, thanks!


[CORE] set default spark.version to 3.4.1

What changes were proposed in this pull request?
Set the default spark.version to 3.4.1 to fix the security issues reported by local code scan
Note this will be overwrite in each profile
How was this patch tested?
pass GHA

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query
log/native_3727_time.csv
log/native_master_11_16_2023_510b22841_time.csv
difference
percentage

q1
34.12
34.35
0.231
100.68%

q2
26.20
24.60
-1.601
93.89%

q3
37.65
37.34
-0.315
99.16%

q4
37.08
37.04
-0.038
99.90%

q5
70.54
68.82
-1.721
97.56%

q6
6.92
7.03
0.108
101.56%

q7
84.23
85.40
1.168
101.39%

q8
84.68
85.86
1.179
101.39%

q9
126.34
126.12
-0.220
99.83%

q10
45.08
46.82
1.738
103.85%

q11
20.48
19.68
-0.799
96.10%

q12
25.67
24.50
-1.171
95.44%

q13
46.28
46.88
0.602
101.30%

q14
16.65
18.78
2.132
112.80%

q15
29.11
28.03
-1.085
96.27%

q16
15.73
15.56
-0.165
98.95%

q17
104.45
99.58
-4.869
95.34%

q18
148.80
148.00
-0.803
99.46%

q19
12.99
12.89
-0.094
99.28%

q20
27.20
28.05
0.850
103.12%

q21
221.92
220.92
-1.002
99.55%

q22
12.77
12.73
-0.039
99.69%

total
1234.88
1228.97
-5.914
99.52%


Release the Mykyta dataset

[ ] Wait until Mykyta finishes recording
[ ] Hire a person to validate the data and wait until the finish
[ ] Release the OPUS dataset with accept, reject folders (the same as Lada)
[ ] Convert OPUS data to WAV with 16, 22.05, 48 kHz freqs
[ ] Remove silence (trimmed version) using the uk tool
[ ] Convert trimmed dataset to WAV with 16, 22.05, 48 kHz freqs
[ ] Release a new version in the repo

2 hours are recorded already

Almost 4 hours done

4 hours recorded

recording is finished


Make most map operations thread safe.

I don't expect this PR to be merged as such, since I'm pretty sure it's not in the direct goals of this library. However, I would really love some pointers and possibly a review of some sort if possible. Thanks!
The goal is to make the hash map thread safe, for most use cases. So far, I've been able to work through the puts, gets, removals, updates, and other point based operations.
One caveat that I can think of is the iteration. My goal was to provide a lock free iteration, which may or may not have the latest values. The idea is to capture the state as of the moment that the iteration starts (keys, values, and mask). Doing so allows me to allow for all other point based map operations to work without waiting for the iteration to complete. Apart from having stale entries, there is one other and potentially more concerning:

When the remove operation invokes shiftConflictingKeys, the position of entries would jump, making the iteration less reliable

Apart from that caveat mentioned above, are there any other worth considering?
My larger goal is to make the iteration "eventually consistent".
Thank you!

@judepereira did you look at the Hopscotch Hashing technique?
The paper says it was designed as a concurrent hash map, though I'm not sure about the iteration.

Thanks @bruno-roustant. I'll have a look at that.


FullDescription not visible to any command/player

During testing of Jobs 4.8.0 with 1.13.1 (Paper), I can add the FullDescription field to the jobConfig.yml, but it is not visible to users or using any commands.

Left click shows details of that job earnings but no full description either.

please be more specific - type what with the job name?  Show an example, as I've not seen it appear for any command. As shown above, I did /jobs info Builder and neither short or full descriptions are returned.

Oh, you can disable this function, JobsGUI.OpenOnBrowse and enable this if you want to display the jobs in chat, JobsGUI.ShowChatBrowse.
Example command: /jobs browse [jobname]

@montlikadani what are you talking about??  The bug is about the FullDescription not showing up in any way other than the configuration file.  I did use the /jobs browse as did someone else.  I think this is a question for @Zrips to answer since it appears you may not know.

Zrips will not answer because I told him I could help with the plugin development and added, so I'll help her. As I said, FullDescription will not appear in the GUI because it is not added. FullDescription will only appear in chat when JobsGUI.ShowChatBrowse is enabled and JobsGUI.OpenOnBrowse is disabled.

okay, then there is a different bug.  As you identified, I had JobsGUI: OpenOnBrowse: true and ShowChatBrowse: true
Once I set OpenOnBrowse: false as suggested, now we see nothing - no jobs or GUI

Hm... I've fixed the console error, soon the commit is coming. I also try to fix the player in the game, as this will indicate to me on the chat.

Thanks - I think it would be better to also allow the FullDescription to be visible on the GUI of jobs browse - when someone left clicks to get more info. Even if it means adding a block to show it since it could be multiple lines. Turning off GUI just to see a full description doesn't sound right, when most users want GUI's. :-)

@Zrips - any update on this issue?  Thanks, Steve

I've released a DEV. version which includes lots of fixes, add new items, and more. release, You can test it.

The FullDescription is not fixed in the 4.8.1 Dev release.  There are no more errors, but still no where does it show FullDescription.

Showing full description would cover entire screen in some situations, so need to have that one.
For error that one is fixed with
99f13e5c475750614385ac2a62d19a35a56aa4be


How to  record screen sharing video

Help! In practical use, I found that gst-meet can only record user webcam videos and cannot record screen sharing videos. How should I handle this?

I am not totally sure, but currently gst-meet only supports two participants, and if you look closely, the source is added only when a participant joins. Since screen sharing is basically the same participant but adding a track, you will have to tweak it accordingly.

Now that Jitsi supports multi-stream, the screen share is being ignored because we only look at the first track of the participant. I implemented the first step towards resolving this yesterday, in that we now signal source name & type and use the correct msid format for multi-stream. But supporting multiple streams per participant will require some more changes — PRs are welcome or I will get to it when I have time. I'll keep this issue open to track progress.


add-on only works after disable/enable

Using Firefox 33.1.
After starting/restarting Firefox, this add-on does not work unless I first disable and then re-enable it. I am not sure if something loads after this add-on that overrides the functionality; maybe by disable/re-enable it then overrides the other something?
This add-on should enforce its functionality so it automatically starts working after launch of Firefox.

Closing this until there is more information.


Update gboost create to use static pre-defined templates

gboost create currently asks users a series of questions before creating their app. These questions ask which features the user wants in their app. This is nice, but difficult to maintain. Switch to static templates. Templates can still include a few variables that can be supplied by user. See sst create as example.

Add basic tRPC setup in minimal template with to-do list?


Checkmarx has to be added as additional quality gate to the CI pipeline

Description
Checkmarx is currently not pat of the regular CI pipeline checks. This step has to be added to the CI pipeline of the reconciler.
AC:

Checkmarx scanner is automatically executed at least once a day for the main branch by a CI pipeline

Reasons
Finding of the security threat modelling workshop and required to fulfil security requirements.
Attachments

Done. It will run each working day at 6:30 AM.


Fix circular require warning

Goal
This PR fixes a circular require warning caused by several files requiring the main bugsnag.rb file
I've also gone through and removed other duplicate requires, consolidating them into bugsnag.rb
See https://github.com/bugsnag/bugsnag-ruby/issues/822

Is it worth considering a rake task to check for this in future?

Is it worth considering a rake task to check for this in future?

I think the best approach would be to fail the Maze Runner tests if a warning is emitted. I've raised PLAT-12273 to track that work


fix unreachable code: revert OperatorNotAllowed(operator);

The following line /src/OperatorFilterer.sol#L56 is unreachable because isOperatorAllowed/2 can only return true or throw the errors AddressFiltered/1 and CodeHashFiltered/2.
To fix it and also make it compatible with documentation:

isOperatorAllowed will return true. Otherwise, isOperatorAllowed will return false
-- /README.md#updatecodehash

This PR refactors isOperatorAllowed/2 removing the reverts and returning false instead.

TODO: fix tests

I'm also bothered by the problem "fixed" in this PR but as I understand it the registry contract is not upradable so it's likely that it'll never get fixed on-chain...


Multimapping dapper

In this PR, I added dapper multimapping funcionality. This is really useful for one to many relathionship.
Regards

Very useful and I think it is necessary for complements SQLKata to be a better product

I would love to see this feature added as soon as possible. @dlopezb93 Is there any thing I can do to use this feature in my code today.

I would love to see this feature added as soon as possible. @dlopezb93 Is there any thing I can do to use this feature in my code today.

Hello @ahmad-moussawi  I'm going to resolve conflicts and push again


Add support for python 3.9

sdist and wheel crawlers must be updated to also parse requirements for 3.9
To not stall the the regular updates through this, it's probably best to limit the number of python 3.9 jobs on each run.

Is this issue still actual? I tried changing python 3.8 -> 3.9 and it just worked with the python packages that I use.

Yep, this is done. Forgot to close this


Feature/add example for using atecc608a with WROOM32SE (IDFGH-2630)

This PR is generated for providing an early overview of the example to some users who requested it.
For now the Python utility executes the commands by itself
It executes 2 commands

generate key from slot 1, which also provides public Key for the key
Generate pem csr for the private key generated in slot 1
( I will soon update the PR with other changes to make it fully working )
Note : The Setup to lock the Config Zone and data zone is yet to be updated so If you have already locked config zones of ATECC chip on the WROOM32SE board , this would work ( provided slot 1 can be used to generate key )

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.1 out of 11 committers have signed the CLA.:white_check_mark: rousveiga:x: Felipe Neves:x: igrr:x: kumekay:x: david-cermak:x: KonstantinKondrashov:x: dobairoland:x: projectgus:x: prasad-alatkar:x: mahavirj:x: AdityaHPatwardhanFelipe Neves seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Trying to update java.txt file at /user/share/crypto-policies/DEFAULT/java.txt

I am trying to update the java.txt file present at /user/share/crypto-policies/DEFAULT/java.txt in the image created through jib plugin
But it always do permission denied
Any way to update the file?

Check out extraDirectories and extraDirectories.permissons.

Please re-open this if the above does not answer your question.


Removed unused parameter form anonymous function.

Removed unused parameter form anonymous function inside aliases method of PackageManifest class.

You submitted the same PR twice. You can close this.

No @Dylan-DPC They are for different methods. Please check the changes.

My bad. both could have been in one PR though :+1:

I know it could be ! But I figured the second method later when I already named the previous branch. :(

Ah not an issue. You can always push more commits to the same branch


Xiaomi Gateway Illumination sensor update bug

Make sure you are running the latest version of Home Assistant before reporting an issue.
You should only file an issue if you found a bug. Feature and enhancement requests should go in the Feature Requests section of our community forum:
Home Assistant release (hass --version):
0.50.1
Python release (python3 --version):
Python 3.4.2
Component/platform:
Xiaomi Gateway
Description of problem:
The illumination sensor does not update correctly. Shows for example 800 lumen if its completly dark or 100 lumen when its defenetly over 1000.
Expected:
Expected to show the right value and to have like a heardbeat so it gets frequently update.
Problem-relevant configuration.yaml entries and steps to reproduce:
xiaomi:
 gateways:
   - mac: !secret xiaomi_sid
     key: !secret xiaomi_key

sensor.illumination_f0b4XXXXXXXX:
    friendly_name: Gateway Lumen
    icon: mdi:lightbulb-on-outline

turn off all lights, so its totally dark -> sensor shows 0 lumen
turn on all lights -> sensor should show 1100 lumen or so but does only show 101 lumen
Turn off light again -> sensor should show 0 lumen but instead shows 800 or so
3.1 you can manually update the sensor by turning the gateway light on and off. Everytime you do this, the sensor value gets updated.

Traceback (if applicable):

Additional info:

Xiaomi illumination sensor has some delays in updating his data. Maybe it's platform limitations with it's compensation mechanisms. My sensor never goes to 0. According to specifications in internet it's possible values from 280 to 1200.

Well if i do nothing it stays forever on this value (e.g. 700)

Can nobody reproduce this??

1100 lumen - I'm guessing you're working that out based on light sources, check out the inverse square law

1100 lumen is not my problem.. the problem is that the sensor does not update right. For example right now the sensor shows 550 lumen. but its totally dark in my room.
The only think i can do to get the right value is to turn on the gateway light some times. every time a do this the sensor updates.
Need help with this, can not imagine that i am the only one with this problem

The HA component just shows the received values of the xiaomi gateway. The gateway firmware is responsible for the measurement and compensation. The manufacturer does not provide the measurement/sensor on his own platform so far. I guess he knows about the weak performance of the sensor and is working on it. Which gateway firmware do you use? I hope a firmware update will fix the issue someday.
I have attached a graph for comparison (gateway illumination vs. the measurements of a tsl2561):

Hmm okay,
well at least it seems like your sensor does work ;)
My only way to get the sensordata right is with the following automation:
- id: id12   alias: Update lumen sensor   trigger:      - platform: time       seconds: '/5'   action:     - service: homeassistant.turn_on       entity_id: light.gateway_light_f0b42XXXXXXX       data:         brightness: 2     - delay:         seconds: 5     - service: homeassistant.turn_off       entity_id: light.gateway_light_f0b42XXXXXXX
The log shows the following and i can not use the gateway light anymore but the sensordata does get updated right:
2017-08-06 03:30:05 ERROR (Thread-2) [homeassistant.components.light.xiaomi] Light RGB data error. Must be 8 characters. Received: ff0000

Try to set the brightness of the gateway not less than 5. A brightness of 2 will result in unreliable behavior. I dont't know way. ;-)

i am doing this extra.

What do you try to achieve? Your automation turns the light on and off every 5 seconds!?

My automation trys to turn the light on and off but it fails. BUT the important thing is, the illumination sensor does then update to the "right" value. As i said if i turn on the light and off again the sensor shows for example 600 lumen and stays there until i turn the light on again. When i turn my automation on the value degress to the actual real value.

I get it. You found a hack how to reset the compensation mechanism of the gateway firmware.

Seems like. Because every time the gateway talks with me about the light, it does also send me the illumination level.

Do you know the purpose of the compensation mechanism? :-)

No. But otherwise i cannot use the illumination sensor, because the values are totally wrong.
Maybe you can explain me ? ;)
It seems to me that your sensor does work better.

Compensation: The gateway firmware calculates an average over for example 100 measurements. The result is the provided value of the illumination sensor. If you change the light conditions you expect an immediate change of the illumination sensor. However the gateway firmware took just 1 measurement with the new light condition and 99 measurements of the old condition. So the provided value will be somehow the previous value. I will take some time (10 minutes? 15 minutes?) before the value of the sensor decreases. The compensation mechanism is somehow broken. Some users reported increasing illumination will be represented fast in the sensor value. Decreasing light conditions needs more time to populate.
Your approach: Turn on and off the gateway light. It looks like the measurements of the compensation mechanism will be discarded if the gateway changes the light conditions by his own light. You can bypass the compensation mechanism now.

You are right, the sensor does change but took like 4:30 for me. I never waited that long :D
So its not a good idea to bypass this mechanism?

It depends on your needs. In my case it is totally fine if the illumination sensor does not report every cloud covering the sun for a few seconds.

Please close the issue if your problem is solved.

Thanks!


Fix forgotten goss copy src variable

Overall Review of Changes:
Fix forgotten goss copy src variable
Issue Fixes:
N/A
Enhancements:
N/A
How has this been tested?:
N/A

Hi @cbcercas
Thank you for taking the time to raise this PR and providing a solution.  Unfortunately this missed the latest devel release. We will be picking this up and addressing in the next release in the near future.
As you may have noted we have permissions issues we are currently addressing with the pr workflow. we are hoping this will become more seamless to do this going forward.
Thank you once again for your contribution.
uk-bolly

Hello,
This was addressed with the latest releases
George


Explain arguments to match callback.

Fixes #2622

I think it might make more sense to put that description at https://github.com/rackt/react-router/blob/master/docs/API.md#matchlocation-cb. Still fairly easy to find (hopefully?) but lets us keep the server rendering guide itself more to the point. What do you think?

Ok, will do

I created a new pull request to keep commit history clean.


add(tools): Flowrift

Name
Link

Flowrift
https://flowrift.com

Beautifully designed Tailwind CSS UI blocks.

[X] My item is in the right category
[X] My item is logically grouped below similar items
[X] My item's name and description respects the conventions of the list
[X] My item is awesome
[X] My item is in line with the Tailwind brand usage guidelines
[X] I have read and followed the contribution guidelines

Thanks!


[CI] address sequence sampler test problem

Description
address sequence sampler test failure
Checklist
Essentials

[ ] PR's title starts with a category (e.g. [BUGFIX], [MODEL], [TUTORIAL], [FEATURE], [DOC], etc)
[ ] Changes are complete (i.e. I finished coding on this PR)
[ ] All changes have test coverage
[ ] Code is well-documented

Changes

[ ] Feature1, tests, (and when applicable, API doc)
[ ] Feature2, tests, (and when applicable, API doc)

Comments

If this change is a backward incompatible change, why must this change be made.
Interesting edge cases to note here

Job PR-685/4 is complete.
Docs are uploaded to http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-685/4/index.html


Seems we remove the first 4 byte of message length data for LocalSendMessage?

https://github.com/Microsoft/GraphEngine/blob/3a83cba54f5d3d9b2cb1e6cf34670679a9dffcce/src/Trinity.Core/Storage/LocalMemoryStorage/LocalMemoryStorage.Message.cs#L36
Here, we send the buf to native codes, but the buf has a 8 byte header with the first 4 byte message length data.
Shoule we remove the first 4 byte message length data?
Because in
https://github.com/Microsoft/GraphEngine/blob/3a83cba54f5d3d9b2cb1e6cf34670679a9dffcce/src/Trinity.C/src/Events/Events.cpp#L423
Here, "*(uint16_t*)message->buf" seems get 2 bytes of the message length. But, we supporse want to get the message type index here.

hi huoyao,
nope, the length header is always invisible to a handler. Notice the length is populated to MessageBuff.Length, not the head of MessageBuf.Buffer.
If sent remotely, the bytes transferred on-wire would be [Length] + [Buffer].

closing this issue now;


DID support in java driver

Do you plan to support DID per spec https://w3c-ccg.github.io/did-spec/ as you do in javascript driver?
It will be nice to see this example in java as a test case:
https://www.bigchaindb.com/developers/guide/tutorial-car-telemetry-app/#update-of-an-asset-on-bigchaindb

No.


Merge v2.3 to Main

Grabs some of the objective favorites for the main branch.

Will fix docs links separately, then merge.


[GSOC 2019] App crash while uploading the image

Summary:
App crash on navigating to a different app while uploading an image. Don't now that it appears other times or not. But I'll go through it
E/ACRA: ACRA caught a IllegalStateException for fr.free.nrw.commons.beta
    java.lang.IllegalStateException: Failure saving state: active UploadMediaDetailFragment{49afb6e (a30d76d9-c80c-4da5-8418-952c2c6f0b74) id=0x7f09025c} was removed from the FragmentManager
        at androidx.fragment.app.FragmentManagerImpl.saveAllState(FragmentManagerImpl.java:2315)
        at androidx.fragment.app.FragmentController.saveAllState(FragmentController.java:150)
        at androidx.fragment.app.FragmentActivity.onSaveInstanceState(FragmentActivity.java:496)
        at androidx.appcompat.app.AppCompatActivity.onSaveInstanceState(AppCompatActivity.java:511)
        at android.app.Activity.performSaveInstanceState(Activity.java:1420)
        at android.app.Instrumentation.callActivityOnSaveInstanceState(Instrumentation.java:1306)
        at android.app.ActivityThread.callCallActivityOnSaveInstanceState(ActivityThread.java:4710)
        at android.app.ActivityThread.performStopActivityInner(ActivityThread.java:4007)
        at android.app.ActivityThread.handleStopActivity(ActivityThread.java:4072)
        at android.app.ActivityThread.-wrap25(ActivityThread.java)
        at android.app.ActivityThread$H.handleMessage(ActivityThread.java:1608)
        at android.os.Handler.dispatchMessage(Handler.java:110)
        at android.os.Looper.loop(Looper.java:203)
        at android.app.ActivityThread.main(ActivityThread.java:6364)
        at java.lang.reflect.Method.invoke(Native Method)
        at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:1076)
        at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:937)
I/Process: Sending signal. PID: 21465 SIG: 9
Application terminated.

Would you like to work on the issue?
Yes

Is this happening on master as well ?

No it happened for me in branch upload_caption_depict

Ohh, please sync your branch with master, master already has a fix for this :-)


GDAL integration not being picked up in rf-notebooks.

Using the code in https://github.com/locationtech/rasterframes/pull/235 the following code can be invoked in the notebook environement:
from pyrasterframes.utils import *
spark = create_rf_spark_session()
gdal_version()

The current  result is 'not available'. It should be something like
GDAL version GDAL 2.4.1, released 2019/03/15

Note: To build and launch a notebook, run sbt rf-notebook/startRFNotebook

Looks like the GDAL install code in build/circleci/Dockerfile needs to be copied to rf-notebook/src/main/docker/Dockerfile.

@vpipkt Kinda got it working.... but not the right version of gdal :-/ :

Closing as dupe. We'll move conversations to #193