Crash with libtesseract with PSM_AUTO_OSD

Environment

Tesseract Version: 4.00~git2288-10f4998a-2
Platform: Linux cloud-STK1AW32SC 4.15.0-20-generic #21-Ubuntu SMP Tue Apr 24 06:16:15 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux

Current Behavior:
I am using above mentioned version of libtesseract for reading. When initializing tesseract with following code, the program crashes at startup.
    TessBaseAPI _tess_ptr = new TessBaseAPI();
    if (_tess_ptr->Init(NULL, "osd+deu+eng")) {
        fprintf(stderr, "Could not initialize tesseract\n");
        exit(1);
    }
    _tess_ptr->SetPageSegMode(PSM_AUTO_OSD);

The only error message I get is:
Error: Illegal Parameter specification!
"Fatal error encountered!" == NULL:Error:Assert failed:in file globaloc.cpp, line 75

Expected Behavior:
I would expect the Program to actually start up or give a more explanatory error message.
I don't rule out an error on my side.
Suggested Fix:

The error handling in libtesseract is indeed problematic.

Which traineddata variant did you use (tessdata/tessdata_fast/tessdata_best)?

I don't know which traineddata I did use. When trying to run the tesseract CLI utility with the command tesseract bc.png stdout -l eng+deu --psm 0 I get a segfault.
I can not provide a sample image, but I don't think it has to do something with the image. I tried different images, but they all fail.

When trying to run the tesseract CLI utility with the command tesseract bc.png stdout -l eng+deu --psm 0

Try this:

tesseract bc.png stdout -l osd --psm 0

Also see issue https://github.com/tesseract-ocr/tesseract/issues/1463

Try this:

tesseract bc.png stdout -l osd --psm 0

The CLI utility does not crash, but does not give me only this output:
Page number: 0
Orientation in degrees: 180
Orientation confidence: 0.13
Script: Japanese
Script confidence: 0.20

I have two problems with this:

This is interesting, but incorrect metadata. What I am trying to read is German.
The utility does not output any text it has read.

Without a sample image it's hard to tell what the source of the issue.

This is interesting, but incorrect metadata. What I am trying to read is German.

The osd module needs a certain minimum amount of characters for each block of text.

The utility does not output any text it has read.

You can try
tesseract bc.png stdout -l deu --psm 1
Or
tesseract bc.png stdout -l deu+eng --psm 1
Or
tesseract bc.png stdout -l script/Latin --psm 1
https://github.com/tesseract-ocr/tessdata_fast/tree/master/script
but if --psm 0 recognized German text as Japanese these command won't recognize your text properly.

You can try
tesseract bc.png stdout -l deu --psm 1
reads the image fine.

Or
tesseract bc.png stdout -l deu+eng --psm 1
reads the image fine.

Or
tesseract bc.png stdout -l script/Latin --psm 1
also works fine.

all three commands resulted in the image being (more or less) correctly read. It's the OSD part that fails. setting --psm 0 results in a crash. Using any Page segmentation that ends on OSD in my code results in a crash.

The reason for crash is this:
osd.traineddata only has legacy tesseract model in it, so any command that causes osd to be called along with a language which only supports --oem 1 (LSTM ) results in crash.
If there is a fix for this for 4.0.0, it will only be to give an error message rather than a crash.
I don't think Ray is going to update osd.traineddata for LSTM now.

I have two problems with this:
This is interesting, but incorrect metadata. What I am trying to read is German.
The utility does not output any text it has read.

For German, just using -l deu should suffice. Why are you using osd?

I am using OSD, because I can't guarantee that the text is oriented the right way.

Specifying -l lang1+osd is wrong usage.
-l deu --psm 1
will use the deu and osd traineddata
However, with --psm 0 the right usage is:
-l osd --psm 0

However, with --psm 0 the right usage is: -l osd --psm 0

I just had a crash because I did not use -l osd with --psm 0. If --psm 0 requires -l osd, we should either abort with an error message if -l osd was missing, or enforce it automatically. Which of both alternatives would be preferred?

Pull request #1818 implements that.
@nek0, I tried your test code. After fixing a compiler error in TessBaseAPI _tess_ptr = new TessBaseAPI();, that code compiled and could be run without a crash.


test: Fixing gsheet tests

Description

Gsheet test fixes due to recent flow changes

Type of change

Cypress

Testing

How Has This Been Tested?

[x] Cypress

Checklist:
QA activity:

[ ] Added Test Plan Approved label after Cypress tests were reviewed

Summary by CodeRabbit

Refactor

Streamlined end-to-end test flows by removing unnecessary interactions with dropdowns and buttons in spreadsheet page management.

https://github.com/appsmithorg/appsmith/actions/runs/7565674948 is the latest run

Latest Run


ci: check if all tests have markers

coverage: 95.224% (-1.2%) from 96.465%
when pulling c2968c82fe93d910ebb80b501d23b97ce7fa1f13 on check-pytest-markers
into 394c88149f9bb875f7336eb3f7c5027b770826a3 on main.


Site Recovery Checklist for replicating VMs

Is there a "checklist" in Azure Site Recovery documentation that contains the requirements for on-premise virtual machines be shown to ASR Replicate Setup?
We're having some issues in where we want to protect a certain VM in ASR but we cannot find that particular VM during the setup.
So far, what we've checked is that the configuration server can ping/communicate to the VM.
Is there anything I need to check here?

@prtdomingo Please help with the document on which this feedback is provided. Thanks.

@prtdomingo Please note that the GitHub issue on which you are requesting assistance is related to Azure Document Feedback. Every Azure document have Document Feedback option and that open this GitHub issue. If you could help with the document you were referring on which the query is related to we will be able to help you here.
In case you query is not related to any document please open a new MSDN forum post and community will help address your query. Please refer to below link to MSDN forum to ask new question -
https://social.msdn.microsoft.com/Forums/en-US/newthread?category=windowsazureplatform&forum=hypervrecovmgr

@prtdomingo We will now proceed to close this thread. Thanks.


Port to dotnet core (.NET Core) 1.0.0 RTM

https://github.com/aspnet/cli-samples

This should be done as fork to "ASP.NET-Core-WebSocket-Example". (https://github.com/aspnet/Announcements/issues/176)

https://docs.asp.net/en/latest/getting-started.html

So how to make it run this example? I can't make it work

@Konard
I have this issue
Reference to type 'WebSocket' claims it is defined in 'System', but it could not be found.
When I try to run this project in new 1.0 .Net Core


Salutation Associations

Please make possible that when customers ask a question in an application of an association do not be addressed as "dear Customer" but as " Shoot your question and we will answer"
Thanks

Make it possible to configure this in the dashboard

duplicate of #156


openstack: Add NOVA_ENDPOINT_TYPE flag

Add flag to change default nova endpoint type passed to the nova
client to allow the ability to use internal endpoints.
Signed-off-by: Carlos L. Torres<EMAIL_ADDRESS>

PTAL @kivio @mateusz-blaszkowski
thanks!

@meteorfox for me looks good but i can check it on setup tomorrow.

@kivio thanks, I can wait until tomorrow

@meteorfox works for me. From my perspective can be merged

LGTM
@meteorfox just FYI - I can of course review the code but I can't verify it it works - @kivio has the access to Openstack setup

@mateusz-blaszkowski Ah, ok. That's good to know. Thanks for the review!
@kivio Thanks!


node-gyp rebuild error in macOS

I am getting the following error while running npm install in my macOS. I have not yet installed Xcode since I currently don't have enough bandwidth to download it. Is there any other workaround to make it work since I need it to work urgently as one of my project depends on it?
Any help will be much appreciated.
><EMAIL_ADDRESS>install /Users/sidntrivedi012/Code/spectral-workbench.js/node_modules/contextify
> node-gyp rebuild

  CXX(target) Release/obj.target/contextify/src/contextify.o
../src/contextify.cc:62:65: warning: 'ToObject' is deprecated [-Wdeprecated-declarations]
        ContextifyContext* ctx = new ContextifyContext(info[0]->ToObject());
                                                                ^
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8.h:2455:10: note: 'ToObject' has been explicitly marked deprecated here
  inline V8_DEPRECATED("Use maybe version", Local<Object> ToObject() const);
         ^
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8config.h:327:29: note: expanded from macro 'V8_DEPRECATED'
  declarator __attribute__((deprecated))
                            ^
../src/contextify.cc:131:56: error: no matching member function for call to 'NewInstance'
        Local<Object> wrapper = Nan::New(constructor)->NewInstance();
                                ~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8.h:3996:44: note: candidate function not viable: requires single argument 'context', but
      no arguments were provided
  V8_WARN_UNUSED_RESULT MaybeLocal<Object> NewInstance(
                                           ^
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8.h:3993:44: note: candidate function not viable: requires 3 arguments, but 0 were
      provided
  V8_WARN_UNUSED_RESULT MaybeLocal<Object> NewInstance(
                                           ^
../src/contextify.cc:150:16: error: no member named 'SetAccessCheckCallbacks' in 'v8::ObjectTemplate'
        otmpl->SetAccessCheckCallbacks(GlobalPropertyNamedAccessCheck,
        ~~~~~  ^
../src/contextify.cc:176:43: warning: 'ToObject' is deprecated [-Wdeprecated-declarations]
        Local<Object> data = info.Data()->ToObject();
                                          ^
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8.h:2455:10: note: 'ToObject' has been explicitly marked deprecated here
  inline V8_DEPRECATED("Use maybe version", Local<Object> ToObject() const);
         ^
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8config.h:327:29: note: expanded from macro 'V8_DEPRECATED'
  declarator __attribute__((deprecated))
                            ^
../src/contextify.cc:182:80: error: too few arguments to function call, expected 2, have 1
        Local<Value> rv = Nan::New(ctx->sandbox)->GetRealNamedProperty(property);
                          ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~         ^
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8.h:3562:3: note: 'GetRealNamedProperty' declared here
  V8_WARN_UNUSED_RESULT MaybeLocal<Value> GetRealNamedProperty(
  ^
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8config.h:416:31: note: expanded from macro 'V8_WARN_UNUSED_RESULT'
#define V8_WARN_UNUSED_RESULT __attribute__((warn_unused_result))
                              ^
../src/contextify.cc:192:43: warning: 'ToObject' is deprecated [-Wdeprecated-declarations]
        Local<Object> data = info.Data()->ToObject();
                                          ^
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8.h:2455:10: note: 'ToObject' has been explicitly marked deprecated here
  inline V8_DEPRECATED("Use maybe version", Local<Object> ToObject() const);
         ^
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8config.h:327:29: note: expanded from macro 'V8_DEPRECATED'
  declarator __attribute__((deprecated))
                            ^
../src/contextify.cc:203:43: warning: 'ToObject' is deprecated [-Wdeprecated-declarations]
        Local<Object> data = info.Data()->ToObject();
                                          ^
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8.h:2455:10: note: 'ToObject' has been explicitly marked deprecated here
  inline V8_DEPRECATED("Use maybe version", Local<Object> ToObject() const);
         ^
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8config.h:327:29: note: expanded from macro 'V8_DEPRECATED'
  declarator __attribute__((deprecated))
                            ^
../src/contextify.cc:209:67: error: too few arguments to function call, expected 2, have 1
        if (!Nan::New(ctx->sandbox)->GetRealNamedProperty(property).IsEmpty() ||
             ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~         ^
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8.h:3562:3: note: 'GetRealNamedProperty' declared here
  V8_WARN_UNUSED_RESULT MaybeLocal<Value> GetRealNamedProperty(
  ^
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8config.h:416:31: note: expanded from macro 'V8_WARN_UNUSED_RESULT'
#define V8_WARN_UNUSED_RESULT __attribute__((warn_unused_result))
                              ^
../src/contextify.cc:210:71: error: too few arguments to function call, expected 2, have 1
            !Nan::New(ctx->proxyGlobal)->GetRealNamedProperty(property).IsEmpty()) {
             ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~         ^
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8.h:3562:3: note: 'GetRealNamedProperty' declared here
  V8_WARN_UNUSED_RESULT MaybeLocal<Value> GetRealNamedProperty(
  ^
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8config.h:416:31: note: expanded from macro 'V8_WARN_UNUSED_RESULT'
#define V8_WARN_UNUSED_RESULT __attribute__((warn_unused_result))
                              ^
../src/contextify.cc:218:43: warning: 'ToObject' is deprecated [-Wdeprecated-declarations]
        Local<Object> data = info.Data()->ToObject();
                                          ^
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8.h:2455:10: note: 'ToObject' has been explicitly marked deprecated here
  inline V8_DEPRECATED("Use maybe version", Local<Object> ToObject() const);
         ^
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8config.h:327:29: note: expanded from macro 'V8_DEPRECATED'
  declarator __attribute__((deprecated))
                            ^
../src/contextify.cc:229:43: warning: 'ToObject' is deprecated [-Wdeprecated-declarations]
        Local<Object> data = info.Data()->ToObject();
                                          ^
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8.h:2455:10: note: 'ToObject' has been explicitly marked deprecated here
  inline V8_DEPRECATED("Use maybe version", Local<Object> ToObject() const);
         ^
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8config.h:327:29: note: expanded from macro 'V8_DEPRECATED'
  declarator __attribute__((deprecated))
                            ^
../src/contextify.cc:319:53: warning: 'ToObject' is deprecated [-Wdeprecated-declarations]
        if (!ContextifyContext::InstanceOf(info[0]->ToObject()))
                                                    ^
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8.h:2455:10: note: 'ToObject' has been explicitly marked deprecated here
  inline V8_DEPRECATED("Use maybe version", Local<Object> ToObject() const);
         ^
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8config.h:327:29: note: expanded from macro 'V8_DEPRECATED'
  declarator __attribute__((deprecated))
                            ^
../src/contextify.cc:322:86: warning: 'ToObject' is deprecated [-Wdeprecated-declarations]
        ContextifyContext* ctx = Nan::ObjectWrap::Unwrap<ContextifyContext>(info[0]->ToObject());
                                                                                ^
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8.h:2455:10: note: 'ToObject' has been explicitly marked deprecated here
  inline V8_DEPRECATED("Use maybe version", Local<Object> ToObject() const);
         ^
/Users/sidntrivedi012/Library/Caches/node-gyp/10.16.0/include/node/v8config.h:327:29: note: expanded from macro 'V8_DEPRECATED'
  declarator __attribute__((deprecated))
                            ^
8 warnings and 5 errors generated.
make: *** [Release/obj.target/contextify/src/contextify.o] Error 1
gyp ERR! build error
gyp ERR! stack Error: `make` failed with exit code: 2
gyp ERR! stack     at ChildProcess.onExit (/usr/local/lib/node_modules/npm/node_modules/node-gyp/lib/build.js:190:23)
gyp ERR! stack     at ChildProcess.emit (events.js:198:13)
gyp ERR! stack     at Process.ChildProcess._handle.onexit (internal/child_process.js:248:12)
gyp ERR! System Darwin 18.5.0
gyp ERR! command "/usr/local/bin/node" "/usr/local/lib/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js" "rebuild"
gyp ERR! cwd /Users/sidntrivedi012/Code/spectral-workbench.js/node_modules/contextify
gyp ERR! node -v v10.16.0
gyp ERR! node-gyp -v v5.0.2
gyp ERR! not ok
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR<EMAIL_ADDRESS>install: `node-gyp rebuild`
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>install script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR!      /Users/sidntrivedi012/.npm/_logs/2019-07-21T11_50_57_636Z-debug.log

Those compile errors are indicative of C++ code that was designed to work against older Node versions compiling against newer ones. You either need to downgrade your version of Node to match what's supported by the package, or find a newer version of the package (or a newer version of a dependent of the package) if one's available or find some other alternative.
It's worth noting that contextify, the package you're compiling here, has been redundant since Node 0.12 since its functionality was integrated into core. See the message here: https://github.com/brianmcd/contextify#you-dont-need-this-module-on-node--012
If you're using a package that's depending on contextify then you might want to see if there's a newer version of it available, it must be pretty old.


HTTP 500 when fetching version statistics

Observed/problematic behavior
I get an internal server error when fetching https://hangar.papermc.io/api/v1/projects/Aternos/mclogs/versions/2.6.2/PAPER/stats?fromDate=2023-04-07T00:00:00Z&toDate=2023-04-13T00:00:00Z
Here's the response body returned by the API:
{
    "timestamp": "2023-04-13T14:10:27.842+00:00",
    "status": 500,
    "error": "Internal Server Error",
    "path": "/api/v1/projects/Aternos/mclogs/versions/2.6.2/PAPER/stats"
}

Expected behavior
A valid response
Steps to reproduce
Fetch the specified endpoint. This also happens on other projects (I tested https://hangar.papermc.io/Aternos/motdgg as well)
Other
No response

Also note that the platform has been removed from the query path, since the return value includes all platform stats anyways


[HW] Sanjeev Deo

Name: Sanjeev Deo
Email<EMAIL_ADDRESS>Linkedin Profile: https://www.linkedin.com/in/sanjeevdeo/
Attach the homework screenshots below for both step II and step III:
Step II Completed:

Step III Completed:
Cassandra Data Modeling:

Cassandra Query Language:

Nice job Sanjeev, thank you.

Hey Sanjeev Deo, great job! Congrats! Here is your badge! https://api.badgr.io/public/assertions/brNe75E-Rt61QIwxrtJ9XA


Iowa County-Level Official Scraper (closes #41)

Good evening!  I've nearly completed the Iowa scraper port from the cmdc-tools version and was hoping to begin reviewing my code!
I'm currently running into 2 errors when running pytest -v -k Iowa ., having to do with the insertion constraints.  It appears to be a problem with locations.  For context, while the IowaCasesDeaths class has county names (or even FIPS codes if we want them), the IowaHospitals class refers to custom "regions".  Are there any recommendations on how to proceed?

Great work @christopherturner
We do have room in the schema for reporting by hospital reagion. It is a location type here: https://github.com/covid-projections/can-scrapers/blob/main/can_tools/bootstrap_data/location_types.csv
We would need to determine how to append the proper rows to the locations.csv file in the bootstrap_data folder
We may need some insight from @TomGoBravo, @ghop02, and @mikelehen on how to set the locationID column for a hospital region

Great work @christopherturner
We do have room in the schema for reporting by hospital reagion. It is a location type here: https://github.com/covid-projections/can-scrapers/blob/main/can_tools/bootstrap_data/location_types.csv
We would need to determine how to append the proper rows to the locations.csv file in the bootstrap_data folder
We may need some insight from @TomGoBravo, @ghop02, and @mikelehen on how to set the locationID column for a hospital region

I don't have too much context on how we did in the past.  I think @ghop02 might.

I don't have too much context on how we did in the past.  I think @ghop02 might.


Using dark theme primitives

Previously we are using lightThemePrimitives as a default theme, but my eyes sucks if I see a light theme.
Consider to change to darkThemePrimitives instead.

test


Add under maintenance page to Vortex

As a vortex user, when vortex is not working i should be able to see the Under Maintenance page
Acceptance criteria

If Vortex is not working, this page should be displayed
Copy of the page

Under Maintenance
We'll be back soon.

Reference

Context
Based on the recent incident where squid router contracts where not working and users funds were stuck on Moonbeam, too avoid such situations we make this page live

@pendulum-chain/devs How would this work? Would we have to manually every time make this live?

If we don't want to make a new release every time something is not working, we should change the app so that it checks some endpoint of a status page (so not on the signer service but somewhere else) and if that status says that there is an error, vortex will show the under maintenance screen. We just need to find a provider that allows us to define custom statuses so that we can easily set it with a user interface (ie. you wouldn't need to require a dev to set the status).

we should change the app so that it checks some endpoint of a status page

You mean something manual? We could set an endpoint on the backend that forces the status to be offline, and only check 1 endpoint from the UI which we already do. Not great UI for us, but works 😆.
But what do we want to shut it off? Ideally we have the pre-flight checks, are there cases not covered?

We could set an endpoint on the backend that forces the status to be offline, and only check 1 endpoint from the UI which we already do. Not great UI for us, but works 😆.

True, but then we'd need to worry about the authentication, which I was hoping to offboard to some other provider.. :( we can't risk the endpoint being callable from anyone obviously.

But what do we want to shut it off? Ideally we have the pre-flight checks, are there cases not covered?

Generally yes, but for example the multicall contract migration that the squidrouter team did broke our app and there was some delay to get the fix live. I think for 'unforeseen' issues like this one, having the ability to show the maintenance message would be helpful.

You're right, I didn't think about the authentication. That is inconvenient to add on our backend. Let's find something like you commented above.

Hey team! Please add your planning poker estimate with Zenhub @ebma @gianfra-t @Sharqiewicz

Instead of using another service we might be able to pull this off with GTM.
One approach would be to have a custom trigger to add a cookie or similar to the app, which then indicates the 'under maintenance' mode. A quick list of actions generated by AI:
Is there a way I can toggle a flag in Google Tag Manager and then have access to that flags status in the web page?
Yes, you can achieve this by using Google Tag Manager (GTM) to set a variable or flag that can be accessed by your web page. Here's a step-by-step guide on how to do this:
Step 1: Create a Variable in GTM

Open GTM and navigate to your container.
Go to Variables in the left-hand menu.
Click on "New" to create a new user-defined variable.
Name the variable (e.g., maintenanceMode).
Set the variable type to 1st Party Cookie or another relevant type, depending on how you want to store the flag.
Save the variable.

Step 2: Create a Tag to Set the Flag

Go to Tags in the left-hand menu.
Click on "New" to create a new tag.
Choose "Custom HTML" as the tag type.
Add the HTML and JavaScript code to set the variable or flag. For example, if using cookies:

<script>
    document.cookie = "maintenanceMode=true; path=/";
</script>

Set up the trigger: Create a trigger that determines when this tag should fire (e.g., a button click, a specific page view, etc.).
Save the tag.

Step 3: Access the cookie

Access the cookie and check it's value
Show app content accordingly

@ebma so tl;dr if i understand this right, we should manually set the variable to true or false and they the page shows up automatically right?

Yeah exactly. So we would configure Google Tag Manager and set up some tags so that in the vortex frontend, we have something we can check, maybe a cookie. And if the cookie is set to 'true' we assume that the app is 'under maintenance' and can then show the screen you put in the description. We would then in GTM configure the schedule of when this cookie should be set and it would be off by default of course.

Interesting solution, so we rely on GTM setting of cookies. Do you know if the cookie will get removed automatically? Otherwise, we can overwrite it once the maintenance is over.

 So we could e.g. say that a specific trigger, in this case the maintenance mode, should be fired from 19.12.2024 at 10am CET to 12am CET, or similar. You get the gist.


Fix BetweenPredicate clone with ExprSubstitutionMap

What type of PR is this：

[x] bug
[ ] feature
[ ] enhancement
[ ] refactor
[ ] others

for https://github.com/StarRocks/starrocks/issues/8699
The expr clone method is:
    /**
     * Create a deep copy of 'this'. If sMap is non-null,
     * use it to substitute 'this' or its subnodes.
     * <p/>
     * Expr subclasses that add non-value-type members must override this.
     */
    public Expr clone(ExprSubstitutionMap sMap) {
        if (sMap != null) {
            for (int i = 0; i < sMap.getLhs().size(); ++i) {
                if (this.equals(sMap.getLhs().get(i))) {
                    return sMap.getRhs().get(i).clone(null);
                }
            }
        }
        Expr result = (Expr) this.clone();
        result.children = Lists.newArrayList();
        for (Expr child : children) {
            result.children.add(((Expr) child).clone(sMap));
        }
        return result;
    }

but BetweenPredicate override it
-    @Override
-    public Expr clone(ExprSubstitutionMap sMap) {
-        return new BetweenPredicate(this);
-    }

Which is needn't and unreasonable.
Why there is no issue before?
Because in old Analyzer, BetweenPredicate will be rewriten to CompoundPredicate.

run starrocks_fe_unittest

This bug has already been covered by daily test


Export feature?

Hi,
Is it possible to add export feature to the chrome app? I've been using it quite a long time and found it was pretty annoy when I finished everything but could not export as HTML or PDF.
For the HTML one I can simply copy all the code, paste and save as html file, but the style is missing.
Thanks.

Hey, thanks for the suggestion.
That's a feature I've been personally missing for quite some time as well, and it definitely makes sense in such an editor, so rest assured it's already on the roadmap.
I'll leave this issue open until it ships, so you'll get a notification when it does. In the meantime, here's the alternate solution I've been using: copy the HTML generated from your Markdown, and paste it inside this HTML template to get an HTML doc using the same styles as in the editor's preview.
Thanks again for bringing this up!


Fix for cygwin/WSL and add support for Windows Store WSL distros

In the Fall Creators Update, WSL now supports different Linux distributions through the Windows Store. Unfortunately, this means the old method of probing $(LOCALAPPDATA)\lxss\rootfs\usr\bin\git to check if git is installed in WSL will no longer work. This patch refactors things so we now just try to run git --version from within the user's default WSL distro, the same way we probe for git on the Windows PATH. This should work with both the old and new WSL installations.

thanks!


JSImport: Not enough information regarding interop for non-module code

The page doesn't mention the [JSImport] overload that only takes a single string functionName argument (without the string moduleName second parameter):

This implies there is an alternate way to reference functions, but the page makes no mention of this. The API/source isn't clear either:

As the alternative IJSRuntime-based JS interop takes objects that reside on the global object, it is not straighforward to migrate to the new JSImport-based solution. This can be increasingly troublesome, because bundling the resulting application code in a JavaScript bundle might not support exporting the bundle as an EcmaScript module (webpack support is only experimental). Bundling (with minification, optimizations etc.) is still considered by many a superior solution than loading individual (small) module files over network and can simplify deployment or caching of resources.
The questions unclear are:

Is there a way to refer to already loaded objects/functions instead of loading different modules?
How to use the [JSImport(string functionName)] overload of the attribute?

I haven't found an easy way to invoke non-module members with JSImport, but if it is an intentional design choice, there is a simple hack to work around that:
const w = window;
export { w as window };

I'd rather the API supported the window/global object by default.

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 8aab92a0-c05f-ef01-fb74-a0bf525aae69
Version Independent ID: 8aab92a0-c05f-ef01-fb74-a0bf525aae69
Content: JavaScript JSImport/JSExport interop with ASP.NET Core Blazor WebAssembly
Content Source: aspnetcore/blazor/javascript-interoperability/import-export-interop.md
Product: aspnet-core
Technology: aspnetcore-blazor
GitHub Login: @guardrex
Microsoft Alias: riande

Hello @yugabe ... Let's ping @pavelsavara for comment on this.

module name on JSImport is just a name. It doesn't have to be JS file. You could use setModuleImports to set the exports of virtual "module" and bind it to any function, even things on globalThis. Example
You can pass globalThis prefix to [JSImport("globalThis.console.log")] Example

Thanks @pavelsavara, I'll take a look. I tried prefixing with "window", but it didn't work (didn't log an error either, but it's probably an issue elsewhere in my code base). This is enough for me to go on.
This could maybe worth mentioning in the docs, especially as it seems this is just undocumented, but there are test cases that support it is working. @guardrex?

I'll take look, but it will probably be tomorrow/Friday due to on-going .NET 7 docs work.

didn't log an error either

It could not fail on compile time when the attribute is processed, because we don't know if you provided window module at runtime. It would fail when you call the imported function.

The issue was indeed in one of my test projects (Blazor didn't register some event handlers correctly, so the generated interop method wasn't called).
Using it as @pavelsavara described works as intended. Prefixing with "window" in itself does not work, but "globalThis" does. Thanks for the help.


Unread multipart form input generates error output

I am using Flask (2.0.2) for a web service API. It does not produce web pages, but accepts multipart form encoded requests to read and update a back-end data store, carries out the requests, and returns a simple text response (with response code 200) or an error response with error message.
The following "Hello World" code produces a rather strange response when some multipart input is posted.
@app.route('/hello', methods = ['GET', 'POST'])
def hello():
return 'Hello World!\n'
The result of this is:
Hello World!

Error response

Error response
Error code: 400
Message: Bad request syntax ('--&').
Error code explanation: HTTPStatus.BAD_REQUEST - Bad request syntax or unsupported method.

The returned response code is actually 200 but the response includes an error message that looks as though it was generated by trying to parse the multipart form input as HTML. (The multipart boundary was '&' and this looks to be the immediate cause of the "bad syntax".)
If, however, the following line is inserted before the return statement, the response is what I would expect. (One of the multipart parts is named 'json').
ignore = request.files['json']

The result in this case is just:
Hello World!
It looks as though, unless the input is read, it is parsed as HTML. Although there is an easy work-around, it would be better if this did not happen.

Upgrade Werkzeug. Also upgrade Flask.

Thanks - David! Works with Flask 2.1.2 (I did look for relevant issues, but must have used the wrong search terms.)


How to solve "Enable text compression" Lighthouse performance error when running through Netlify Plugin

I'm trying to see if I can move Frontend oriented CI to Netlify.
One of the features I'm expecting is getting Lighthouse score and thresholds to work.
However, it seems that, because this plugin relies on puppeteer and http-server, gzip compression is not enabled leading to a poor performance grade making it unusable for us.

Any idea how to get this sorted? I'm willing to help with a PR if any of you have a pointer to sort this out.
Many thanks!

Hi @griable! That's a very good point.
Looking at https://github.com/http-party/http-server/issues/56 it doesn't seem it has built in support for compression.
We could switch to https://expressjs.com/en/starter/static-files.html and http://expressjs.com/en/resources/middleware/compression.html if that works, or any other static server that supports it.
Also we have a discussion in https://github.com/netlify-labs/netlify-plugin-lighthouse/issues/152#issuecomment-824198174 to audit the live URL instead of using a local server, however that might take longer to implement.


[AutoPR network/resource-manager] Revert "Swagger changes for App Gw Server Variables APIs"

Created to sync https://github.com/Azure/azure-rest-api-specs/pull/4911

Codecov Report

Merging #4068 into restapi_auto_december-network-release will decrease coverage by 1.74%.
The diff coverage is 69.97%.

@@                            Coverage Diff                            @@
##           restapi_auto_december-network-release    #4068      +/-   ##
=========================================================================
- Coverage                                  55.97%   54.23%   -1.75%
=========================================================================
  Files                                       9412    10235     +823
  Lines                                     189074   207839   +18765
=========================================================================
+ Hits                                      105841   112719    +6878
- Misses                                     83233    95120   +11887

Impacted Files
Coverage Δ

..._01/models/container_service_ssh_public_key_py3.py
100% <ø> (ø)

...7_07_01/models/container_service_vm_diagnostics.py
62.5% <ø> (ø)

...rservice/v2018_03_31/models/operation_value_py3.py
41.66% <ø> (ø)

...stry/v2018_09_01/operations/webhooks_operations.py
85.71% <ø> (ø)
:arrow_up:

...service/v2017_07_01/models/key_vault_secret_ref.py
55.55% <ø> (ø)

...ice/v2017_07_01/models/key_vault_secret_ref_py3.py
55.55% <ø> (ø)

...01/models/container_service_windows_profile_py3.py
62.5% <ø> (ø)

...18_02_01_preview/operations/webhooks_operations.py
85.71% <ø> (ø)
:arrow_up:

.../v2017_10_01/operations/replications_operations.py
15.17% <ø> (ø)
:arrow_up:

..._07_01/models/container_service_windows_profile.py
62.5% <ø> (ø)

... and 1201 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 43c6b15...50e66f8. Read the comment docs.


Refactor variable names according to Go style guide

What type of PR is this?
/kind cleanup
What this PR does / why we need it:
Refactor unexported variable names: remove underscores and change case for initialisms. Enable revive.var-naming rule to enforce proper variable names.
Special notes for your reviewer:
From the Google style guide:

Go source code usually uses MixedCaps or mixedCaps (camel case) rather than underscores (snake case) when writing multi-word names.

From Effective Go:

Finally, the convention in Go is to use MixedCaps or mixedCaps rather than underscores to write multiword names.

From Go wiki:

Words in names that are initialisms or acronyms (e.g. “URL” or “NATO”) have a consistent case. For example, “URL” should appear as “URL” or “url” (as in “urlPony”, or “URLPony”), never as “Url”.
This rule also applies to “ID” when it is short for “identifier” (which is pretty much all cases when it’s not the “id” as in “ego”, “superego”), so write “appID” instead of “appId”.

Does this PR introduce a user-facing change?
NONE

ok-to-test

/ok-to-test


Retrieve current or previous frontmatter setting

It would be nice to have a way to determine what the frontmatter value is of (setting X) the last time it was set.
An example:
We could use it to define "sections" or "chapters" and not have to set it for any slide in that section, but rather only when it starts. We can use it to i.e. determine a default background color/blend or even display it in the bottom bar

Maybe this will help


Add ability to export metrics and users tabular data to csv and excel

To give users flexibility of performing their own analysis add ability to export metrics and users data. We will need to consider larger datasets export with possible solutions of paging, pre-filtering or thresholding.
Consider tabular data for export:

Any table under /administrator/projects/<project id>/metrics/**
users table on project, subject, badge, skill pages

this ticket was split into:

https://github.com/NationalSecurityAgency/skills-service/issues/2768
https://github.com/NationalSecurityAgency/skills-service/issues/2769
https://github.com/NationalSecurityAgency/skills-service/issues/2770


Minor code clean-up

@croudet Could you please rebase this PR on the current master branch and resolve the conflict with modules/swagger-core/src/main/java/io/swagger/v3/core/jackson/TypeNameResolver.java?
Thanks. 😃

Rebased to current master.


Process does not exit after window is closed

It seems like bs:f is told to shut down but the process actually seems to stay active until you manually kill it.

On windows I even get an exception when I close the window.
void REGothEngine::shutdown()
{
  if (bs::Application::isStarted())
  {
    bs::gDebug().logDebug("[REGothEngine] Shutting down bs::f");

    bs::Application::shutDown();
  }
  else
  {
    bs::gDebug().logWarning("[REGothEngine] Received shutdown request, but bs::f is not running!");
  }
}

It can be traced back to the else case of the code above. Using the logger after the window (and therefore bs::f) has been shut down seems cause the exception.

Fixed in PR #40


Hw11

A new test was added for checking Constrained Forward Dynamics that checks if you implemented a non-zero return value.
You do not have to update the tests in your toolbox, they are updated in the BRUTE automatically.
there is also a bug in the exercise for Constrained Forward Dynamics; the initial velocity has to be zero; it was fixed in the latest commit


 Exiting.

The issue you're seeing is happening because the kolide container is failing to connect to the mysql one. We've noticed over time that Docker for Mac can sometimes fail network connections between macs. (see https://github.com/docker/for-mac/issues/1374 for example)
I recommend running docker rm -f $(docker ps -a -q) (which will remove all containers you have running on your mac, if you wan tto preserve some you can just remove the kolide ones) then restart the docker daemon and try again.

thanks Groob, is now working

I'm having the same issue that nigifabio had but it persists after removing all containers and restarting Docker.

@ashvinashoke are you running the latest version of kolide-quickstart?

@zwass Yes I am.

@zwass In the demo.sh file, does the server address need to be set to <IP_ADDRESS> if I'm trying to run Kolide locally?

No, you should be able to run it just by following the instructions. Can you paste the error you are seeing?

Waiting for MySQL to accept connections... Waiting for Kolide server to accept connections.....................................................Error: Kolide failed to start up. Exiting.

Can you please provide the full output of the command? And the results of docker-compose ps?

./demo.sh up simple <my license string>
Using default tag: latest
latest: Pulling from kolide/kolide
52a8f959a09a: Already exists
a3ed95caeb02: Already exists
13b5209e6196: Already exists
9005727a1eab: Already exists
Digest: sha256:956d4bf9c11c88f75ad92df9375a0285948aaf42950180d8f8501edbf835548a
Status: Image is up to date for kolide/kolide:latest
Using default tag: latest
latest: Pulling from kolide/openssl
Digest: sha256:9d86215afdd5d76faae9de32b7be862a64542ff7ddcc753c43b34118f42aead8
Status: Image is up to date for kolide/openssl:latest
kolidequickstart_mailhog_1 is up-to-date
kolidequickstart_redis_1 is up-to-date
kolidequickstart_mysql_1 is up-to-date
Starting kolidequickstart_kolide_1 ...
Starting kolidequickstart_kolide_1 ... done
Waiting for MySQL to accept connections...
Waiting for Kolide server to accept connections.....................................................Error: Kolide failed to start up. Exiting.
ashvin-ashoke-mbpr15:kolide-quickstart ashvinashoke$
docker-compose ps
WARNING: The KOLIDE_HOST_HOSTNAME variable is not set. Defaulting to a blank string.
WARNING: The KOLIDE_HOST_IP variable is not set. Defaulting to a blank string.
Name                         Command               State                 Ports
kolidequickstart_kolide_1    sh -c echo '\n' | ./kolide ...   Exit 1
kolidequickstart_mailhog_1   MailHog                          Up       1025/tcp, <IP_ADDRESS>:8025->8025/tcp
kolidequickstart_mysql_1     docker-entrypoint.sh mysql ...   Up       3306/tcp
kolidequickstart_redis_1     docker-entrypoint.sh redis ...   Up       6379/tcp

Are you replacing <my license string> with the license string from your https://kolide.com/ account?

Yes

I just tried starting again from scratch and it works for me. I know this is silly, but have you restarted your computer? Can you post the output of docker-compose logs?

Yeah I've tried restarting. Here's the output:
WARNING: The KOLIDE_HOST_HOSTNAME variable is not set. Defaulting to a blank string.
WARNING: The KOLIDE_HOST_IP variable is not set. Defaulting to a blank string.
Attaching to kolidequickstart_kolide_1, kolidequickstart_redis_1, kolidequickstart_mysql_1, kolidequickstart_mailhog_1
redis_1             | 1:C 11 Jul 23:38:46.424 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf
redis_1             |                 .
redis_1             |            .-__ ''-._                                              redis_1             |       _.- .  .  ''-._           Redis 3.2.4 (00000000/0) 64 bit
redis_1             |   .- .-```.  ```\/    _.,_ ''-._                                    mysql_1             | 2017-07-11T23:38:46.984157Z 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details). redis_1             |  (    '      ,       .-`  | `,    )     Running in standalone mode kolide_1            | Using config file:  /tmp/kolide.yml mysql_1             | 2017-07-11T23:38:46.988567Z 0 [Note] mysqld (mysqld 5.7.18) starting as process 1 ... redis_1             |  |`-._`-...-` __...-.-.|'_.-'|     Port: 6379 kolide_1            | Migrations already completed. Nothing to do. mysql_1             | 2017-07-11T23:38:46.992293Z 0 [Warning] Setting lower_case_table_names=2 because file system for /tmp/mysqldata/ is case insensitive redis_1             |  |   -. ._    /     _.-'    |     PID: 1 kolide_1            | Using config file:  /tmp/kolide.yml mysql_1             | 2017-07-11T23:38:46.994188Z 0 [Note] InnoDB: PUNCH HOLE support available redis_1             |   -._    -._  -./  .-'    .-'
kolide_1            | ################################################################################
mysql_1             | 2017-07-11T23:38:46.994233Z 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
redis_1             |  |-._-. -.__.-'    _.-'_.-'|                                   kolide_1            | # ERROR: mysql_1             | 2017-07-11T23:38:46.994238Z 0 [Note] InnoDB: Uses event mutexes redis_1             |  |    -.-._        _.-'_.-'    |           http://redis.io         kolide_1            | #   A value must be supplied for --auth_jwt_key. This value is used to create mysql_1             | 2017-07-11T23:38:46.994240Z 0 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier kolide_1            | #   session tokens for users. redis_1             |   -._    -._-..-'.-'    .-'
mysql_1             | 2017-07-11T23:38:46.994242Z 0 [Note] InnoDB: Compressed tables use zlib 1.2.3
kolide_1            | #
mailhog_1           | [HTTP] Binding to address: <IP_ADDRESS>:8025
redis_1             |  |-._-. -.__.-'    _.-'_.-'|                                   mysql_1             | 2017-07-11T23:38:46.994245Z 0 [Note] InnoDB: Using Linux native AIO kolide_1            | #   Consider using the following randomly generated key: mailhog_1           | Creating API v1 with WebPath:  redis_1             |  |    -.-._        _.-'_.-'    |                                   mysql_1             | 2017-07-11T23:38:46.994595Z 0 [Note] InnoDB: Number of pools: 1 kolide_1            | #   xNLJS/uZ1KX2sW/LAbHWmBpa7efbHZka mailhog_1           | Creating API v2 with WebPath:  redis_1             |   -._    -._-..-'.-'    .-'
mysql_1             | 2017-07-11T23:38:46.994715Z 0 [Note] InnoDB: Using CPU crc32 instructions
kolide_1            | ################################################################################
mailhog_1           | 2017/07/11 23:38:46 Using in-memory storage
redis_1             |       -._    -..-'    _.-'
mysql_1             | 2017-07-11T23:38:47.002650Z 0 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M
kolide_1            | Using config file:  /tmp/kolide.yml
mailhog_1           | 2017/07/11 23:38:46 [SMTP] Binding to address: <IP_ADDRESS>:1025
redis_1             |           -._        _.-'                                            mysql_1             | 2017-07-11T23:38:47.008301Z 0 [Note] InnoDB: Completed initialization of buffer pool kolide_1            | Migrations already completed. Nothing to do. mailhog_1           | 2017/07/11 23:38:46 Serving under http://<IP_ADDRESS>:8025/ redis_1             |               -..-'
mysql_1             | 2017-07-11T23:38:47.011308Z 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
kolide_1            | Using config file:  /tmp/kolide.yml
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             |
mysql_1             | 2017-07-11T23:38:47.041951Z 0 [Note] InnoDB: Highest supported file format is Barracuda.
kolide_1            | ################################################################################
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             | 1:M 11 Jul 23:38:46.425 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.
mysql_1             | 2017-07-11T23:38:47.051539Z 0 [Note] InnoDB: Log scan progressed past the checkpoint lsn 13898535
kolide_1            | # ERROR:
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             | 1:M 11 Jul 23:38:46.425 # Server started, Redis version 3.2.4
mysql_1             | 2017-07-11T23:38:47.051575Z 0 [Note] InnoDB: Doing recovery: scanned up to log sequence number 13898544
kolide_1            | #   A value must be supplied for --auth_jwt_key. This value is used to create
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             | 1:M 11 Jul 23:38:46.425 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo never > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled.
mysql_1             | 2017-07-11T23:38:47.051927Z 0 [Note] InnoDB: Doing recovery: scanned up to log sequence number 13898544
kolide_1            | #   session tokens for users.
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             | 1:M 11 Jul 23:38:46.425 * The server is now ready to accept connections on port 6379
mysql_1             | 2017-07-11T23:38:47.051947Z 0 [Note] InnoDB: Database was not shutdown normally!
kolide_1            | #
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             | 1:signal-handler<PHONE_NUMBER>) Received SIGTERM scheduling shutdown...
mysql_1             | 2017-07-11T23:38:47.051950Z 0 [Note] InnoDB: Starting crash recovery.
kolide_1            | #   Consider using the following randomly generated key:
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             | 1:M 12 Jul 16:14:26.193 # User requested shutdown...
mysql_1             | 2017-07-11T23:38:48.296277Z 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
kolide_1            | #   htYIUS68s3mQifw24yoo/zVKn+MqXih4
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             | 1:M 12 Jul 16:14:26.194 * Saving the final RDB snapshot before exiting.
mysql_1             | 2017-07-11T23:38:48.296313Z 0 [Note] InnoDB: Creating shared tablespace for temporary tables
kolide_1            | ################################################################################
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             | 1:M 12 Jul 16:14:26.196 * DB saved on disk
mysql_1             | 2017-07-11T23:38:48.297173Z 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
kolide_1            | Using config file:  /tmp/kolide.yml
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             | 1:M 12 Jul 16:14:26.196 # Redis is now ready to exit, bye bye...
mysql_1             | 2017-07-11T23:38:48.357702Z 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
kolide_1            | Migrations already completed. Nothing to do.
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             | 1:C 12 Jul 16:50:59.819 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf
mysql_1             | 2017-07-11T23:38:48.377849Z 0 [Note] InnoDB: 96 redo rollback segment(s) found. 96 redo rollback segment(s) are active.
kolide_1            | Using config file:  /tmp/kolide.yml
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             |                 .
mysql_1             | 2017-07-11T23:38:48.377900Z 0 [Note] InnoDB: 32 non-redo rollback segment(s) are active.
kolide_1            | ################################################################################
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             |            .-__ ''-._                                              mysql_1             | 2017-07-11T23:38:48.378270Z 0 [Note] InnoDB: Waiting for purge to start kolide_1            | # ERROR: mailhog_1           | [APIv1] KEEPALIVE /api/v1/events redis_1             |       _.- .  .  ''-.           Redis 3.2.4 (00000000/0) 64 bit
mysql_1             | 2017-07-11T23:38:48.428590Z 0 [Note] InnoDB: 5.7.18 started; log sequence number 13898544
kolide_1            | #   A value must be supplied for --auth_jwt_key. This value is used to create
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             |   .- .-```.  ```\/    _.,_ ''-._                                    mysql_1             | 2017-07-11T23:38:48.428828Z 0 [Note] Plugin 'FEDERATED' is disabled. kolide_1            | #   session tokens for users. mailhog_1           | [APIv1] KEEPALIVE /api/v1/events redis_1             |  (    '      ,       .-`  | `,    )     Running in standalone mode mysql_1             | 2017-07-11T23:38:48.429998Z 0 [Note] InnoDB: Loading buffer pool(s) from /tmp/mysqldata/ib_buffer_pool kolide_1            | # mailhog_1           | [APIv1] KEEPALIVE /api/v1/events redis_1             |  |`-._`-...-` __...-.-.|'_.-'|     Port: 6379 mysql_1             | 2017-07-11T23:38:48.441006Z 0 [Warning] World-writable config file './auto.cnf' is ignored. kolide_1            | #   Consider using the following randomly generated key: mailhog_1           | [APIv1] KEEPALIVE /api/v1/events redis_1             |  |   -._   ._    /     _.-'    |     PID: 1 mysql_1             | 2017-07-11T23:38:48.441490Z 0 [Warning] World-writable config file './auto.cnf' has been removed. kolide_1            | #   nC0tVJwcPfyRH8ylWybD3rM8wjlBE/a9 mailhog_1           | [APIv1] KEEPALIVE /api/v1/events redis_1             |   -._    -._  -./  .-'    .-'
mysql_1             |
kolide_1            | ################################################################################
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             |  |-._-. -.__.-'    _.-'_.-'|                                   mysql_1             | 2017-07-11T23:38:48.442485Z 0 [Note] Salting uuid generator variables, current_pid: 1, server_start_time:<PHONE_NUMBER>, bytes_sent: 0,  kolide_1            | Using config file:  /tmp/kolide.yml mailhog_1           | [APIv1] KEEPALIVE /api/v1/events redis_1             |  |    -.-._        _.-'_.-'    |           http://redis.io         mysql_1             | 2017-07-11T23:38:48.442575Z 0 [Note] Generated uuid: '165b3bf9-6692-11e7-9624-0242ac120003', server_start_time:<PHONE_NUMBER>26983, bytes_sent: 64455968 kolide_1            | Migrations already completed. Nothing to do. mailhog_1           | [APIv1] KEEPALIVE /api/v1/events redis_1             |   -._    -._-..-'.-'    .-'
mysql_1             | 2017-07-11T23:38:48.442617Z 0 [Warning] No existing UUID has been found, so we assume that this is the first time that this server has been started. Generating a new UUID: 165b3bf9-6692-11e7-9624-0242ac120003.
kolide_1            | Using config file:  /tmp/kolide.yml
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             |  |-._-. -.__.-'    _.-'_.-'|                                   mysql_1             | 2017-07-11T23:38:48.468591Z 0 [Note] Found ca.pem, server-cert.pem and server-key.pem in data directory. Trying to enable SSL support using them. kolide_1            | ################################################################################ mailhog_1           | [APIv1] KEEPALIVE /api/v1/events redis_1             |  |    -.-._        _.-'_.-'    |                                   mysql_1             | 2017-07-11T23:38:48.475406Z 0 [Note] InnoDB: Buffer pool(s) load completed at 170711 23:38:48 kolide_1            | # ERROR: mailhog_1           | [APIv1] KEEPALIVE /api/v1/events redis_1             |   -._    -._-..-'_.-'    _.-'
mysql_1             | 2017-07-11T23:38:48.476116Z 0 [Warning] CA certificate ca.pem is self signed.
kolide_1            | #   A value must be supplied for --auth_jwt_key. This value is used to create
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             |       -._    -..-'    _.-'
mysql_1             | 2017-07-11T23:38:48.477623Z 0 [Note] Server hostname (bind-address): '*'; port: 3306
kolide_1            | #   session tokens for users.
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             |           -._        _.-'                                            mysql_1             | 2017-07-11T23:38:48.477661Z 0 [Note] IPv6 is available. kolide_1            | # mailhog_1           | [APIv1] KEEPALIVE /api/v1/events redis_1             |               -..-'
mysql_1             | 2017-07-11T23:38:48.477667Z 0 [Note]   - '::' resolves to '::';
kolide_1            | #   Consider using the following randomly generated key:
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             |
mysql_1             | 2017-07-11T23:38:48.477693Z 0 [Note] Server socket created on IP: '::'.
kolide_1            | #   xnXUvZwg69AgY9VlN+HmIbgMtTI3Yjrc
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             | 1:M 12 Jul 16:50:59.823 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.
mysql_1             | 2017-07-11T23:38:48.503350Z 0 [Warning] 'user' entry 'root@localhost' ignored in --skip-name-resolve mode.
kolide_1            | ################################################################################
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             | 1:M 12 Jul 16:50:59.824 # Server started, Redis version 3.2.4
mysql_1             | 2017-07-11T23:38:48.503392Z 0 [Warning] 'user' entry 'mysql.sys@localhost' ignored in --skip-name-resolve mode.
kolide_1            | Using config file:  /tmp/kolide.yml
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             | 1:M 12 Jul 16:50:59.824 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo never > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled.
mysql_1             | 2017-07-11T23:38:48.504004Z 0 [Warning] 'db' entry 'sys mysql.sys@localhost' ignored in --skip-name-resolve mode.
kolide_1            | Migrations already completed. Nothing to do.
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             | 1:M 12 Jul 16:50:59.824 * DB loaded from disk: 0.000 seconds
mysql_1             | 2017-07-11T23:38:48.504541Z 0 [Warning] 'proxies_priv' entry '@ root@localhost' ignored in --skip-name-resolve mode.
kolide_1            | Using config file:  /tmp/kolide.yml
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
redis_1             | 1:M 12 Jul 16:50:59.824 * The server is now ready to accept connections on port 6379
mysql_1             | 2017-07-11T23:38:48.538751Z 0 [Warning] 'tables_priv' entry 'sys_config mysql.sys@localhost' ignored in --skip-name-resolve mode.
kolide_1            | ################################################################################
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-11T23:38:48.679462Z 0 [Note] Event Scheduler: Loaded 0 events
kolide_1            | # ERROR:
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-11T23:38:48.679738Z 0 [Note] mysqld: ready for connections.
kolide_1            | #   A value must be supplied for --auth_jwt_key. This value is used to create
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | Version: '5.7.18'  socket: '/var/run/mysqld/mysqld.sock'  port: 3306  MySQL Community Server (GPL)
kolide_1            | #   session tokens for users.
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-11T23:38:48.679759Z 0 [Note] Executing 'SELECT * FROM INFORMATION_SCHEMA.TABLES;' to get a list of tables using the deprecated partition engine. You may use the startup option '--disable-partition-engine-check' to skip this check.
kolide_1            | #
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-11T23:38:48.679761Z 0 [Note] Beginning of list of non-natively partitioned tables
kolide_1            | #   Consider using the following randomly generated key:
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-11T23:38:48.994749Z 0 [Note] End of list of non-natively partitioned tables
kolide_1            | #   bFQ96BXLM7xmBl2F5+SM3R8kbgzAfTFd
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-11T23:38:50.056968Z 4 [Note] Aborted connection 4 to db: 'kolide' user: 'kolide' host: '<IP_ADDRESS>' (Got an error reading communication packets)
kolide_1            | ################################################################################
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-11T23:38:50.080169Z 5 [Note] Aborted connection 5 to db: 'kolide' user: 'kolide' host: '<IP_ADDRESS>' (Got an error reading communication packets)
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-11T23:42:18.217022Z 6 [Note] Aborted connection 6 to db: 'kolide' user: 'kolide' host: '<IP_ADDRESS>' (Got an error reading communication packets)
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-11T23:42:18.230411Z 7 [Note] Aborted connection 7 to db: 'kolide' user: 'kolide' host: '<IP_ADDRESS>' (Got an error reading communication packets)
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-11T23:46:39.149387Z 9 [Note] Aborted connection 9 to db: 'kolide' user: 'kolide' host: '<IP_ADDRESS>' (Got an error reading communication packets)
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-11T23:46:39.163900Z 10 [Note] Aborted connection 10 to db: 'kolide' user: 'kolide' host: '<IP_ADDRESS>' (Got an error reading communication packets)
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-11T23:51:31.893755Z 12 [Note] Aborted connection 12 to db: 'kolide' user: 'kolide' host: '<IP_ADDRESS>' (Got an error reading communication packets)
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-11T23:51:31.909620Z 13 [Note] Aborted connection 13 to db: 'kolide' user: 'kolide' host: '<IP_ADDRESS>' (Got an error reading communication packets)
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-12T00:06:23.001300Z 0 [Note] InnoDB: page_cleaner: 1000ms intended loop took 379089ms. The settings might not be optimal. (flushed=0 and evicted=0, during the time.)
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-12T16:10:06.001566Z 0 [Note] InnoDB: page_cleaner: 1000ms intended loop took 55369776ms. The settings might not be optimal. (flushed=0 and evicted=0, during the time.)
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-12T16:14:26.160482Z 0 [Note] Giving 0 client threads a chance to die gracefully
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-12T16:14:26.160518Z 0 [Note] Shutting down slave threads
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-12T16:14:26.160527Z 0 [Note] Forcefully disconnecting 0 remaining clients
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-12T16:14:26.160550Z 0 [Note] Event Scheduler: Purging the queue. 0 events
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-12T16:14:26.160665Z 0 [Note] Binlog end
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-12T16:14:26.168614Z 0 [Note] Shutting down plugin 'ngram'
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-12T16:14:26.168647Z 0 [Note] Shutting down plugin 'BLACKHOLE'
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-12T16:14:26.168653Z 0 [Note] Shutting down plugin 'partition'
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-12T16:14:26.168658Z 0 [Note] Shutting down plugin 'ARCHIVE'
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mailhog_1           | 2017/07/12 16:51:00 Using in-memory storage
mailhog_1           | 2017/07/12 16:51:00 [SMTP] Binding to address: <IP_ADDRESS>:1025
mailhog_1           | 2017/07/12 16:51:00 Serving under http://<IP_ADDRESS>:8025/
mailhog_1           | [HTTP] Binding to address: <IP_ADDRESS>:8025
mailhog_1           | Creating API v1 with WebPath:
mailhog_1           | Creating API v2 with WebPath:
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mailhog_1           | [APIv1] KEEPALIVE /api/v1/events
mysql_1             | 2017-07-12T16:14:26.168662Z 0 [Note] Shutting down plugin 'INNODB_SYS_VIRTUAL'
mysql_1             | 2017-07-12T16:14:26.168667Z 0 [Note] Shutting down plugin 'INNODB_SYS_DATAFILES'
mysql_1             | 2017-07-12T16:14:26.168671Z 0 [Note] Shutting down plugin 'INNODB_SYS_TABLESPACES'
mysql_1             | 2017-07-12T16:14:26.168676Z 0 [Note] Shutting down plugin 'INNODB_SYS_FOREIGN_COLS'
mysql_1             | 2017-07-12T16:14:26.168683Z 0 [Note] Shutting down plugin 'INNODB_SYS_FOREIGN'
mysql_1             | 2017-07-12T16:14:26.168698Z 0 [Note] Shutting down plugin 'INNODB_SYS_FIELDS'
mysql_1             | 2017-07-12T16:14:26.168703Z 0 [Note] Shutting down plugin 'INNODB_SYS_COLUMNS'
mysql_1             | 2017-07-12T16:14:26.168738Z 0 [Note] Shutting down plugin 'INNODB_SYS_INDEXES'
mysql_1             | 2017-07-12T16:14:26.168755Z 0 [Note] Shutting down plugin 'INNODB_SYS_TABLESTATS'
mysql_1             | 2017-07-12T16:14:26.168763Z 0 [Note] Shutting down plugin 'INNODB_SYS_TABLES'
mysql_1             | 2017-07-12T16:14:26.168769Z 0 [Note] Shutting down plugin 'INNODB_FT_INDEX_TABLE'
mysql_1             | 2017-07-12T16:14:26.168775Z 0 [Note] Shutting down plugin 'INNODB_FT_INDEX_CACHE'
mysql_1             | 2017-07-12T16:14:26.168781Z 0 [Note] Shutting down plugin 'INNODB_FT_CONFIG'
mysql_1             | 2017-07-12T16:14:26.168787Z 0 [Note] Shutting down plugin 'INNODB_FT_BEING_DELETED'
mysql_1             | 2017-07-12T16:14:26.168804Z 0 [Note] Shutting down plugin 'INNODB_FT_DELETED'
mysql_1             | 2017-07-12T16:14:26.168810Z 0 [Note] Shutting down plugin 'INNODB_FT_DEFAULT_STOPWORD'
mysql_1             | 2017-07-12T16:14:26.168814Z 0 [Note] Shutting down plugin 'INNODB_METRICS'
mysql_1             | 2017-07-12T16:14:26.168818Z 0 [Note] Shutting down plugin 'INNODB_TEMP_TABLE_INFO'
mysql_1             | 2017-07-12T16:14:26.168822Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_POOL_STATS'
mysql_1             | 2017-07-12T16:14:26.168828Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_PAGE_LRU'
mysql_1             | 2017-07-12T16:14:26.168837Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_PAGE'
mysql_1             | 2017-07-12T16:14:26.168859Z 0 [Note] Shutting down plugin 'INNODB_CMP_PER_INDEX_RESET'
mysql_1             | 2017-07-12T16:14:26.168866Z 0 [Note] Shutting down plugin 'INNODB_CMP_PER_INDEX'
mysql_1             | 2017-07-12T16:14:26.168872Z 0 [Note] Shutting down plugin 'INNODB_CMPMEM_RESET'
mysql_1             | 2017-07-12T16:14:26.168877Z 0 [Note] Shutting down plugin 'INNODB_CMPMEM'
mysql_1             | 2017-07-12T16:14:26.168895Z 0 [Note] Shutting down plugin 'INNODB_CMP_RESET'
mysql_1             | 2017-07-12T16:14:26.168905Z 0 [Note] Shutting down plugin 'INNODB_CMP'
mysql_1             | 2017-07-12T16:14:26.168909Z 0 [Note] Shutting down plugin 'INNODB_LOCK_WAITS'
mysql_1             | 2017-07-12T16:14:26.168912Z 0 [Note] Shutting down plugin 'INNODB_LOCKS'
mysql_1             | 2017-07-12T16:14:26.168916Z 0 [Note] Shutting down plugin 'INNODB_TRX'
mysql_1             | 2017-07-12T16:14:26.168923Z 0 [Note] Shutting down plugin 'InnoDB'
mysql_1             | 2017-07-12T16:14:26.169049Z 0 [Note] InnoDB: FTS optimize thread exiting.
mysql_1             | 2017-07-12T16:14:26.169352Z 0 [Note] InnoDB: Starting shutdown...
mysql_1             | 2017-07-12T16:14:26.275256Z 0 [Note] InnoDB: Dumping buffer pool(s) to /tmp/mysqldata/ib_buffer_pool
mysql_1             | 2017-07-12T16:14:26.280919Z 0 [Note] InnoDB: Buffer pool(s) dump completed at 170712 16:14:26
mysql_1             | 2017-07-12T16:14:27.186862Z 0 [Note] InnoDB: Shutdown completed; log sequence number 13898572
mysql_1             | 2017-07-12T16:14:27.188039Z 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
mysql_1             | 2017-07-12T16:14:27.188065Z 0 [Note] Shutting down plugin 'MRG_MYISAM'
mysql_1             | 2017-07-12T16:14:27.188076Z 0 [Note] Shutting down plugin 'MyISAM'
mysql_1             | 2017-07-12T16:14:27.188090Z 0 [Note] Shutting down plugin 'CSV'
mysql_1             | 2017-07-12T16:14:27.188102Z 0 [Note] Shutting down plugin 'MEMORY'
mysql_1             | 2017-07-12T16:14:27.188107Z 0 [Note] Shutting down plugin 'PERFORMANCE_SCHEMA'
mysql_1             | 2017-07-12T16:14:27.188138Z 0 [Note] Shutting down plugin 'sha256_password'
mysql_1             | 2017-07-12T16:14:27.188149Z 0 [Note] Shutting down plugin 'mysql_native_password'
mysql_1             | 2017-07-12T16:14:27.188268Z 0 [Note] Shutting down plugin 'binlog'
mysql_1             | 2017-07-12T16:14:27.192967Z 0 [Note] mysqld: Shutdown complete
mysql_1             |
mysql_1             | 2017-07-12T16:51:01.724779Z 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details).
mysql_1             | 2017-07-12T16:51:01.733397Z 0 [Note] mysqld (mysqld 5.7.18) starting as process 1 ...
mysql_1             | 2017-07-12T16:51:01.737799Z 0 [Warning] Setting lower_case_table_names=2 because file system for /tmp/mysqldata/ is case insensitive
mysql_1             | 2017-07-12T16:51:01.742058Z 0 [Note] InnoDB: PUNCH HOLE support available
mysql_1             | 2017-07-12T16:51:01.742115Z 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
mysql_1             | 2017-07-12T16:51:01.742132Z 0 [Note] InnoDB: Uses event mutexes
mysql_1             | 2017-07-12T16:51:01.742143Z 0 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier
mysql_1             | 2017-07-12T16:51:01.742154Z 0 [Note] InnoDB: Compressed tables use zlib 1.2.3
mysql_1             | 2017-07-12T16:51:01.742163Z 0 [Note] InnoDB: Using Linux native AIO
mysql_1             | 2017-07-12T16:51:01.743804Z 0 [Note] InnoDB: Number of pools: 1
mysql_1             | 2017-07-12T16:51:01.747385Z 0 [Note] InnoDB: Using CPU crc32 instructions
mysql_1             | 2017-07-12T16:51:01.754667Z 0 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M
mysql_1             | 2017-07-12T16:51:01.768516Z 0 [Note] InnoDB: Completed initialization of buffer pool
mysql_1             | 2017-07-12T16:51:01.775800Z 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
mysql_1             | 2017-07-12T16:51:01.805674Z 0 [Note] InnoDB: Highest supported file format is Barracuda.
mysql_1             | 2017-07-12T16:51:01.987417Z 0 [Note] InnoDB: Creating shared tablespace for temporary tables
mysql_1             | 2017-07-12T16:51:01.988310Z 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
mysql_1             | 2017-07-12T16:51:02.043879Z 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
mysql_1             | 2017-07-12T16:51:02.062290Z 0 [Note] InnoDB: 96 redo rollback segment(s) found. 96 redo rollback segment(s) are active.
mysql_1             | 2017-07-12T16:51:02.062389Z 0 [Note] InnoDB: 32 non-redo rollback segment(s) are active.
mysql_1             | 2017-07-12T16:51:02.062942Z 0 [Note] InnoDB: Waiting for purge to start
mysql_1             | 2017-07-12T16:51:02.116342Z 0 [Note] InnoDB: 5.7.18 started; log sequence number 13898572
mysql_1             | 2017-07-12T16:51:02.116908Z 0 [Note] Plugin 'FEDERATED' is disabled.
mysql_1             | 2017-07-12T16:51:02.120215Z 0 [Note] InnoDB: Loading buffer pool(s) from /tmp/mysqldata/ib_buffer_pool
mysql_1             | 2017-07-12T16:51:02.136652Z 0 [Warning] World-writable config file './auto.cnf' is ignored.
mysql_1             | 2017-07-12T16:51:02.137402Z 0 [Warning] World-writable config file './auto.cnf' has been removed.
mysql_1             |
mysql_1             | 2017-07-12T16:51:02.137715Z 0 [Note] Salting uuid generator variables, current_pid: 1, server_start_time:<PHONE_NUMBER>, bytes_sent: 0,
mysql_1             | 2017-07-12T16:51:02.138435Z 0 [Note] Generated uuid: '49b73e69-6722-11e7-a7ef-0242ac120004', server_start_time:<PHONE_NUMBER>88918, bytes_sent: 54502688
mysql_1             | 2017-07-12T16:51:02.138537Z 0 [Warning] No existing UUID has been found, so we assume that this is the first time that this server has been started. Generating a new UUID: 49b73e69-6722-11e7-a7ef-0242ac120004.
mysql_1             | 2017-07-12T16:51:02.153075Z 0 [Note] Found ca.pem, server-cert.pem and server-key.pem in data directory. Trying to enable SSL support using them.
mysql_1             | 2017-07-12T16:51:02.159143Z 0 [Warning] CA certificate ca.pem is self signed.
mysql_1             | 2017-07-12T16:51:02.163834Z 0 [Note] Server hostname (bind-address): '*'; port: 3306
mysql_1             | 2017-07-12T16:51:02.163961Z 0 [Note] IPv6 is available.
mysql_1             | 2017-07-12T16:51:02.163985Z 0 [Note]   - '::' resolves to '::';
mysql_1             | 2017-07-12T16:51:02.164014Z 0 [Note] Server socket created on IP: '::'.
mysql_1             | 2017-07-12T16:51:02.176643Z 0 [Note] InnoDB: Buffer pool(s) load completed at 170712 16:51:02
mysql_1             | 2017-07-12T16:51:02.190262Z 0 [Warning] 'user' entry 'root@localhost' ignored in --skip-name-resolve mode.
mysql_1             | 2017-07-12T16:51:02.190359Z 0 [Warning] 'user' entry 'mysql.sys@localhost' ignored in --skip-name-resolve mode.
mysql_1             | 2017-07-12T16:51:02.190800Z 0 [Warning] 'db' entry 'sys mysql.sys@localhost' ignored in --skip-name-resolve mode.
mysql_1             | 2017-07-12T16:51:02.191213Z 0 [Warning] 'proxies_priv' entry '@ root@localhost' ignored in --skip-name-resolve mode.
mysql_1             | 2017-07-12T16:51:02.220076Z 0 [Warning] 'tables_priv' entry 'sys_config mysql.sys@localhost' ignored in --skip-name-resolve mode.
mysql_1             | 2017-07-12T16:51:02.376855Z 0 [Note] Event Scheduler: Loaded 0 events
mysql_1             | 2017-07-12T16:51:02.377263Z 0 [Note] mysqld: ready for connections.
mysql_1             | Version: '5.7.18'  socket: '/var/run/mysqld/mysqld.sock'  port: 3306  MySQL Community Server (GPL)
mysql_1             | 2017-07-12T16:51:02.377313Z 0 [Note] Executing 'SELECT * FROM INFORMATION_SCHEMA.TABLES;' to get a list of tables using the deprecated partition engine. You may use the startup option '--disable-partition-engine-check' to skip this check.
mysql_1             | 2017-07-12T16:51:02.377338Z 0 [Note] Beginning of list of non-natively partitioned tables
mysql_1             | 2017-07-12T16:51:02.811119Z 0 [Note] End of list of non-natively partitioned tables
mysql_1             | 2017-07-12T16:51:02.841580Z 3 [Note] Aborted connection 3 to db: 'kolide' user: 'kolide' host: '<IP_ADDRESS>' (Got an error reading communication packets)
mysql_1             | 2017-07-12T16:51:02.865831Z 4 [Note] Aborted connection 4 to db: 'kolide' user: 'kolide' host: '<IP_ADDRESS>' (Got an error reading communication packets)


Bug: Cannot convert BigInt value to a number.

This is a bug report
Problem
In our frontend platform at Huddle01 we are facing this bug on running yarn build.

On checking various packages we found that when we commented the usage of waku functions and deleted the waku package then this error wasn't showing up.
Here is all the code related to waku functionality that we are using.
wakuUtils.js
import protons from "protons";
const proto = protons(`
    message SimpleChatMessage {
      uint64 timestamp = 1;
      string text = 2;
      string sender = 3;
    }
  `);

const selectFleetEnv = () => {
  // Works with react-scripts
  if (process?.env?.NODE_ENV === "development") {
    return ["fleets", "wakuv2.test", "waku-websocket"];
  } else {
    return ["fleets", "wakuv2.prod", "waku-websocket"];
  }
};

const processMsgs = (msg) => {
  if (!msg.payload) return;

  const { timestamp, text, sender } = proto.SimpleChatMessage.decode(
    msg.payload
  );

  const time = new Date(timestamp).toLocaleTimeString();

  const utf8Text = Buffer.from(text).toString("utf-8");

  return { timestamp: time, text: utf8Text, sender };
};

export { proto, selectFleetEnv, processMsgs };

Parts of code where we used waku in our live stream chats:
// creating waku object
  useEffect(() => {
    if (!isLivestreamChat) return;
    if (!!waku) return;
    if (wakuStatus !== "None") return;

    setWakuStatus("Starting");

    // Create Waku
    Waku.create({
      libp2p: {
        config: {
          pubsub: {
            enabled: true,
            emitSelf: true,
          },
        },
      },
      bootstrap: getBootstrapNodes.bind({}, selectFleetEnv()),
    }).then((waku) => {
      setWaku(waku);
      setWakuStatus("Started");
      waku.waitForConnectedPeer().then(() => {
        setWakuStatus("Ready");
        console.log(wakuStatus);
      });
    });
    console.log(wakuStatus);
  }, [waku, wakuStatus]);

  const processWakuHistory = (retrievedMessages) => {
    const messages = retrievedMessages
      .map((msg) => processMsgs(msg))
      .filter(Boolean);

    setWakuMsgs((waku) => {
      return messages.concat(waku);
    });

    if (wakuMsgs.length >= 20) return true;
  };

  // fetching history of chats from waku-store
  useEffect(() => {
    if (wakuStatus !== "Ready") return;

    waku.store
      .queryHistory([ContentTopic], { callback: processWakuHistory })
      .catch((e) => {
        console.log("Failed to retrieve messages", e);
      });
    dispatch(setWakuStoreRetrieved(true));
  }, [waku, wakuStatus]);

  // sending message using waku-relay
  const handleWakuMessage = async (msgInput) => {
    if (!isLivestreamChat) return;
    if (wakuStatus !== "Ready") return;
    if (!msgInput) return;

    const text = msgInput.trim();

    const payload = proto.SimpleChatMessage.encode({
      timestamp: new Date(),
      text: text,
      sender:
        localStorage.getItem("livestream_viewer") ||
        window.ethereum.selectedAddress,
    });

    WakuMessage.fromBytes(payload, ContentTopic).then((wakuMessage) =>
      waku.relay.send(wakuMessage)
    );
    console.log(payload);
  };

  // observer for receiving messages
  const processIncomingMessage = useCallback((wakuMessage) => {
    const message = processMsgs(wakuMessage);
    setWakuMsgs((messages) => {
      return messages.concat(message);
    });
  }, []);

  // receive message using waku-relay
  useEffect(() => {
    if (!waku) return;

    waku.relay.addObserver(processIncomingMessage, [ContentTopic]);

    return function cleanUp() {
      waku.relay.deleteObserver(processIncomingMessage, [ContentTopic]);
    };
  }, [waku, wakuStatus, processIncomingMessage]);

Notes

js-waku version: 0.14.2

Are you able to create a minimum, reproducible example?
The error show seem to be for react prod build, does the error happen for a dev build too? If so, what is the error? A dev build should help pinpoint the exact line that is an issue.

Yes we can reproduce it.
No it only breaks on prod, when we try to serve the prod build.

Great, please publish the minimal, reproducible example so I can further investigate.

FYI, this is what i am referring to https://stackoverflow.com/help/minimal-reproducible-example

Bug also occurs with chat demo: https://status-im.github.io/js-waku/

Leads:

https://github.com/seanjameshan/starknet.js/issues/37#issuecomment-955797303
https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/BigInt#browser_compatibility
https://github.com/blockstack/stacks.js/issues/1096#issuecomment-946350299

I was able to reproduce in the web-chat example by setting the browsers.list.development property of package.json to the same value than browserslist.production:
    "development": [
      ">0.2%",
      "not dead",
      "not op_mini all"
    ]

and deleting the cache: rm -rf node_modules/.cache

I was able to solve the issue in development with:
    "development": [
      ">0.2%",
      "not ie <= 99",
      "not android <= 4.4.4",
      "not dead",
      "not op_mini all"
    ]

Will apply to prod and see if it works in GH pages.

Here is the upstream issue: https://github.com/paulmillr/noble-ed25519/issues/23

▶ npm ls @noble/ed25519
<EMAIL_ADDRESS>/home/froyer/src/status-im/js-waku
├─┬<EMAIL_ADDRESS>│ └─┬<EMAIL_ADDRESS>│   └─┬<EMAIL_ADDRESS>│     └──<EMAIL_ADDRESS>└─┬<EMAIL_ADDRESS>  └─┬<EMAIL_ADDRESS>    └─┬<EMAIL_ADDRESS>      └──<EMAIL_ADDRESS>deduped

Unfortunately, setting the following in the package.json of web-chat did not fix it in GH pages. Not sure if it's an issue with some caching:
"browserslist": {
   "development": [
      ">0.2%",
      "not ie <= 99",
      "not android <= 4.4.4",
      "not dead",
      "not op_mini all"
    ]
}

@ritvij14 can you try this solution with your project and let me know if it helps?

@D4nte yes ok let me try this on our system today, I will get back to you on this soon.

@D4nte yes ok let me try this on our system today, I will get back to you on this soon.

Great. Be sure to delete your node_modules to be sure it does not use the cache.

Unfortunately, setting the following in the package.json of web-chat did not fix it in GH pages. Not sure if it's an issue with some caching, I need to investigate further.
"browserslist": {
"development": [
">0.2%",
"not ie <= 99",
"not android <= 4.4.4",
"not dead",
"not op_mini all"
]
}
@ritvij14 can you try this solution with your project and let me know if it helps?

@D4nte I added this thing like this:
"production": [
      ">0.2%",
      "not ie <= 99",
      "not android <= 4.4.4",
      "not dead",
      "not op_mini all"
    ],

and on doing yarn build && npx serve -s build, it ran without problems. But I am still kind of confused as to how did doing this help.

@ritvij14 please have a look at at what browserslist does. My understanding is that it set the browser target for which the code is transpiled to.
">0.2%" for example means: transpile code from browser that has a market share of more than 0.2% (I think).
This included all browsers that do not support BigInt such as ie 98 and below and android 4.4.3 and below.
Which mean the transpiled code did not contain definition of BigInt. Hence the error.
By restricting the browser target to more recent browser, it allowed the use of BigInt.
Keeping this issue open to track documentation effort.

Documented in the ReactJS doc: https://github.com/vacp2p/docs.dappconnect.dev/pull/19
Also this issue can serve as documentation.

So what's the fix? I see a scattering of messages with nothing definitive. I get the issue with production react builds.

So what's the fix? I see a scattering of messages with nothing definitive. I get the issue with production react builds.

Unfortunately, setting the following in the package.json of web-chat did not fix it in GH pages. Not sure if it's an issue with some caching, I need to investigate further.
"browserslist": {
"development": [
">0.2%",
"not ie <= 99",
"not android <= 4.4.4",
"not dead",
"not op_mini all"
]
}
@ritvij14 can you try this solution with your project and let me know if it helps?

@D4nte I added this thing like this:
"production": [
      ">0.2%",
      "not ie <= 99",
      "not android <= 4.4.4",
      "not dead",
      "not op_mini all"
    ],

and on doing yarn build && npx serve -s build, it ran without problems. But I am still kind of confused as to how did doing this help.

@matbee-eth this is what you need to do. Add this in package.json

@D4nte
your fix just saved my day,thank

I wasted 2 days on trying to fix it, tried everything from package update to cache clean. Nothing worked. Then saw this and implemented it and now it works. Thank you so much for saving my day!
Thanks a ton!

Hi, really sorry to hear you wasted time on this issue. Are you using @waku/core or js-waku npm packages? js-waku is now deprecated.


Switch to api.openstreetmap.org API host

Use api.openstreetmap.org/api/ -and HTTPS- instead of www.openstreetmap.org/api/*.
(Is: https://github.com/openstreetmap/operations/issues/951)

Thanks! Will oauth2 work? I see some comments there which I didn't understand...

I avoided changing the ones in AuthClient.cs, NonAuthClient.cs and anything else in other files.
I think NonAuthClient.cs is complementary to ClientsFactory.cs in that it does API calls without authentication.
In that case it can also be changed to the api. URL. Let me know if this is correct.

As for the other two, note api.openstreetmap.org API url currently can not do OAuth 2 handshake. See https://github.com/openstreetmap/operations/issues/951#issuecomment-1748717154
You can split the www. base URL and api. API url. See https://github.com/osmlab/osm-auth/pull/123#issuecomment-1777330094
See also https://github.com/osmlab/osm-auth/pull/123#issuecomment-1791057278 for another solution.

Does the www end point still works?
If this is the case, I prefer to keep the current address until everything is solved and then migrate... Makes more sense to me, but I might be wrong.
@blackboxlogic what do you think?

Does the www end point still works?

There have been no changes to the functionality, so yes.

@HarelM @danieldegroot2
Pro: longer timeouts
Con: Oauth2 breaks with work-arounds
Am I understanding that right?
Feel free to change all the documentation/comments, including in AuthClient.cs and NonAuthClient.cs to nudge users in the right direction. But updating PRODUCTION_URL is a breaking change I wouldn't surprising on users.
Maybe we should deprecate PRODUCTION_URL with a lengthy comment mentioning timeouts, Oath2, and the updated URL. Or, if there are plans to resolves the Oauth2 issue (are there?), then let's just wait for that to be resolved.

Pro: longer timeouts

Yes, though they are subject to change.

Con: Oauth2 breaks with work-arounds

Yes, without workarounds it would break, so to be safe you should use a workaround.

plans to resolve the Oauth2 issue

No timeline has been announced, so no.

then let's just wait for that to be resolved.

I will close this PR in favour of #9 .


PLAT-4525 Add GitHub actions validations for terraform

Adding basic visible terraform validations on push:

id: terraform_fmt
id: terraform_tflint
id: terraform_validate
id: checkov
id: terraform_tfsec
id: terrascan

Reopening from dominodatalab, as we dont have circle  support for forks


Prevent ForeignKeyConstraintViolation during migration

Reproduced reported issue by enhancing the unit test.
Fixed ForeignKeyConstraintViolation by re-ordering migration statements.

Fixes issue #3803.

[x] I have reviewed the contributing guide

[x] I have viewed, signed, and submitted the Contributor License Agreement

[x] I have made this pull request to the main branch

[x] I have run all the unit tests using bundle exec rake

[ ] I have run CF Acceptance Tests

Looks good, thanks for the fix!


JIT reorder kernel for SVE 256 and SVE 128

Hi,
I have some questions regarding the JIT - reorder AArch64 kernel  in the main oneDNN repository that I am investigating for SVE 256 and SVE 128 .
For SVE 256, I was able run the JIT reorder kernel with a small change to enable it (mayiuse(sve_256)) on the a64fx and I was able to run the reorder tests from benchdnn with tests:24533 passed:14617 skipped:9916 which is the same as SVE 512. I also observed performance benefits over the simple reorder kernel.
However, with SVE-128, I have noted some benchdnn failures with looks to be related to when input type != output type and for some blocked data formats (attached logs)
benchdnn-failed-128.log. I got tests:24533 passed:3830 skipped:9916 mistrusted:0 unimplemented:0 failed:10787. Are these known non-supported cases for SVE 128?

Hi, @cfRod
Thank you for the investigation and comments. I'll check your log. Please wait a week, since this week and next week are major holidays in Japan. Sorry for inconvenience.  The latest branch is fj_rls-v2.1, so it would be nice if you could evaluate fj_rls-v2.1.
BTW, how do you use the A64FX as SVE 256 and 128? Did you use the following command for SVE 256?
echo 32 > /proc/sys/abi/sve_default_vector_length

Thanks.

Hi @kawakami-k,
Thanks for your response, I tested this on master in oneDNN's repository (https://github.com/oneapi-src/oneDNN).  I was also testing v2.2 branch. I made two changes: I used a script that can set "prctl(PR_SVE_SET_VL, vl") to a particular vector length and I made a change here using (mayiuse(x)) : https://github.com/oneapi-src/oneDNN/blob/ca6ca816faa92025a231f3ff1d110b73c5a460c1/src/cpu/aarch64/jit_uni_reorder.cpp#L124 (to test SVE 256 and 128). I can try fj_rls-v2.1 branch next week.

Hi @cfRod
process_unroll_tr8x8 requires more than or equal to 256 bits as the SVE register width, because it transposes an 8x8 matrix of 32-bit data on the SVE registers. In other cases, it seems that the condition can be relaxed to 128 bits. I'll make a patch and send a pull request to Intel in a few days!
Thanks.


Change the source data

http://download.geonames.org/export/dump/ looks more complete

fixed in https://github.com/vincentmorneau/oracle-countries-states-cities/commit/4ef3f9cfcf06d4cd27733da1a66e9ae9dbdc8baf


Creating Webdataset from tar files

I am looking for some help/advice to shard a video dataset into tar files and use it with webdataset. In a folder I have a number of  XX.mp4 (video), XX.info.json (script and action-labels) and XX.mp4.json (video metadata ). To use webdataset().decode() if I make a tar file out of each sample (i.e tar  000.tar -cf XX.mp4  XX.info.json  XX.mp4.json) then pass the files such as ds = wds.Dataset("/Users/../../data/tardb/{000..010}.tar").decode() then I can see the right keys in
for sample in ds:
    for key, value in sample.items():
        print(key, repr(value)[:50])
    break

output	: dict_keys(['__key__', 'mp4.json', 'info.json', 'mp4'])

If I have multiple folders that in each folder there is a number of samples that share same base name as above XX.mp4, XX.info.json and XX.mp4.json, and then tar each folder and name it sequentially such as
tar -cf "db-{file_index}.tar" "db-{file_index}"
Then ds = wds.Dataset("/Users/../../data/db-{0..10}.tar").decode(), the only key I see in the sample is only info.json
dict_keys(['__key__', 'info.json'])

I was wondering what I am missing in this process/ what is a better way of making a webdataset out of such a data settings. Thanks.

When creating WebDataset data with tar, you need to use the --sort=name option:
tar --sort=name -cf "db-{file_index}.tar" "db-{file_index}"

without it, files with the same basename may not end up adjacent to each other in the tar file. It is a good idea to verify file order in the tar file with "tar tf db-00000.tar" and make sure that files are grouped sequentially by file name.
You can also control the order of files added to the archive using a pipeline like:
find . -name '*.json' -o -name '*.mp4' | sort | tar -cf archive.tar -T -

And even more general way of creating these archives is using the tarp create command, which lets you specify the exact order and composition of the resulting tar file using a two column text file, listing the archive file name in the first column and the file system file name in the second column.
NOTE: We should probably add a small command to check the validity of a WebDataset .tar archive.

@tmbdev Thank you, using the sort option the issue is resolved.

There is now a little command line program you can use for verifying that the .tar files are correct, as well as measure I/O speeds:
    $ python3 webdataset.bench shard-000000.tar


'tdb_cursor_next' magic

Hey,
I'm currently updating the TrailDB rust binding and noticed a strange behaviour where the binding generator isn't finding tdb_cursor_next.
Then I realized it's exported in a non-standard way:
#pragma GCC diagnostic push
#pragma GCC diagnostic ignored "-Wmissing-prototypes"
__attribute__((visibility("default"))) inline const tdb_event *tdb_cursor_next(tdb_cursor *cursor)
{
    if (cursor->num_events_left > 0 || _tdb_cursor_next_batch(cursor)){
        const tdb_event *e = (const tdb_event*)cursor->next_event;
        cursor->next_event += sizeof(tdb_event) +
                              e->num_items * sizeof(tdb_item);
        --cursor->num_events_left;
        return e;
    }else
        return NULL;
}
#pragma GCC diagnostic pop

This is a huge problem for Clang because the GCC attributes effectively make the method invisible for the outside world. In the binding, I manually removed the attributes in order to have it compile using Clang.
-- Kenan
🚀

IMO there should be an equivalent function in traildb.h that is otherwise exactly the same as tdb_cursor_next but is friendly to bindings. It's not just Clang world but also different language bindings would have slightly easier time binding to C APIs when they can't directly bind to inlined C functions. @tuulos


Xz24 l 79 instructor view part2 (with main already merged into this branch)

Checked again and all changes were successful