Calling endFrameSubscription() when there are more frames buffered crashes Electron

While trying to fix screenshotting inconsistencies in Nightmare.js, I ran into a pretty frustrating crasher.
Subscribing to a browser window's frames with webContent.beginFrameSubscription(), then unsubscribing when more frames are ready to be sent to your subscriber causes electron to crash when sending subsequent frames (which it shouldn't do because you've unsubscribed). Here's a reduced example:
// setup
const electron = require('electron');
var mainWindow = null;
electron.app.on('ready', function() {
  mainWindow = new electron.BrowserWindow({width: 200, height: 200});
  mainWindow.loadURL('about:blank');
  mainWindow.webContents.on('did-finish-load', crashMyWindow)
});

// the crash-prone code
function crashMyWindow() {
  // make a change that will cause rendering
  mainWindow.webContents.executeJavaScript("document.body.style.background = '#ddf0ff';");
  // ..and wait a moment before making another so that they are separate frames
  setTimeout(function() {
    // commenting out the following line will prevent the crash
    mainWindow.webContents.executeJavaScript("document.body.appendChild(document.createTextNode('x'));");

    // subscribe to the rendered frames
    mainWindow.webContents.beginFrameSubscription(function(buffer) {
      // try unsubscribing; this will crash :(
      mainWindow.webContents.endFrameSubscription();
    });
  }, 10);
}

It's not the actual endFrameSubscription() call that actually crashes. I'm pretty sure what's happening is that the frame subscriber callback is still trying to be called for subsequent frames that have been queued up, but the pointer to that callback is no longer valid. I don't know nearly enough about the C++ parts of electron or Chrome to understand where to really examine the issue, though.
As near as I can tell, there's no way to determine whether more frames are waiting to be sent and therefore whether it's safe to call endFrameSubscription(). Is there something I'm missing here? It seems like the only alternative is to keep the frame subscription for the lifetime of the window, which seems like it could be pretty high overhead.
I'm running…
Electron-prebuilt 0.36.7
Mac OS X 10.11.3 on a 13" Retina MacBook Pro.
Processor: 3.1 GHz Intel Core i7
Graphics: Intel Iris Graphics 6100 1536 MB
The top of the stack on the crashed thread:
Exception Type:        EXC_BAD_ACCESS (SIGSEGV)
Exception Codes:       EXC_I386_GPFLT

Thread 0 Crashed:: CrBrowserMain  Dispatch queue: com.apple.main-thread
0   libnode.dylib                 	0x000000010e43d339 v8::Locker::Initialize(v8::Isolate*) + 57
1   com.github.electron.framework 	0x0000000109b12c8f atom::api::FrameSubscriber::OnFrameDelivered(scoped_refptr<media::VideoFrame>, base::TimeTicks, bool) + 47
2   com.github.electron.framework 	0x0000000109b13585 base::internal::RunnableAdapter<void (atom::api::FrameSubscriber::*)(scoped_refptr<media::VideoFrame>, base::TimeTicks, bool)>::Run(atom::api::FrameSubscriber*, scoped_refptr<media::VideoFrame> const&, base::TimeTicks const&, bool const&) + 101
3   com.github.electron.framework 	0x0000000109b134a3 base::internal::InvokeHelper<false, void, base::internal::RunnableAdapter<void (atom::api::FrameSubscriber::*)(scoped_refptr<media::VideoFrame>, base::TimeTicks, bool)>, base::internal::TypeList<atom::api::FrameSubscriber*, media::VideoFrame*, base::TimeTicks const&, bool const&> >::MakeItSo(base::internal::RunnableAdapter<void (atom::api::FrameSubscriber::*)(scoped_refptr<media::VideoFrame>, base::TimeTicks, bool)>, atom::api::FrameSubscriber*, media::VideoFrame*, base::TimeTicks const&, bool const&) + 115
4   com.github.electron.framework 	0x0000000109b13421 base::internal::Invoker<base::IndexSequence<0ul, 1ul>, base::internal::BindState<base::internal::RunnableAdapter<void (atom::api::FrameSubscriber::*)(scoped_refptr<media::VideoFrame>, base::TimeTicks, bool)>, void (atom::api::FrameSubscriber*, scoped_refptr<media::VideoFrame>, base::TimeTicks, bool), base::internal::TypeList<base::internal::UnretainedWrapper<atom::api::FrameSubscriber>, scoped_refptr<media::VideoFrame> > >, base::internal::TypeList<base::internal::UnwrapTraits<base::internal::UnretainedWrapper<atom::api::FrameSubscriber> >, base::internal::UnwrapTraits<scoped_refptr<media::VideoFrame> > >, base::internal::InvokeHelper<false, void, base::internal::RunnableAdapter<void (atom::api::FrameSubscriber::*)(scoped_refptr<media::VideoFrame>, base::TimeTicks, bool)>, base::internal::TypeList<atom::api::FrameSubscriber*, media::VideoFrame*, base::TimeTicks const&, bool const&> >, void (base::TimeTicks const&, bool const&)>::Run(base::internal::BindStateBase*, base::TimeTicks const&, bool const&) + 129
5   com.github.electron.framework 	0x000000010a52e661 0x109a95000 + 11114081

I've tried you example with a 36.4 prebuilt and a 64bit debug build with the latest commits, and I can't reproduce the crash on Windows. Might be something osx related, which sadly I can't test for you :C

Well, that narrows down the problem a bit, I guess :\

I might ask a friend who has a Mac tomorrow if it's not resolved by then :)

@brenca thanks!
I also tried building the latest Electron from master and am still seeing the crash there. It looks like the actual call to FrameSubscriber::OnFrameDelivered (where the crash is) comes from somewhere in Chromium code, which I don't have debugging symbols for, so it's tough to tell what's going on.
As a side note, I totally believe that this doesn't happen on Windows, since it appears that RenderWidgetHostView and friends are implemented in totally different ways on each platform. But just in case the problem was actually that my "wait ~10ms before making another change approach" wasn't the right timing on your machine, using animations struck me as a more reliable way to trigger it:
function crashMyWindow() {
  mainWindow.webContents.executeJavaScript(`
    var style = document.createElement('style');
    style.setAttribute('type', 'text/css');
    style.innerHTML = '@keyframes pulser { 0% { opacity: 0; } 100% { opacity: 1; } } div {animation: pulser 1s infinite;animation-direction: alternate;}';
    document.body.appendChild(style);
    var div = document.createElement('div');
    div.innerHTML = 'hi';
    document.body.appendChild(div);`);

  // let the animation start going...
  setTimeout(function() {

      // subscribe to the rendered frames
      mainWindow.webContents.beginFrameSubscription(function(buffer) {
        // unsubscribe, setting up the crash
        mainWindow.webContents.endFrameSubscription();
      });

  }, 100);
}

I had a similar idea yesterday, so after the original example didn't fail, I used a setInterval to add another "x" to the page, and that still didn't cause a crash. Just in case I tried the animation approach, that still didn't cause a crash on Windows. At least we really know that it's an osx problem :)

Ha, I guess we were definitely on the same page!

So this may be a really kludgy way to address the issue, but changing line 37 of atom/browser/api/frame_subscriber.cc to check whether the frame subscriber's isolate is the current one seems to solve the issue for me:
void FrameSubscriber::OnFrameDelivered(
    scoped_refptr<media::VideoFrame> frame, base::TimeTicks, bool result) {
  if (!result || v8::Isolate::GetCurrent() != isolate_)
    return;

  v8::Locker locker(isolate_);
  ...

It also only hits that condition once—after returning early there, calls to OnFrameDelivered() stop. I also noticed that, when the crash is about to happen, the EndFrameSubscription() call is coming in between associated calls to FrameSubscriber::ShouldCaptureFrame() and FrameSubscriber::OnFrameDelivered(). So it would seem that EndFrameSubscription() is effectively and safely stopping new uses of the frame subscriber, but any callbacks that have already been retrieved from the frame subscriber are still called.

Or we could always ask for the current isolate instead of using a saved one, if that works on mac (it seems to be okay on Windows), that would be a bit cleaner I guess.

So the problem is that when we call EndFrameSubscription(), the whole FrameSubscriber gets deleted from the Chromium side, but the base class of the FrameSubscriber, content::RenderWidgetHostViewFrameSubscriber only declares the ShouldCaptureFrame method, and we are actually using another member of FrameSubscriber as the DeliverFrameCallback - but copying takes time, and the callback is called some time after ShouldCaptureFrame is called. If we end the subscription between a ShouldCaptureFrame and the callback for it - which as far as I've seen happens all the time -, Chormium tries to call the callback that is a member of an object that's already deleted, and all the members - like isolate_ is actually just garbage.I cooked up a solution for this, we've tested it on both platforms and it seems to fix the issue.

Thanks! I pulled down the PR and built it; fixes the issue for me! More elegant than my kludgy solution, too. (I noted one other thought over on the PR itself.)

Fixed by #4451.


ORDER BY across multiple Shards/Partitions hangs indefinitely

I am running Crate version 0.54.5 on a single node.  When I setup a partitioned table with 1 shard per partition, 10 partitions, and 3,000,000 records distributed among the partitions, some queries using the ORDER BY statement hang indefinitely.  It does not matter which column I ORDER BY.
For example, I have a query that when I SELECT COUNT(*) on, it shows 430 records total, some records coming from each partition.  Here are some examples of queries I am having issues with:
SELECT * ... ORDER BY _id LIMIT 60;  // hangs indefinitely
SELECT * ... ORDER BY name LIMIT 60;  // hangs indefinitely
SELECT * ... ORDER BY _id LIMIT 10;  // works fine, returns in under a second

This behavior is not exhibited when I remove the PARTITIONED BY clause and recreate the table (using COPY FROM / COPY TO).  All of these queries work just fine when partitions are not involved.
All 10 of my partitions total about 3GB in RAM, and I have 8GB dedicated to the heap, and 14GB total on the machine.
Please let me know the logging settings that I need to use to collect logs for this problem.

---
Want to back this issue? **[Post a bounty on it!](https://www.bountysource.com/issues/30998912-order-by-across-multiple-shards-partitions-hangs-indefinitely?utm_campaign=plugin&utm_content=tracker%2F505659&utm_medium=issues&utm_source=github)** We accept bounties via [Bountysource](https://www.bountysource.com/?utm_campaign=plugin&utm_content=tracker%2F505659&utm_medium=issues&utm_source=github).

Just to make sure: These are simple queries without GROUP BY?
As a start I think the logs from io.crate.operation.collect: TRACE could be helpful.
Could you also share the create table statement? In case you can't:  Are you also using CLUSTERED BY in addition to PARTITIONED BY?
Thanks for reporting!

Correct, these are simple queries without GROUP BY.  The query looks something like this:
SELECT * FROM test WHERE name = 'joe' AND active = 'YES' ORDER BY _id LIMIT 60;

I tried with CLUSTERED INTO 5 SHARDS and CLUSTERED INTO 1 SHARDS and hit the problem both ways.  Here's the CREATE TABLE with the fields taken out:
 CREATE TABLE IF NOT EXISTS "doc"."test" ... CLUSTERED INTO 5 SHARDS PARTITIONED BY ("testfield") WITH ( "blocks.metadata" = false, "blocks.read" = false, "blocks.read_only" = false, "blocks.write" = false, column_policy = 'dynamic', "gateway.local.sync" = 5000, number_of_replicas = '1', "recovery.initial_shards" = 'quorum', refresh_interval = 1000, "routing.allocation.enable" = 'all', "routing.allocation.total_shards_per_node" = -1, "translog.disable_flush" = false, "translog.flush_threshold_ops" =<PHONE_NUMBER>, "translog.flush_threshold_period" = 1800000, "translog.flush_threshold_size" = 209715200, "translog.interval" = 5000, "unassigned.node_left.delayed_timeout" = 60000, "warmer.enabled" = true )
 CREATE TABLE IF NOT EXISTS "doc"."test" ... CLUSTERED INTO 1 SHARDS PARTITIONED BY ("testfield") ... // everything else the same

And here is the TRACE from io.crate.operation.collect:
[2016-02-18 23:36:36,234][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.0424ihi1][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,236][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.0424ihi1][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,237][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.0424ihi1][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,240][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.0424ihi1][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,240][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.0424ihi1][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,240][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04254ia1][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,241][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04254ia1][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,241][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04254ia1][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,242][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04254ia1][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,247][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04254ia1][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,248][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.046kqobiddin882dc5lmasg][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,248][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.046kqobiddin882dc5lmasg][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,248][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.046kqobiddin882dc5lmasg][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,250][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.046kqobiddin882dc5lmasg][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,250][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.046kqobiddin882dc5lmasg][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,250][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.046kqtbkelgmo826eln68so][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,251][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.046kqtbkelgmo826eln68so][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,251][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.046kqtbkelgmo826eln68so][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,251][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.046kqtbkelgmo826eln68so][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,252][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.046kqtbkelgmo826eln68so][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,252][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04742srjclq20jb1dpgmepbi][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,252][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04742srjclq20jb1dpgmepbi][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,253][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04742srjclq20jb1dpgmepbi][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,253][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04742srjclq20jb1dpgmepbi][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,253][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04742srjclq20jb1dpgmepbi][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,255][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.0474cobdd5m7i82fcpj6ior5][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,255][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.0474cobdd5m7i82fcpj6ior5][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,255][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.0474cobdd5m7i82fcpj6ior5][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,256][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.0474cobdd5m7i82fcpj6ior5][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,256][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.0474cobdd5m7i82fcpj6ior5][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,256][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.0484irjmclpn8rb5dpq20gj1dplg][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,257][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.0484irjmclpn8rb5dpq20gj1dplg][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,257][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.0484irjmclpn8rb5dpq20gj1dplg][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,257][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.0484irjmclpn8rb5dpq20gj1dplg][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,257][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.0484irjmclpn8rb5dpq20gj1dplg][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,258][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04854pbkc5kmo829dpr6asrkdtp0][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,258][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04854pbkc5kmo829dpr6asrkdtp0][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,258][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04854pbkc5kmo829dpr6asrkdtp0][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,259][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04854pbkc5kmo829dpr6asrkdtp0][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,259][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04854pbkc5kmo829dpr6asrkdtp0][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,259][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04942or3e9im8qbkcli20kj5ehgmir0][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,263][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04942or3e9im8qbkcli20kj5ehgmir0][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,264][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04942or3e9im8qbkcli20kj5ehgmir0][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,264][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04942or3e9im8qbkcli20kj5ehgmir0][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,265][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04942or3e9im8qbkcli20kj5ehgmir0][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,265][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.0494cqbec5n66qb1dgg42p3md5pmusg][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,265][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.0494cqbec5n66qb1dgg42p3md5pmusg][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,266][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.0494cqbec5n66qb1dgg42p3md5pmusg][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,266][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.0494cqbec5n66qb1dgg42p3md5pmusg][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,266][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.0494cqbec5n66qb1dgg42p3md5pmusg][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,267][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.049kqpb4d5gi0k3idtj6asrjd5nmsobc][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,267][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.049kqpb4d5gi0k3idtj6asrjd5nmsobc][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,267][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.049kqpb4d5gi0k3idtj6asrjd5nmsobc][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,267][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.049kqpb4d5gi0k3idtj6asrjd5nmsobc][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,268][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.049kqpb4d5gi0k3idtj6asrjd5nmsobc][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,271][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04e46q31e9q6asj5cgg4cqbec5n66qb1dgg42rj1dhsn6t0][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,271][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04e46q31e9q6asj5cgg4cqbec5n66qb1dgg42rj1dhsn6t0][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,271][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04e46q31e9q6asj5cgg4cqbec5n66qb1dgg42rj1dhsn6t0][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,272][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04e46q31e9q6asj5cgg4cqbec5n66qb1dgg42rj1dhsn6t0][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,272][TRACE][io.crate.operation.collect.ShardCollectService] [aF5NXC6GRnOey1yGLS2h9A][[.partitioned.test.04e46q31e9q6asj5cgg4cqbec5n66qb1dgg42rj1dhsn6t0][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-18 23:36:36,308][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 3 exhausted. Retrieving more data
[2016-02-18 23:36:36,308][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 0 exhausted. Retrieving more data
[2016-02-18 23:36:36,309][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 4 exhausted. Retrieving more data
[2016-02-18 23:36:36,309][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 2 exhausted. Retrieving more data
[2016-02-18 23:36:36,309][DEBUG][io.crate.operation.collect.collectors.OrderedDocCollector] searchMore from [doc=53007 score=NaN shardIndex=-1 fields=[[41 77 30 31 4e 6b 45 34 52 45 52 45 4f 54 42 44 4e 30 4d 33 41 54 45 62 51 32 68 68 63 6e 52 6c 63 6d 56 6b 49 45 5a 70 62 6d 46 75 59 32 6c 68 62 43 42 42 62 6d 46 73 65 58 4e 30]]]
[2016-02-18 23:36:36,310][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 1 exhausted. Retrieving more data
[2016-02-18 23:36:36,310][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 0 exhausted. Retrieving more data
[2016-02-18 23:36:36,310][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 3 exhausted. Retrieving more data
[2016-02-18 23:36:36,311][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 0 exhausted. Retrieving more data
[2016-02-18 23:36:36,311][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 4 exhausted. Retrieving more data
[2016-02-18 23:36:36,311][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 3 exhausted. Retrieving more data
[2016-02-18 23:36:36,311][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 2 exhausted. Retrieving more data
[2016-02-18 23:36:36,311][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 1 exhausted. Retrieving more data
[2016-02-18 23:36:36,311][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 2 exhausted. Retrieving more data
[2016-02-18 23:36:36,311][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 4 exhausted. Retrieving more data
[2016-02-18 23:36:36,312][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 1 exhausted. Retrieving more data
[2016-02-18 23:36:36,312][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 2 exhausted. Retrieving more data
[2016-02-18 23:36:36,312][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 3 exhausted. Retrieving more data
[2016-02-18 23:36:36,312][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 1 exhausted. Retrieving more data
[2016-02-18 23:36:36,312][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 3 exhausted. Retrieving more data
[2016-02-18 23:36:36,312][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 4 exhausted. Retrieving more data
[2016-02-18 23:36:36,313][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 0 exhausted. Retrieving more data
[2016-02-18 23:36:36,313][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 1 exhausted. Retrieving more data
[2016-02-18 23:36:36,313][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 4 exhausted. Retrieving more data
[2016-02-18 23:36:36,313][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 2 exhausted. Retrieving more data
[2016-02-18 23:36:36,313][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 0 exhausted. Retrieving more data
[2016-02-18 23:36:36,313][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 0 exhausted. Retrieving more data
// this Iterator 0 exhausted. Retrieving more data trace line appears another 481 times

Can you also add trace logging for io.crate.jobs ?
Could you also post the output of select sum(num_docs), table_name, partition_ident from sys.shards where table_name = 'test' group by 2, 3; ?
And are you sure that the statement is stuck and not very very slow?
I think I've an idea what's causing the issue.

I'm sure it's not a slow statement.  If I search name = 'scott', it will return in under a second.  But if I search name = 'SCOTT' it will hang indefinitely.
Once when running the query, I got the exception:
{"error":{"message":"SQLActionException[StackOverflowError in sun.nio.cs.UTF_8$Encoder.encodeLoop(UTF_8.java:691)]","code":5000}}

Most of the time it simply hangs with no exception however.  I did a COPY FROM, ensured all of my data was UTF8 Encoded, and then a COPY TO, and the problem still happens.
Here is the output from sys.shards:
sum(num_docs)	table_name	    partition_ident
5111            test            0494cqbec5n66qb1dgg42p3md5pmusg
1425232         test            04854pbkc5kmo829dpr6asrkdtp0
313585          test            049kqpb4d5gi0k3idtj6asrjd5nmsobc
664561          test            04254ia1
3816            test            0484irjmclpn8rb5dpq20gj1dplg
188631          test            04942or3e9im8qbkcli20kj5ehgmir0
27255           test            0424ihi1
8402            test            0474cobdd5m7i82fcpj6ior5
196813          test            04e46q31e9q6asj5cgg4cqbec5n66qb1dgg42rj1dhsn6t0
990             test            046kqtbkelgmo826eln68so
42              test            04742srjclq20jb1dpgmepbi
75              test            046kqobiddin882dc5lmasg

Here is the logging with io.crate.jobs enabled:
[2016-02-19 16:30:00,074][TRACE][io.crate.jobs.JobExecutionContext] adding subContext 2, now there are 1 subContexts
[2016-02-19 16:30:00,076][TRACE][io.crate.jobs.JobExecutionContext] adding subContext 1, now there are 2 subContexts
[2016-02-19 16:30:00,076][TRACE][io.crate.jobs.JobExecutionContext] adding subContext 0, now there are 3 subContexts
[2016-02-19 16:30:00,076][TRACE][io.crate.jobs.AbstractExecutionSubContext] preparing io.crate.jobs.ProjectorChainContext@7dae3a13: 2
[2016-02-19 16:30:00,077][TRACE][io.crate.jobs.AbstractExecutionSubContext] preparing io.crate.operation.fetch.FetchContext@4ff1bea2: 1
[2016-02-19 16:30:00,078][TRACE][io.crate.jobs.AbstractExecutionSubContext] preparing JobCollectContext{searchContexts=[], closed=false}: 0
[2016-02-19 16:30:00,078][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.0424ihi1][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,079][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.0424ihi1][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,079][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.0424ihi1][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,080][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.0424ihi1][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,080][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.0424ihi1][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,088][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04254ia1][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,089][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04254ia1][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,089][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04254ia1][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,089][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04254ia1][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,090][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04254ia1][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,090][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.046kqobiddin882dc5lmasg][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,091][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.046kqobiddin882dc5lmasg][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,092][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.046kqobiddin882dc5lmasg][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,093][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.046kqobiddin882dc5lmasg][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,093][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.046kqobiddin882dc5lmasg][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,093][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.046kqtbkelgmo826eln68so][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,094][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.046kqtbkelgmo826eln68so][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,094][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.046kqtbkelgmo826eln68so][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,094][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.046kqtbkelgmo826eln68so][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,095][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.046kqtbkelgmo826eln68so][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,095][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04742srjclq20jb1dpgmepbi][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,095][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04742srjclq20jb1dpgmepbi][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,095][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04742srjclq20jb1dpgmepbi][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,096][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04742srjclq20jb1dpgmepbi][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,096][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04742srjclq20jb1dpgmepbi][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,097][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.0474cobdd5m7i82fcpj6ior5][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,097][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.0474cobdd5m7i82fcpj6ior5][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,098][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.0474cobdd5m7i82fcpj6ior5][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,098][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.0474cobdd5m7i82fcpj6ior5][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,098][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.0474cobdd5m7i82fcpj6ior5][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,098][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.0484irjmclpn8rb5dpq20gj1dplg][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,099][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.0484irjmclpn8rb5dpq20gj1dplg][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,104][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.0484irjmclpn8rb5dpq20gj1dplg][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,105][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.0484irjmclpn8rb5dpq20gj1dplg][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,243][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 0 exhausted. Retrieving more data
[2016-02-19 16:30:00,105][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.0484irjmclpn8rb5dpq20gj1dplg][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,105][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04854pbkc5kmo829dpr6asrkdtp0][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,106][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04854pbkc5kmo829dpr6asrkdtp0][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,106][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04854pbkc5kmo829dpr6asrkdtp0][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,106][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04854pbkc5kmo829dpr6asrkdtp0][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,107][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04854pbkc5kmo829dpr6asrkdtp0][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,107][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04942or3e9im8qbkcli20kj5ehgmir0][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,107][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04942or3e9im8qbkcli20kj5ehgmir0][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,108][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04942or3e9im8qbkcli20kj5ehgmir0][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,108][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04942or3e9im8qbkcli20kj5ehgmir0][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,108][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04942or3e9im8qbkcli20kj5ehgmir0][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,109][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.0494cqbec5n66qb1dgg42p3md5pmusg][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,109][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.0494cqbec5n66qb1dgg42p3md5pmusg][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,110][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.0494cqbec5n66qb1dgg42p3md5pmusg][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,111][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.0494cqbec5n66qb1dgg42p3md5pmusg][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,111][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.0494cqbec5n66qb1dgg42p3md5pmusg][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,111][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.049kqpb4d5gi0k3idtj6asrjd5nmsobc][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,112][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.049kqpb4d5gi0k3idtj6asrjd5nmsobc][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,112][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.049kqpb4d5gi0k3idtj6asrjd5nmsobc][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,112][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.049kqpb4d5gi0k3idtj6asrjd5nmsobc][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,113][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.049kqpb4d5gi0k3idtj6asrjd5nmsobc][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,113][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04e46q31e9q6asj5cgg4cqbec5n66qb1dgg42rj1dhsn6t0][0]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,119][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04e46q31e9q6asj5cgg4cqbec5n66qb1dgg42rj1dhsn6t0][1]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,120][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04e46q31e9q6asj5cgg4cqbec5n66qb1dgg42rj1dhsn6t0][2]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,120][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04e46q31e9q6asj5cgg4cqbec5n66qb1dgg42rj1dhsn6t0][3]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,121][TRACE][io.crate.operation.collect.ShardCollectService] [YuX_3rcoTvqK-nsaVHXF9g][[.partitioned.test.04e46q31e9q6asj5cgg4cqbec5n66qb1dgg42rj1dhsn6t0][4]] creating OrderedDocCollector. Expected number of rows to be collected: 2
[2016-02-19 16:30:00,121][TRACE][io.crate.jobs.AbstractExecutionSubContext] starting io.crate.jobs.ProjectorChainContext@7dae3a13: 2
[2016-02-19 16:30:00,121][TRACE][io.crate.jobs.AbstractExecutionSubContext] starting io.crate.operation.fetch.FetchContext@4ff1bea2: 1
[2016-02-19 16:30:00,121][TRACE][io.crate.jobs.AbstractExecutionSubContext] starting JobCollectContext{searchContexts=[31=>io.crate.action.sql.query.CrateSearchContext@1cde943, 12=>io.crate.action.sql.query.CrateSearchContext@9e92748, 47=>io.crate.action.sql.query.CrateSearchContext@59beac4, 19=>io.crate.action.sql.query.CrateSearchContext@47dd507b, 58=>io.crate.action.sql.query.CrateSearchContext@29b43e32, 5=>io.crate.action.sql.query.CrateSearchContext@69a78f2b, 7=>io.crate.action.sql.query.CrateSearchContext@33309511, 29=>io.crate.action.sql.query.CrateSearchContext@1e435584, 22=>io.crate.action.sql.query.CrateSearchContext@168eadd0, 45=>io.crate.action.sql.query.CrateSearchContext@4385a6fd, 42=>io.crate.action.sql.query.CrateSearchContext@742a3b81, 28=>io.crate.action.sql.query.CrateSearchContext@7041bff5, 40=>io.crate.action.sql.query.CrateSearchContext@13c27c00, 44=>io.crate.action.sql.query.CrateSearchContext@7d9e82cb, 36=>io.crate.action.sql.query.CrateSearchContext@58cd58ca, 15=>io.crate.action.sql.query.CrateSearchContext@250efa31, 2=>io.crate.action.sql.query.CrateSearchContext@252ca0ec, 6=>io.crate.action.sql.query.CrateSearchContext@2cadf658, 46=>io.crate.action.sql.query.CrateSearchContext@1e94f00f, 17=>io.crate.action.sql.query.CrateSearchContext@4c195e9e, 10=>io.crate.action.sql.query.CrateSearchContext@c72bc31, 51=>io.crate.action.sql.query.CrateSearchContext@4f2e94d1, 55=>io.crate.action.sql.query.CrateSearchContext@768301b3, 27=>io.crate.action.sql.query.CrateSearchContext@70e85c53, 56=>io.crate.action.sql.query.CrateSearchContext@69e2f54b, 16=>io.crate.action.sql.query.CrateSearchContext@52517cba, 32=>io.crate.action.sql.query.CrateSearchContext@3c3171da, 35=>io.crate.action.sql.query.CrateSearchContext@e09b8cb, 33=>io.crate.action.sql.query.CrateSearchContext@70bf5cec, 11=>io.crate.action.sql.query.CrateSearchContext@29525aed, 14=>io.crate.action.sql.query.CrateSearchContext@1e5a51bc, 49=>io.crate.action.sql.query.CrateSearchContext@5dd67d5c, 41=>io.crate.action.sql.query.CrateSearchContext@57841236, 13=>io.crate.action.sql.query.CrateSearchContext@6c3aaf19, 38=>io.crate.action.sql.query.CrateSearchContext@2021c493, 0=>io.crate.action.sql.query.CrateSearchContext@4ef37156, 54=>io.crate.action.sql.query.CrateSearchContext@3991cf1c, 39=>io.crate.action.sql.query.CrateSearchContext@6aed50, 24=>io.crate.action.sql.query.CrateSearchContext@2ec1a492, 9=>io.crate.action.sql.query.CrateSearchContext@7b6d19dd, 18=>io.crate.action.sql.query.CrateSearchContext@4c33c083, 21=>io.crate.action.sql.query.CrateSearchContext@1be4a438, 30=>io.crate.action.sql.query.CrateSearchContext@382266e2, 4=>io.crate.action.sql.query.CrateSearchContext@2b1223ca, 26=>io.crate.action.sql.query.CrateSearchContext@79f7c9f3, 53=>io.crate.action.sql.query.CrateSearchContext@478c7791, 23=>io.crate.action.sql.query.CrateSearchContext@6c321cf4, 8=>io.crate.action.sql.query.CrateSearchContext@56847ecb, 37=>io.crate.action.sql.query.CrateSearchContext@117b9db9, 50=>io.crate.action.sql.query.CrateSearchContext@356f50f8, 1=>io.crate.action.sql.query.CrateSearchContext@49c63f1d, 25=>io.crate.action.sql.query.CrateSearchContext@3cc162c8, 52=>io.crate.action.sql.query.CrateSearchContext@719aa6bc, 3=>io.crate.action.sql.query.CrateSearchContext@3e3dc0e7, 43=>io.crate.action.sql.query.CrateSearchContext@467b3eea, 48=>io.crate.action.sql.query.CrateSearchContext@719bd3cf, 57=>io.crate.action.sql.query.CrateSearchContext@55102406, 34=>io.crate.action.sql.query.CrateSearchContext@57afcbb, 59=>io.crate.action.sql.query.CrateSearchContext@1ae90e90, 20=>io.crate.action.sql.query.CrateSearchContext@35c3b3a9], closed=false}: 0
[2016-02-19 16:30:00,148][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 3 exhausted. Retrieving more data
[2016-02-19 16:30:00,149][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 0 exhausted. Retrieving more data
[2016-02-19 16:30:00,149][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 4 exhausted. Retrieving more data
[2016-02-19 16:30:00,149][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 2 exhausted. Retrieving more data
[2016-02-19 16:30:00,149][DEBUG][io.crate.operation.collect.collectors.OrderedDocCollector] searchMore from [doc=53007 score=NaN shardIndex=-1 fields=[[41 77 30 31 4e 6b 45 34 52 45 52 45 4f 54 42 44 4e 30 4d 33 41 54 45 62 51 32 68 68 63 6e 52 6c 63 6d 56 6b 49 45 5a 70 62 6d 46 75 59 32 6c 68 62 43 42 42 62 6d 46 73 65 58 4e 30]]]
[2016-02-19 16:30:00,150][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 1 exhausted. Retrieving more data
[2016-02-19 16:30:00,150][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 0 exhausted. Retrieving more data
[2016-02-19 16:30:00,150][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 3 exhausted. Retrieving more data
[2016-02-19 16:30:00,150][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 0 exhausted. Retrieving more data
[2016-02-19 16:30:00,150][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 4 exhausted. Retrieving more data
[2016-02-19 16:30:00,151][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 3 exhausted. Retrieving more data
[2016-02-19 16:30:00,151][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 2 exhausted. Retrieving more data
[2016-02-19 16:30:00,151][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 1 exhausted. Retrieving more data
[2016-02-19 16:30:00,152][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 2 exhausted. Retrieving more data
[2016-02-19 16:30:00,152][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 4 exhausted. Retrieving more data
[2016-02-19 16:30:00,152][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 1 exhausted. Retrieving more data
[2016-02-19 16:30:00,152][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 2 exhausted. Retrieving more data
[2016-02-19 16:30:00,152][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 3 exhausted. Retrieving more data
[2016-02-19 16:30:00,153][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 1 exhausted. Retrieving more data
[2016-02-19 16:30:00,153][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 3 exhausted. Retrieving more data
[2016-02-19 16:30:00,153][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 4 exhausted. Retrieving more data
[2016-02-19 16:30:00,153][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 0 exhausted. Retrieving more data
[2016-02-19 16:30:00,154][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 1 exhausted. Retrieving more data
[2016-02-19 16:30:00,154][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 4 exhausted. Retrieving more data
[2016-02-19 16:30:00,154][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 2 exhausted. Retrieving more data
[2016-02-19 16:30:00,154][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 0 exhausted. Retrieving more data
[2016-02-19 16:30:00,154][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 0 exhausted. Retrieving more data
[2016-02-19 16:30:00,155][TRACE][io.crate.operation.collect.collectors.MultiShardScoreDocCollector] Iterator 0 exhausted. Retrieving more data
// The above message is repeated a few hundred times
[2016-02-19 16:30:00,258][TRACE][io.crate.jobs.AbstractExecutionSubContext] closing io.crate.operation.fetch.FetchContext@4ff1bea2: 1
[2016-02-19 16:30:44,046][TRACE][io.crate.jobs.JobExecutionContext] adding subContext 1, now there are 1 subContexts
[2016-02-19 16:30:44,047][TRACE][io.crate.jobs.JobExecutionContext] adding subContext 0, now there are 2 subContexts
[2016-02-19 16:30:44,048][TRACE][io.crate.jobs.AbstractExecutionSubContext] preparing io.crate.jobs.ProjectorChainContext@322a46b4: 1
[2016-02-19 16:30:44,048][TRACE][io.crate.jobs.AbstractExecutionSubContext] preparing JobCollectContext{searchContexts=[], closed=false}: 0
[2016-02-19 16:30:44,049][TRACE][io.crate.jobs.AbstractExecutionSubContext] starting io.crate.jobs.ProjectorChainContext@322a46b4: 1
[2016-02-19 16:30:44,049][TRACE][io.crate.jobs.AbstractExecutionSubContext] starting JobCollectContext{searchContexts=[], closed=false}: 0
[2016-02-19 16:30:44,050][TRACE][io.crate.jobs.AbstractExecutionSubContext] closing io.crate.jobs.ProjectorChainContext@322a46b4: 1
[2016-02-19 16:30:44,051][TRACE][io.crate.jobs.AbstractExecutionSubContext] closing JobCollectContext{searchContexts=[], closed=true}: 0
[2016-02-19 16:30:44,051][TRACE][io.crate.jobs.JobContextService] [677471353]: JobExecutionContext closed for job 6e68a95e-3d28-45e2-b3ee-a6c0991af5df removed it - 3 executionContexts remaining
[2016-02-19 16:30:44,051][TRACE][io.crate.jobs.AbstractExecutionSubContext] Collectors finished: StopWatch '0: collect': running time  = 1.6ms

Can you do the name = 'SCOTT' query which gets stuck but also include a and testfield = '<valid-partition-value>' in the where clause? If my guess is right it should execute pretty fast.

Oh yes, I did try that already.  I can query each partition individually and it works on every partition.

I was able to reproduce the issue and come up with a fix (see https://github.com/crate/crate/pull/3277).
The fix will be in the next hotfix release (0.54.6)

Great, thanks for your help!

Btw 0.54.6 which contains the fix for this has been released.


php app/console doctrine:mapping:import thrown ErrorException

if you have enabled DoctrineExtension and you want to generate entities from an existing database executing:
php app/console doctrine:mapping:import BundleName thrown this
[ErrorException]
Warning: class_parents(): Class "CLASS_NAME" does not exist and could not be loaded in  Gedmo/Mapping/ExtensionMetadataFactory.php line 80
A work around this is: Disable the extension, do doctrine:mapping:import and later enable the extension But I think the extension is improved with this issue solved.

do you use latest version of extensions?

Yes, Now I tested with:

Symfony-2.0.11 Standard with vendors (Doctrine 2.1.6)
DoctrineExtensions master-dev
Sakila DB (I dit some changes: change enum and blob fields)

Here the exception:php app/console doctrine:mapping:import AcmeDemoBundle annotation
[ErrorException]
Warning: class_parents(): Class Actor does not exist and could not be loaded in /home/yoander/htdocs/Symfony/vendor/DoctrineExtensions/lib/Gedmo/Mapping/ExtensionMetadataFactory.php line 80
doctrine:mapping:import [--em[="..."]] [--filter="..."] [--force] bundle [mapping-type]
This is my config:
imports:
- { resource: parameters.ini }
- { resource: security.yml }
- { resource: doctrine_extensions.yml }
...
Doctrine Configuration
doctrine:
dbal:
driver:   %database_driver%
host:     %database_host%
port:     %database_port%
dbname:   %database_name%
user:     %database_user%
password: %database_password%
charset:  UTF8
orm:
    auto_generate_proxy_classes: %kernel.debug%
    auto_mapping: true
    mappings:
        tranlatable:
            type: annotation
            dir: %kernel.root_dir%/../vendor/DoctrineExtensions/lib/Gedmo/Translatable/Entity/MappedSuperclass
            prefix: Gedmo\Translatable\Entity
            alias: Gedmo

parameters.ini
[parameters]
database_driver   = pdo_mysql
database_host     = localhost
database_port     = 3306
database_name     = sakila
database_user     = root
database_password =
mailer_transport  = smtp
mailer_host       = localhost
mailer_user       =
mailer_password   =

locale            = en

secret            = ThisTokenIsNotSoSecretChangeIt

well then, it needs to be fixed, thanks for the input


Use disjoint unions on fragments w/ interfaces [WIP]

Starting this off to address #73 by seeing if we can use disjoint/discriminated unions in flow and typescript. This will be a work in progress until the checklist is complete.
For reference on disjoint unions in Flow: https://flow.org/en/docs/types/unions/#toc-disjoint-unions
For reference on discriminated unions in Typescript, search on this page: https://www.typescriptlang.org/docs/handbook/advanced-types.html
Something that I'm still curious about is whether or not this works without an explicit discriminant. I suspect we might only be able to make this work if we use __typeName as a discriminant, which currently is not outputted in type definitions.

[x] Test Cases
[ ] Implementation

It looks like disjoint / discriminated unions are the way to go here, they seem pretty powerful. We can assume __typename is always available, so if it isn't already we should add it to the generated definitions.

Very excited for this to land.

so the __typename change is a bigger change that will affect multiple pieces of apollo-codegen core so I'll do that in a separate PR. This at least enables the creation of types which means the generated Flow output is no longer invalid

Tests are passing! Can we merge this and release it?

The branch is actually not working for me:
yarn run v0.23.3
$ apollo-codegen download-schema http://localhost:3000/graphql --output graphql-schema.json
module.js:327
    throw err;
    ^

Error: Cannot find module 'babel-runtime/regenerator'
    at Function.Module._resolveFilename (module.js:325:15)
    at Function.Module._load (module.js:276:25)
    at Module.require (module.js:353:17)
    at require (internal/module.js:12:17)
    at Object.<anonymous> (/Users/clayne/Library/Caches/Yarn/v1/npm-apollo-codegen-0.10.13-337c5ac58c588d3cf6f38a50a7ec6cf824f2dc98/lib/cli.js:4:20)
    at Module._compile (module.js:409:26)
    at Object.Module._extensions..js (module.js:416:10)
    at Module.load (module.js:343:32)
    at Function.Module._load (module.js:300:12)
    at Function.Module.runMain (module.js:441:10)
error Command failed with exit code 1.
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command

@clayne11 hold on just a little bit more! Just trying to coordinate this with #104 and there is still some work to do there.

Noticing there's still some issues with __typename and fragment spreads, oh boy.

Okay to make this easier on me, I'm going to do this in 2 parts.
Part 1: Make sure __typename is surfaced in all the right places
Part 2: Make sure __typename gets the appropriate string literal as it's type. Since __typename fields should already be in the right places, this should only further refine the generated types to allow for proper use of disjoint unions without having to typecast.
Part 2 will happen in another PR.

Okay this is ready -- and does change the types that are generated in some cases (mainly fragment spreads and inline fragments). this could possibly be a breaking change, but for the better.
This doesn't have the work to fully allow for disjoint unions in some cases, but that will be tackled in the next PR and since that PR is just further refining the types for __typename from 'string' to 'Droid' or 'Human' (whatever the type is), there won't be a further breaking change


[FEAT] Add Quiz Section

Is your feature request related to a problem? Please describe.
I want to add quiz section.
Describe the solution you'd like
By addition of quiz section we can enchance the learning experience of the beginners. It can help them to learn various methods easily. It can include quizzes related to HTML, CSS and JAVASCRIPT. It will help the beginners to gain hand on experience on these tech stacks and understand them very easily. After that they can create their own web projects.
Describe alternatives you've considered
I have different ideas related to the tech stacks present on the website.
Additional context
Solutions of quizzes and hints will also be there. So if anyone stuck in a problem they can take help from them.

Please assign me, I want to work on this.

I'm too intensed


New PyPI release?

v0.35.0 was tagged quite a while ago but there is no PyPI release yet. Would you mind fixing that? Thanks!

Bah. Thanks, fixed.


Add space as type parameter to Gibbs sampler

This PR adds a space type parameter to the Gibbs algorithm, similar to the other algorithms. In that way the recomputation of the space can be avoided when a new sampler is constructed. Moreover, the checks of the types of the component algorithms in the constructor of the sampler are not needed anymore since the type parameters of the Gibbs algorithm are restricted to the supported algorithms.

Again the same (seemingly unrelated) distribution test error.

Again the unrelated distribution test is failing.

Again the unrelated distribution test is failing.

Many thanks. It's ok to ignore the distribution test for now - will try to fix it later in a separate PR.

Many thanks. It's ok to ignore the distribution test for now - will try to fix it later in a separate PR.

Oh sorry, I didn't see your comment. Hopefully https://github.com/TuringLang/Turing.jl/pull/998 fixes the issue.


Bug 1756141: Remove incorrect optional tag from new ingress field

loadBalancer is a new field that contains scope, and loadBalancer is
optional (correct). However, loadBalancer.scope should be required. This
commit fixes that.

/bugzilla refresh

@deads2k @sttts not sure what's up with the protobuf changes that got emitted here. If they shouldn't have happened I can manually delete them for now rather than investigate why the local tooling produced the changes.

/approve
/lgtm

@smarterclayton PTAL

/bugzilla refresh

I'm on my phone. Ben please go ahead and set cherry pick approved valid bug and unset invalid book


Poly n Plannotate

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8262757/
I'd like to get the plannotate auto annotation suite working with poly.
Here's a link to the code: https://github.com/mmcguffi/pLannotate/tree/master
Basically, this would let us auto-annotate plasmids. A very useful task!

Would be happy to take this on! Here's a 2 ways we could approach it:

Closely integrate with the plannotate batch CLI, which takes fasta files and produces output files (genbank or csv). This has the obvious benefit of being quicker to implement, test, and review; and because this calls out to Python via the CLI, future updates from plannotate would not have to be ported to go in order to be utilized. This is what I am leaning towards.
Faithfully port the core logic, which uses several CLI tools (blastn, diamond, infernal) to query several databases that are distributed with plannotate found here and are then aggregated with pandas. This option would result in fast annotation, and by adding local alignment search natively to poly it unlocks future functionality such as CRISPR gRNA design.

In short, both require calling out to external CLI tooling, but option 2 does not have a Python dependency but requires additional work as a result.

One callout: plannotate is distributed under the GNU GPL v3 license. This shouldn't impact option 1, as we do not plan to distribute poly with pLannotate, but it will impact users that may want to use poly + plannotate. Option 2 may be impacted, as poly may become a derivative work, which we don't want if we want to keep using the MIT license.

One callout: plannotate is distributed under the GNU GPL v3 license. This shouldn't impact option 1, as we do not plan to distribute poly with pLannotate, but it will impact users that may want to use poly + plannotate. Option 2 may be impacted, as poly may become a derivative work, which we don't want if we want to keep using the MIT license.

One bit here: DNA cannot be copyrighted. The most important thing that they've made, in my opinion, is the sweet,sweet database of part features. The raw sequences we should be able to use without infringing on any copyright. Translation to a whole new language means it probably isn't derivative work on the code-level.
I suppose I should be more specific with the desire here: I would like the abilities of plannotate, regardless of implementation. So option 2, though I don't think we have to care much about faithfully reproducing the core logic! We just need 98% matching to the full sequence - ie, table 1.
If the goal is to write no new code, you can probably just select down the possible matches using mash, then do a Needleman-Wunsch alignment using align. I've found it's really really really slow, though, but could work. There is a reason blast is a thing
The other option would be getting blast or minimap2 or the like integrated into Poly. I've been looking at doing this with biowasm, but there are some annoying points around getting that to work (been posting my work on discord). It could also be done with cgo, but again, that is also annoying.
I would love this to be done and am very willing to help!

I've never really used DIAMOND, but I'd also be fine with just looking for perfect amino acid matches right now. The nucleotide matching is the important part for a version 1 IMO

I'm not sure the approach but this may be a good external thing to start?


Exchange Online Compatibility?

Describe the bug
I'm attempting to use the Exchange Online Mangement module and it keeps crashing. The cmdlet successfully connects but soon after a Powershell exception is thrown.
The command I'm using is
connect-ExchangeOnline -userprinciplename <USERNAME>

The error message is:
Exception: C:\Program Files\WindowsPowerShell\Modules\ExchangeOnlineManagement\2.0.5\netCore\ExchangeOnlineManagement.psm1:475
Line |
 475 |  … PSSession = New-ExoPSSession -ExchangeEnvironmentName $ExchangeEnviro …
     |                ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
     | An error has occurred which PowerShell cannot handle. A remote session might have
     | ended.

I am able to use this command successfully in the windows powershell console; the error is only thrown in Jupyter and in VSCode when using .NET Interactive
Is this package compatible with Exchange Online?
Please complete the following:
Which version of .NET Interactive are you using? There are a few ways to find this out:

In a notebook, run the #!about magic command.
At the command line, run dotnet interactive --version.

Version: 1.0.235701+3881a96164de75fca84f5f11027f3606b7878044
Build date: 2021-07-09T01:12:29.8185285Z

OS

[X] Windows 10
[ ] macOS
[ ] Linux (Please specify distro)
[ ] iOS
[ ] Android

Browser

[X] Chrome
[ ] Edge
[ ] Firefox
[ ] Safari

Frontend

[X] Jupyter Notebook
[ ] Jupyter Lab
[ ] nteract
[X] Visual Studio Code
[ ] Visual Studio Code Insiders
[ ] Other (please specify)

Screenshots
If applicable, add screenshots to help explain your problem.

@daxian-dbw Any ideas on this one?

I am able to use this command successfully in the windows powershell console; the error is only thrown in Jupyter and in VSCode when using .NET Interactive

@vijaidial By "windows powershell cosnole", do you mean Windows PowerShell 5.1? Can you try using this command in PowerShell 7.1.3, and see if it works?
I remember seeing compatbility issues with ExchangeOnlineManagement in PowerShell Core, so I'm not sure if this module is truely compatible with powershell 7.1.x. @joeyaiello can you please chime in?


Add SNI-Callback to dynamically create missing certs

I have a use case where I needed redbird to dynamically issue certificates for undetermined domains. For this I added a new callback to call proxy.register for yet unregistered hostnames.
It is not the most elegant solution, mostly caused by proxy.register being asynchronous and the need to abort the initial request. I wanted to keep it simple, though and did not touch more code than needed.

I am closing this. To make it work properly, this library would need a heavy overhaul with asynchronicity in mind.


Cannot install through pip or locally because of setup.py

When attempting to install:
    Complete output from command python setup.py egg_info:     Traceback (most recent call last):       File "<string>", line 1, in <module>       File "C:\Users\ser\AppData\Local\Temp\pip-req-build-jkgwiajx\setup.py", line 8, in <module>         readme = f.read()       File "C:\Users\user\AppData\Local\Programs\Python\Python36\lib\encodings\cp1252.py", line 23, in decode         return codecs.charmap_decode(input,self.errors,decoding_table)[0]     UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 661: character maps to <undefined>
Fixed by changing the following lines from setup.py:
with open('README.md'') as f:
    readme = f.read()
with open('LICENSE') as f:
    license = f.read()

To the following:
with open('README.md', encoding='utf-8') as f:
    readme = f.read()
with open('LICENSE', encoding='utf-8') as f:
    license = f.read()

Python ver is 3.6.8

This is on Windows by the way - I realise now that this package is really difficult to install on Windows due to the C dependencies.

I run into the same issue, it seems that one of the dependencies is deprecated, I'm not sure which one but if I would guess I would say it has to do with NumPy API.

I'm still having the same issue while installing whatthelang on windows . any new updates concerning the solution? thanks

Same issue. I have been struggling to install whatthelang on windows machine but no luck. Any update on this. thanks!

same issue. did anyone ever find a way to install it on windows?


Add published ClimSim Dataset via pangeo forge

Thanks to a lot of work by @sungdukyu @jerrylin96 and many others, the E3SM-MMF(ne4) aka ClimSim dataset is now available on huggingface.
I would like to reingest it via pangeo-forge to make this workflow entirely reproducible!

[ ] Wait for final naming/publication

We (at Google) would be excited to be able to play around with the ARCO version of ClimSim. I think this could make for an interesting training dataset for some of our ML weather models :)

@shoyer  (Sorry for the dumb question.) What is "ARCO"?

"Analysis-Ready, Cloud Optimized". See this paper for a longer definition.
So basically:

Converting the data to a single Zarr dataset
Augmenting some of the missing / nonexistent metadata
Placing in cloud object storage

That's the goal here.

@rabernat Thanks for the clarification. One challenge would be the gigantic size of the high-res dataset, ~41TB. (BTW, we already have the 'Zarr'-ed real-go low-res dataset in LEAP cloud storage.)

Yes, absolutely, Zarr's the way to go for these huge datasets. However, what I meant was processing netcdf files (>400k files totaling 41TB) to a single Zarr file. It took quite a long time just for a low res dataset (same file number but much smaller size at several 100s GB). Maybe there's a more efficient way of doing this, I guess.

Maybe there's a more efficient way of doing this, I guess.

@sungdukyu  🤝 Meet Pangeo Forge!

@rabernat Thanks! Seems like my bakery was suboptimal. (https://pangeo-forge.org/pangeo-forge-diagram.png)

Since we have the right audience here, would it make sense to explore uploading a zarr store directly to huggingface?

Let's not try to mix in huggingface-related development work. Let's just try to ship the ClimSim dataset as fast as possible by whatever means necessary.

I can try to spend some time on this next week! In case somebody wants to start before that, starting a recipe PR in our LEAP feedstock would be the way to go.

@jbusecke could you push the work we began together on this as a PR? I have some time I can devote to this and would love to pick up where we left off.

See #33, sorry for the delay.


Can Not Reconnect

I am using SignalA in my android application!
When the network connection shutdown and then switch on immediately, the SignalR connection remains in ReconnectingState and is unable to resume to ConnectedState!
I read the source code of ReconnectingState class and there are no code to change mConnection to ConnectedState (as I expected there must have)
And the function onError(Exception ex) of AsyncCallback, I think it must retry new http post to resume connection there.

I have same problem too.

Same problem.
@erizet what is the likelihood that you will try to fix it?

any news here?


Account for meta in the JEI ISubtypeInterpreter

I think an old JEI was using meta + the ISubtypeInterpreter, but it was not intended, and JEI does not do that now.
Right now, if you look up Mekanism stuff in JEI it shows all kinds of blocks instead of just the intended block.
This PR fixes the Mekanism ISubtypeInterpreter so that it differentiates machines and basic blocks again.

@mezz for the prezident! 😄

Tested: Works.
Build here: http://twitchcharity.com/MekanismAll-1.10.2-9.2.1.homebaked.jar
Because Mekanism doesn't come with a "gradlew"

@ThatGamerBlue How stable this build is? I'm considering to replace my version to that because this is a really annoying bug - if it's good in single, I'm happy.

@hron84 no crashes so far :)

Been running that build on a little private server, for me and a friend.  No issues yet! Looking forward to it being pulled into mainline branch.

Thanks so much @mezz!

@aidancbrady when we can expect it in the wild?

@ThatGamerBlue TwitchCharity.com is down, here is a mirror: http://static.hron.me/privcdn/MekanismAll-1.10.2-9.2.1.homebaked.jar (not exactly a mirror, it's a fresh build of 1.10 branch)

@hron84 thanks for the rehost, my friend killed the server i was hosting on

@ThatGamerBlue You're welcome.


fix: rename then to andThen

BREAKING CHANGE
The addition of R.then in Ramda 0.26 made the R object
a Promise-like object, and meant that Promise.resolve() will attempt
to resolve it by calling the then() method. R is not a Promise, and
to reassure JavaScript of this fact, R.then is renamed to R.andThen.
Fixes #2751

@CrossEye You're still not fixing it. Could you please update it? Thanks.


Live

test PR

Docs Build status updates of commit 8cc6e24:
:white_check_mark: Validation status: passed
For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

Test PR


Add zstd compression content to performance tuning doc

Description
This change adds a brief overview of the zstd compression introduced in opensearch v2.9 to the docs page.
Issues Resolved
List any issues this PR will resolve, e.g. Closes [...].
Checklist

[X] By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license and subject to the Developers Certificate of Origin.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@sarthakaggarwal97 please take a look

thanks @akashsha1 for the review, minor comment, please check!

@akashsha1 Could you please fix DCO? Then we'll be ready to merge.

@akashsha1 Could you please fix DCO? Then we'll be ready to merge.

@kolchfa-aws / @sarthakaggarwal97 - I ran into issues with branch merging, and couldn't resolve the DCO.
So I opened a new PR with the already reviewed content. Please take a look and sign-off.
https://github.com/opensearch-project/documentation-website/pull/4814
PR#4814 should be good to merge.

Closing in favor of #4814


Support for RTL

Hey guys, the built it support for translating the UI is perfect!
How can I also change the UI direction to RTL? (Right-to-Left, for langueges such as Hebrew and Arabic)

I had unsuccessful quick try to add RTL support.
I tried both ways mentioned in the Chakra-UI docs:
https://chakra-ui.com/docs/styled-system/rtl-support#using-rtl-stylis-plugin
The farthest I have come was with the first method in the docs and it only helped me changing the direction of the two first buttons from the demo:

But it didnt work for the component itself that stayed the same.

Hey @eelior, I did a quick check, you can add this to theme
  customTheme={{
      Modal: {
      baseStyle: {
        dialog: {
          direction: "rtl",
        },
      },
    },
}}

With the table we are using (https://github.com/adazzle/react-data-grid) it's a bit more complicated - we need to pass a prop direction="rtl", so we would have to expose this in our props.
The end result would look like this:

Is this something close to what you are trying to achieve?

@masiulis This looks perfect!!
I over complicated this, I'm happy to see its so easy with the customTheme prop.
Ill try to make you a PR for the table later this evening.

rtl prop is available. Closing this as there should solve the discussed problem.


Add native support for Google Storage

Right now Quickwit supports Google storage via its S3 interoperability layer.
This works great but this has three downsides:

Users have to generate interoperabilitiy access/secret tokens and somehow pass them to their instances, instead of simply using Application Default Credentials
Some environment (restack for instance) do not even make it possible to get S3 interoperabillity Access tokens
We cannot use http2.

https://crates.io/crates/google-cloud-storage is probably our best bet.

What does that mean?

@guilload I edited the description.

I think OpenDAL is interesting, could be a good opportunity to test, it opens up many new storage backend too.

Interesting. Let me give it a try.
Initially, I planned to focus on webhdfs support as outlined in https://github.com/quickwit-oss/quickwit/issues/2655; however, I now believe that native GCS support would be more beneficial.
After our opendal storage has been implemented, extend it to webhdfs should be super easy :love_letter:


Function contracts branch rebase

Description of changes:
Rebase function-contracts feature branch.
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 and MIT licenses.

I ended up pushing the rebased branch to a new branch instead: https://github.com/model-checking/kani/tree/features/function-contracts-rebase. Closing this PR.


Service Monitoring

PR Summary

PR Checklist

Do you want this post to be published on a specific date?: Y/N [Specify date]:N
[X] I have read the contributors guide and followed the style and process guidelines
[X] PR has a meaningful title
[X] Includes content related an open issue

see Closing issues using keywords.

[X] This PR is ready to merge and is not Work in Progress

@doctordns @farismalaeb I just noticed that this article is in the July folder. Can you move it to the August folder?

@farismaleb => can you move the file?

Changes are committed and the post is moved to 08
On Tue, Aug 10, 2021 at 9:00 PM Sean Wheeler @.***>
wrote:

@doctordns https://github.com/doctordns @farismalaeb
https://github.com/farismalaeb I just noticed that this article is in
the July folder. Can you move it to the August folder?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/PowerShell/Community-Blog/pull/69#issuecomment-896153179,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AOMFJFUM4WHSAG2DXI43ATLT4FLJ5ANCNFSM5BJ7LJ4Q
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&utm_campaign=notification-email
.


[Prototype] Vectorized causal lm

Prototype to greatly reduce the post-processing overhead at higher batch sizes.

Closing as stale.
Some form of this has already been implemented.
Thanks a lot for this PR.


Cannot install on redmine 3.2.1

I cannot install on redmine 3.2.1 succesfully. Please help. Below are the environment info. and the installation log. Please advise if further info. is needed.
Environment:
Redmine version                3.2.1.stable
Ruby version                   2.3.1-p112 (2016-04-26) [x86_64-linux-gnu]
Rails version                  4.2.6
Environment                    production
Database adapter               PostgreSQL
SCM:
Git                            2.7.4
Filesystem
Redmine plugins:
no plugin installed
Intallation log:
rake redmine:plugins:migrate NAME=redmine_edit_custom_fields RAILS_ENV=production --trace
(in /usr/share/redmine)
** Invoke redmine:plugins:migrate (first_time)
** Invoke environment (first_time)
** Execute environment
rake aborted!
NameError: uninitialized constant EditCustomFieldsHelper
/usr/share/redmine/lib/plugins/redmine_edit_custom_fields/init.rb:43:in block (2 levels) in <top (required)>' /usr/lib/ruby/vendor_ruby/active_support/callbacks.rb:446:in instance_exec'
/usr/lib/ruby/vendor_ruby/active_support/callbacks.rb:446:in block in make_lambda' /usr/lib/ruby/vendor_ruby/active_support/callbacks.rb:192:in block in simple'
/usr/lib/ruby/vendor_ruby/active_support/callbacks.rb:504:in block in call' /usr/lib/ruby/vendor_ruby/active_support/callbacks.rb:504:in each'
/usr/lib/ruby/vendor_ruby/active_support/callbacks.rb:504:in call' /usr/lib/ruby/vendor_ruby/active_support/callbacks.rb:92:in run_callbacks'
/usr/lib/ruby/vendor_ruby/active_support/callbacks.rb:778:in _run_prepare_callbacks' /usr/lib/ruby/vendor_ruby/active_support/callbacks.rb:81:in run_callbacks'
/usr/lib/ruby/vendor_ruby/action_dispatch/middleware/reloader.rb:83:in prepare!' /usr/lib/ruby/vendor_ruby/action_dispatch/middleware/reloader.rb:55:in prepare!'
/usr/lib/ruby/vendor_ruby/rails/application/finisher.rb:50:in block in <module:Finisher>' /usr/lib/ruby/vendor_ruby/rails/initializable.rb:30:in instance_exec'
/usr/lib/ruby/vendor_ruby/rails/initializable.rb:30:in run' /usr/lib/ruby/vendor_ruby/rails/initializable.rb:55:in block in run_initializers'
/usr/lib/ruby/2.3.0/tsort.rb:228:in block in tsort_each' /usr/lib/ruby/2.3.0/tsort.rb:350:in block (2 levels) in each_strongly_connected_component'
/usr/lib/ruby/2.3.0/tsort.rb:431:in each_strongly_connected_component_from' /usr/lib/ruby/2.3.0/tsort.rb:349:in block in each_strongly_connected_component'
/usr/lib/ruby/2.3.0/tsort.rb:347:in each' /usr/lib/ruby/2.3.0/tsort.rb:347:in call'
/usr/lib/ruby/2.3.0/tsort.rb:347:in each_strongly_connected_component' /usr/lib/ruby/2.3.0/tsort.rb:226:in tsort_each'
/usr/lib/ruby/2.3.0/tsort.rb:205:in tsort_each' /usr/lib/ruby/vendor_ruby/rails/initializable.rb:54:in run_initializers'
/usr/lib/ruby/vendor_ruby/rails/application.rb:352:in initialize!' /usr/share/redmine/config/environment.rb:14:in <top (required)>'
/usr/lib/ruby/vendor_ruby/rails/application.rb:328:in require_environment!' /usr/lib/ruby/vendor_ruby/rails/application.rb:457:in block in run_tasks_blocks'
/var/lib/gems/2.3.0/gems/rake-11.3.0/lib/rake/task.rb:248:in block in execute' /var/lib/gems/2.3.0/gems/rake-11.3.0/lib/rake/task.rb:243:in each'
/var/lib/gems/2.3.0/gems/rake-11.3.0/lib/rake/task.rb:243:in execute' /var/lib/gems/2.3.0/gems/rake-11.3.0/lib/rake/task.rb:187:in block in invoke_with_call_chain'
/usr/lib/ruby/2.3.0/monitor.rb:214:in mon_synchronize' /var/lib/gems/2.3.0/gems/rake-11.3.0/lib/rake/task.rb:180:in invoke_with_call_chain'
/var/lib/gems/2.3.0/gems/rake-11.3.0/lib/rake/task.rb:209:in block in invoke_prerequisites' /var/lib/gems/2.3.0/gems/rake-11.3.0/lib/rake/task.rb:207:in each'
/var/lib/gems/2.3.0/gems/rake-11.3.0/lib/rake/task.rb:207:in invoke_prerequisites' /var/lib/gems/2.3.0/gems/rake-11.3.0/lib/rake/task.rb:186:in block in invoke_with_call_chain'
/usr/lib/ruby/2.3.0/monitor.rb:214:in mon_synchronize' /var/lib/gems/2.3.0/gems/rake-11.3.0/lib/rake/task.rb:180:in invoke_with_call_chain'
/var/lib/gems/2.3.0/gems/rake-11.3.0/lib/rake/task.rb:173:in invoke' /var/lib/gems/2.3.0/gems/rake-11.3.0/lib/rake/application.rb:152:in invoke_task'
/var/lib/gems/2.3.0/gems/rake-11.3.0/lib/rake/application.rb:108:in block (2 levels) in top_level' /var/lib/gems/2.3.0/gems/rake-11.3.0/lib/rake/application.rb:108:in each'
/var/lib/gems/2.3.0/gems/rake-11.3.0/lib/rake/application.rb:108:in block in top_level' /var/lib/gems/2.3.0/gems/rake-11.3.0/lib/rake/application.rb:117:in run_with_threads'
/var/lib/gems/2.3.0/gems/rake-11.3.0/lib/rake/application.rb:102:in top_level' /var/lib/gems/2.3.0/gems/rake-11.3.0/lib/rake/application.rb:80:in block in run'
/var/lib/gems/2.3.0/gems/rake-11.3.0/lib/rake/application.rb:178:in standard_exception_handling' /var/lib/gems/2.3.0/gems/rake-11.3.0/lib/rake/application.rb:77:in run'
/var/lib/gems/2.3.0/gems/rake-11.3.0/exe/rake:27:in <top (required)>' /usr/local/bin/rake:23:in load'
/usr/local/bin/rake:23:in `'
Tasks: TOP => redmine:plugins:migrate => environment

Hi @andrewsze
I just wonder: Why is your plugin directory in /usr/share/redmine/lib/plugins and not in /usr/share/redmine/plugins? I know that Ruby on Rails or Redmine sometimes behave strange when you do not install the plugins to the "correct" directory.
On the other hand, this might be a Ruby version issue. I will look into it anyway.
Best regards
Frederick Thomssen

Hi Frederick,
After modifying the plugins directory location, the plugin can be installed properly. Thank you for your help.
Andrew

Hi Andrew
You're welcome. I will update the readme file to make more clear that you have to use exactly the specified folders.
Best regards
Frederick Thomssen

Fixed with commit 0c07bc05f05d61d63dd0e5e0aa5df4c92e8cd514


gdu: enable tests and fix version output

Motivation for this change
Enable tests again.
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[x] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 113304 at 3d659902 run on x86_64-linux 1

1 package built:

gdu

1 suggestion:

error: no-flags-array
buildFlagsArray is only intended to be used in Bash, not as a Nix attribute.
Near pkgs/tools/system/gdu/default.nix:20:3:
   |
20 |   buildFlagsArray = [ "-ldflags=-s -w -X github.com/dundee/gdu/build.Version=${version}" ];
   |   ^

Can you mark the package broken on aarch64?

Result of nixpkgs-review pr 113304 run on x86_64-linux 1

1 package built:

gdu

Can you mark the package broken on aarch64? Or not. Not sure why ofborg failed and the other bot not.

There ware a issue with the tests on Darwin. Could be the same now with aarch64.

There ware a issue with the tests on Darwin.

Tests are still broken on darwin:
# github.com/dundee/gdu/cmd [github.com/dundee/gdu/cmd.test]
cmd/run_test.go:101:12: undefined: device.LinuxDevicesInfoGetter
cmd/run_test.go:136:12: undefined: device.LinuxDevicesInfoGetter
FAIL    github.com/dundee/gdu/cmd [build failed]

Do we want to mark it broken for darwin or merge it without that?

This PR fixes also the broken version output which was detected in https://github.com/NixOS/nixpkgs/pull/114654.

This is a semi-automatic executed nixpkgs-review with nixpkgs-review-checks extension. It is checked by a human on a best effort basis and does not build all packages (e.g. lumo, tensorflow or pytorch).
If you have any questions or problems please reach out to SuperSandro2000 on IRC.
Result of nixpkgs-review pr 113304 run on x86_64-darwin 1

1 package built:

gdu

Thanks, SuperSandro2000 for checking on darwin.


Add 'Error' response and use for default error

Replace the placeholder empty default error responses with an Error response

obsoleted by https://github.com/ansible/galaxy-api/pull/15/


installed .NET CORE SDK 3.0 on my linux 16.04 server but getting below issue while making "dotnet --info" command.

Problem encountered on https://dotnet.microsoft.com/download/linux-package-manager/ubuntu16-04/runtime-3.0.0
Operating System: Linux Ubuntu 16.04 - x64
Failed to load ▒▒=, error: /usr/share/dotnet/host/fxr/5.0.0-alpha1.19427.12/libhostfxr.so: cannot open shared object file: No such file or directory
The library libhostfxr.so was found, but loading it from /usr/share/dotnet/host/fxr/5.0.0-alpha1.19427.12/libhostfxr.so failed

Failed to load ▒▒=, error: /usr/share/dotnet/host/fxr/5.0.0-alpha1.19427.12/libhostfxr.so: cannot open shared object file: No such file or directory

Looks like you also have installed a daily build of .NET Core 5.0 which is causing trouble. Did you install using the .deb file at https://github.com/dotnet/core-sdk/ or did you use the tar.gz?

i have just simply follow the below command to install same.
1 :: wget -q https://packages.microsoft.com/config/ubuntu/16.04/packages-microsoft-prod.deb -O packages-microsoft-prod.deb
2 :: sudo dpkg -i packages-microsoft-prod.deb
3 :: sudo apt-get update
4 :: sudo apt-get install apt-transport-https
5 :: sudo apt-get install dotnet-sdk-3.0

Thanks for that. I would recommend cleaning the 16.04 machine up to ensure the 5.0.0-alpha files are removed. These steps should get you to a point where things are ok.
sudo apt remove dotnet-host # this will use the package manager to uninstall everything it knows about.
sudo rm -rf /usr/share/dotnet/ # this will remove everything the package manager doesn't know about
sudo apt-get install dotnet-sdk-3.0 # re-install the 3.0 SDK

thanks leecow, it's works fine. we can close this issue.


Build Polkassenbly front-server

Not sure how to do this with prisma but I guess we can have something like an admin password and use this in node-watcher.
Right now anyone can change anything in the DB by just knowing the IP edit: accessing it from the same cluster.

renamed it. What we need to do is what's been done here for Nomidot queries and subscriptions https://github.com/paritytech/Nomidot/pull/138/files


Proposal for documentation restructuring

Looking at the state and the direction of Xentriq currently I think we can identify the following concepts surrounding the project:

Project/Website development
Addon/Extension development
Template language

I propose the following initial restructuring to the documentation pages to reflect this:

Project development

Getting started

Composer & Docker
Eclipse (Xentriq plugin & Tiabo & SSH)

Project structure

Project addon instructions (reference addon development)

Configuration

Project
Environment

Localization
Deployment

Apache, NGINX, IIS

Templating

Tags (if, for, etc.), Links, Include & implement, variables etc...

Addons

Development

Getting started

Composer
Tiabo

Addon structure
Namespacing

Usage

Configuration
Forms, Actions

Few things;

Documentation should also contain info about the Xentriq plugin (autocompleting tags ed) somewhere.

Might be wise to have subtopics for Configuration, I think something like;
...

Configuration

Project
Environment
...

Maybe we should divide up the Addons section in to Addons and Addon Development since they will probably have different target audiences. In that case I also feel templating is a more important topic then Addon Development, so we should probably move that around.

All in all I think the suggested structure looks really good.

@ttveldhuis updated the structure above:

included a reference to Xentriq plugin under Project Development -> Getting started, we might want to move this to a separate dev tools section in the future.
Moved templating to be higher in hierarchy than Addons
Split addon into Development and usage
Added comment that project structure should also talk about adding a backend/project addon


Bump k8s-tools image

Description
Changes proposed in this pull request:

bump kubectl to 1.21.12

Related issue(s)

/assign


free space planner may collide obstacles with vehicle front

Checklist

[X] I've read the contribution guidelines.
[X] I've searched other issues and no duplicate issues were found.
[X] I'm convinced that this is not my fault but a bug.

Description
I think that the following lines shorten the forward length of the vehicle and may cause a collision.
 for (double x = back; x <= front; x += costmap_.info.resolution) {
    for (double y = right; y <= left; y += costmap_.info.resolution) {

https://github.com/autowarefoundation/autoware.universe/blob/main/planning/freespace_planning_algorithms/src/abstract_algorithm.cpp#L135-L136
It's better to guarantee that x(y) exceeds font(left) like
 for (double x = back; x <= front + costmap_.info.resolution; x += costmap_.info.resolution) {
    for (double y = right; y <= left + costmap_.info.resolution; y += costmap_.info.resolution) {

Expected behavior
The front of the vehicle does not collide with obstacles
Actual behavior
Sorry, I haven't reproduced it but the front of the vehicle may collide with obstacles.
Steps to reproduce
Sorry, I haven't reproduced it but the front of the vehicle may collide with obstacles.
Versions
No response
Possible causes
No response
Additional context
No response

cc @TakaHoribe @yukkysaito

@kosuke55 @TakaHoribe Is anyone from TIER IV going to fix the issue?

@HiroIshida  @TakaHoribe
If you can check if this is a mistake, I will send fix PR.

@kosuke55
Sorry for late reply. I will check today.

Thank you, I think you are right.

@TakaHoribe @rej55
Not urgent, but if you have time, please check https://github.com/autowarefoundation/autoware.universe/pull/985 :bow:


Avoid inferring return and yield types from unreachable statements

closes https://github.com/microsoft/TypeScript/issues/55437

I needed this just the other day.

@typescript-bot test top200
@typescript-bot user test this
@typescript-bot run dt
@typescript-bot perf test this
@typescript-bot pack this

This doesn't really work for assertion functions right?
Can you add a few tests around that?
function throws(): never {
    throw new Error();
}

export function foo() {
    throws();
    return 42;
}

export function bar() {
    var x;
    x = 1;
    if (Math.random()) {
        throws();
        return x;
    }
    x = 2;
    return x;
}

Should I just codify the current results in the test suite or would you expect those cases to work differently? It would be possible to achieve different results for them, right? I'm not sure if that's totally desirable from your PoV though.


Handle text-plain part in multipart/mixed emails

with #5 merged, the new test works for me.

Merged. Thanks for the contribution.