OOM with only ~300MB memory allocated / requested on GPU

Description
The following code crashes with OOM, even though from the error message it doesn't seem to be using or requesting much memory: on an A40 card with ~40GB of available memory, it crashes when having allocated ~340 MB and requesting ~250 MB of memory.
import jax, flax
from jax import numpy as np
from flax import linen as nn
from tqdm import trange

model = nn.Sequential([nn.Dense(50)])

@partial(jax.vmap, in_axes=(0, None))
def sample_from_prior(rng, inp):
    params = model.init(rng, np.zeros((10, 50)))
    return model.apply(params, inp)

for i in trange(1000):
    rngs = jax.random.split(jax.random.PRNGKey(23), 10000)
    sample_from_prior(rngs, np.ones((4, 50)))
    # this won't help
    # if i % 400 == 0:
    #     jax.lib.xla_bridge.get_backend().defragment()

A typical error log looks like this:
jax._src.traceback_util.UnfilteredStackTrace: jaxlib.xla_extension.XlaRuntimeError: RESOURCE_EXHAUSTED: Out of memory while trying to allocate 250000256 bytes.
BufferAssignment OOM Debugging.

I should note that this seems specific to some computation performed by flax, in particular the Sequential wrapper: it does not happen if we remove it.  Nonetheless it would be better if we don't have to work around it, and the error looks rather strange, so I hope it could get fixed some time.
What jax/jaxlib version are you using?
0.3.20, 0.3.20+cuda11.cudnn82
Which accelerator(s) are you using?
GPU
Additional system info
Python 3.9, Ubuntu 20.04.2, flax 0.6.0
NVIDIA GPU info
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 510.47.03    Driver Version: 510.47.03    CUDA Version: 11.6     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA A40          On   | 00000000:12:00.0 Off |                    0 |
|  0%   36C    P0    86W / 300W |  41147MiB / 46068MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+
|   1  NVIDIA A40          On   | 00000000:13:00.0 Off |                    0 |
|  0%   27C    P8    32W / 300W |      0MiB / 46068MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+
|   2  NVIDIA A40          On   | 00000000:14:00.0 Off |                    0 |
|  0%   27C    P8    31W / 300W |      0MiB / 46068MiB |      0%      Default |
|                               |                      |                  N/A |

# omitted below; code was using an unoccupied card.

I wasn't able to repro this. Are you able to consistently repro this error? Also, could you make sure there isn't any other process running on the GPUs?

I think so.

I can consistently reproduce this on the A40 server (CUDA 11.2), as well as another Linux server with a GTX 2080 Ti (NVIDIA drivier 510.47.03, CUDA 11.4) and the same python / package versions.  If these help: the first server is a docker instance, but the second is bare metal; my pip freeze result is here.
I checked nvidia-smi before running the program, and used CUDA_DEVICE_ORDER=PCI_BUS_ID to ensure I use the right card.

I find the crash to happen faster if we use a larger network, e.g., nn.Sequential([nn.Dense(100), nn.Dense(100)]) crashes at iteration 68, and the output is
jax._src.traceback_util.UnfilteredStackTrace: jaxlib.xla_extension.XlaRuntimeError: RESOURCE_EXHAUSTED: Out of memory while trying to allocate<PHONE_NUMBER> bytes.
BufferAssignment OOM Debugging.
BufferAssignment stats:
             parameter allocation:    78.1KiB
              constant allocation:         0B
        maybe_live_out allocation:  381.47MiB
     preallocated temp allocation:  953.67MiB
  preallocated temp fragmentation:         0B (0.00%)
                 total allocation:    1.30GiB
              total fragmentation:  190.73MiB (14.28%)

Ah I can repro now. I think this code is bound to OOM since you're creating a new NN every iteration (do you intend to do that?)

If i print(i) in the loop, it consistently OOM at step 146 on my machine and 333.86MiB* 146 = 51.5GiB, so it could be hitting total GPU memory limit.
It would seem that somehow the GPU allocations in each loop iteration are not freed, despite trying to delete things at the end of each loop
client = jax.lib.xla_bridge.get_backend()

for i in trange(1000):
    print('step=', i)
    bs = [b.shape for b in client.live_buffers()]
    print('num_live_buffers=', len(bs))
    print('live_buffers_shapes=', bs)
    rngs = jax.random.split(jax.random.PRNGKey(23), 10000)
    out = sample_from_prior(rngs, np.ones((4, 50)))
    out.block_until_ready()
    del out
    del rngs

step= 0
num_live_buffers= 0
live_buffers_shapes= []
  0%|▏                                                                                | 1/1000 [00:02<40:32,  2.43s/it]step= 1
num_live_buffers= 3
live_buffers_shapes= [(50,), (10000, 50, 50), (10000, 2)]
step= 2
num_live_buffers= 6
live_buffers_shapes= [(50,), (10000, 50, 50), (10000, 2), (50,), (10000, 50, 50), (10000, 2)]
step= 3
num_live_buffers= 9
live_buffers_shapes= [(50,), (10000, 50, 50), (10000, 2), (50,), (10000, 50, 50), (10000, 2), (50,), (10000, 50, 50), (10000, 2)]```

What made a difference as @meta-inf also mentioned is to avoid using nn.Sequential

#model = nn.Sequential([nn.Dense(50)])
model = nn.Dense(50)

Now, no more persistent GPU arrays

step= 0
num_live_buffers= 0
live_buffers_shapes= []
0%|▏                                                                                | 1/1000 [00:02<41:07,  2.47s/it]step= 1
num_live_buffers= 0
live_buffers_shapes= []
step= 2
num_live_buffers= 0
live_buffers_shapes= []
step= 3
num_live_buffers= 0
live_buffers_shapes= []
0%|▍                     ```
I'll need to dig into nn.Sequential and see why it's causing this behavior.

If you jit the function, it works.
step= 999
num_live_buffers= 2
live_buffers_shapes= [(10000, 4, 50), (10000, 2)]

Something is holding onto JAX GPU array references, and it's not clear to me why this simple nn.Sequential implementation would lead to that.
But perhaps @jax.jit + nn.Sequential is a ok workaround while I get Flax dev to look into this some more?
Full code
import jax, flax
from jax import numpy as np
from flax import linen as nn
from tqdm import trange
from functools import partial

model = nn.Sequential([nn.Dense(50)])
#model = nn.Dense(50)

@jax.jit
@partial(jax.vmap, in_axes=(0, None))
def sample_from_prior(rng, inp):
    params = model.init(rng, np.zeros((10, 50)))
    out = model.apply(params, inp)
    del params
    return out

client = jax.lib.xla_bridge.get_backend()

import gc

for i in trange(1000):
    print('step=', i)
    bs = [b.shape for b in client.live_buffers()]
    print('num_live_buffers=', len(bs))
    print('live_buffers_shapes=', bs)
    rngs = jax.random.split(jax.random.PRNGKey(23), 10000)
    out = sample_from_prior(rngs, np.ones((4, 50)))
    #gc.collect()
    #out.block_until_ready()
    #del out
    #del rngs
    #if i == 5:
    #    break

Thanks @ggdakarsingh27 @zhangqiaorjc for the comments and workaround!  I should have thought of client.live_buffers(), but I'm not sure why the BufferAssignment OOM Debugging log seems to report different things.
And FWIW, I just found it's not limited to nn.Sequential.  This also fails if (and only if) we don't jit:
class Model(nn.Module):
    @nn.compact
    def __call__(self, x):
        x = nn.Dense(200)(x)
        return nn.Dense(200)(x)

model = Model()

This bug should be fixed if you update to Flax head. See fix in https://github.com/google/flax/issues/2493

Unfortunately, while the code in the OP runs to 1000 steps for me (on an A100 w/ 40GB), following @meta-inf's thinking in this comment, a larger model like Sequential([Dense(250), Dense(250)]) still OOMs for me around step 20 with analogous BufferAssignment stats:
from functools import partial

import jax, flax
from jax import numpy as np
from flax import linen as nn
from tqdm import trange

model = nn.Sequential([nn.Dense(250), nn.Dense(250)])

@partial(jax.vmap, in_axes=(0, None))
def sample_from_prior(rng, inp):
    params = model.init(rng, np.zeros((10, 50)))
    return model.apply(params, inp)

for i in trange(1000):
    print(i)
    rngs = jax.random.split(jax.random.PRNGKey(23), 10000)
    sample_from_prior(rngs, np.ones((4, 50)))

2022-10-04 03:17:38.522221: E external/org_tensorflow/tensorflow/compiler/xla/pjrt/pjrt_stream_executor_client.cc:2130] Execution of replica 0 failed: RESOURCE_EXHAUSTED: Out of memory while trying to allocate<PHONE_NUMBER> bytes.
BufferAssignment OOM Debugging.
BufferAssignment stats:
             parameter allocation:    78.1KiB
              constant allocation:         0B
        maybe_live_out allocation:    2.33GiB
     preallocated temp allocation:    5.82GiB
  preallocated temp fragmentation:         0B (0.00%)
                 total allocation:    8.15GiB
              total fragmentation:    1.16GiB (14.29%)

(base) mattjj@matt-a100-8:~$ nvidia-smi
Tue Oct  4 03:18:22 2022
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 515.65.01    Driver Version: 515.65.01    CUDA Version: 11.7     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA A100-SXM...  Off  | 00000000:00:04.0 Off |                    0 |
| N/A   31C    P0    53W / 400W |      0MiB / 40960MiB |      0%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+

I think this is analogous because the stats show plenty of free memory, yet the allocation failed at runtime. (Please let me know if I'm misinterpreting these.)
We suspect that the reason the code in the OP now runs is that Python's garbage collection just happens to be triggered with that code. IIUC it has heuristics to trigger based on e.g. the number of new objects it sees. But if we make the sizes bigger, like in the larger model case, the Python gc doesn't trigger before we overflow GPU memory.
IIUC google/flax#2493 fixed one issue, but we still have a cyclic references problem.
A workaround for now is to add gc.collect() statements to your code, perhaps every few iterations.

I think Flax's Sequential is creating reference cycles. I modified jax/core.py's maybe_find_leaked_tracers to look like this:

Then, running the code with jax.config.update('jax_check_tracer_leaks', True), I got this:
y is a  <class 'flax.linen.linear.Dense'><PHONE_NUMBER>96608
y.parent is a <class 'flax.linen.combinators.Sequential'><PHONE_NUMBER>97568
y.parent.layers is a <class 'tuple'><PHONE_NUMBER>96416
y.parent.layers[0] is a <class 'flax.linen.linear.Dense'><PHONE_NUMBER>96608

So I think the issue is a Flax reference cycle. We're talking with the friendly Flax devs to brainstorm a fix! But in the meantime, just doing some gc.collect() would solve things as a workaround.

We forgot to update this issue, but we believe this was fixed last week in google/flax#2499. I'll leave it open until one of us can verify the original code doesn't reproduce the issue.

I just checked the fix; it works on all cases.  Thanks!


Fails with Python 3

My system have Python 3 installed by default (Archlinux). This is the output of accloudtant report:
Traceback (most recent call last):
  File "/usr/bin/accloudtant", line 22, in <module>
    cli()
  File "/usr/lib/python3.5/site-packages/click/core.py", line 716, in __call__
    return self.main(*args, **kwargs)
  File "/usr/lib/python3.5/site-packages/click/core.py", line 696, in main
    rv = self.invoke(ctx)
  File "/usr/lib/python3.5/site-packages/click/core.py", line 1060, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/lib/python3.5/site-packages/click/core.py", line 889, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/lib/python3.5/site-packages/click/core.py", line 534, in invoke
    return callback(*args, **kwargs)
  File "/usr/bin/accloudtant", line 19, in report
    click.echo(Reports())
  File "/usr/lib/python3.5/site-packages/click/utils.py", line 221, in echo
    message = text_type(message)
  File "/usr/lib/python3.5/site-packages/accloudtant/aws/reports.py", line 69, in __repr__
    instance.name,
  File "/usr/lib/python3.5/site-packages/accloudtant/aws/instance.py", line 68, in name
    return names[0]['Value']
IndexError: list index out of range

I can't verify that it works well on Python 2 so fell free to close this issue and open a new one if the problem is not caused by the Python version.

I think this is not related with Python version, but a bug located in https://github.com/ifosch/accloudtant/blob/master/accloudtant/aws/instance.py#L65 where names is not None but an empty list ([]), which doesn't have the first element. Could this happen because you have some unnamed instances?

@ifosch exactly, we don't add names to instances inside autoscaling groups.


HlLL get_rel_err() fix

check lgk range
handle > 12

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

4 of 6 (66.67%)  changed or added relevant lines in 2 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.008%) to 97.133%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

cpc/include/cpc_confidence.hpp
0
2
0.0%

Totals

Change from base Build<PHONE_NUMBER>:
-0.008%

Covered Lines:
4912

Relevant Lines:
5057

💛  - Coveralls


ENH: Add squared exponential covariance kernel

Add squared exponential covariance kernel.

The remaining comments in https://github.com/nipreps/eddymotion/pull/188#issuecomment-2118215168 and https://github.com/jhlegarreta/eddymotion/pull/1 will be addressed in this PR.

I've added the valuable text in the docstrings into #216 so they are not lost. When we implement multi-shell, we can come back to this one for inspiration on the missing bits.
Closing in favor of the omnibus PR (#216). Please reopen if that doesn't feel okay.


Getting @wdio/cli: [0-0] SKIPPED in chrome, one spec file skipped

Hello,
I just started using wdi5 and trying to setup and run a simple spec file to open a browser and validate title as mentioned in your example, but getting below response without any error or warnings. Tried lot of permutations and combinations but nothing worked.
$ npx wdio

Execution of 1 spec files started at 2022-04-07T18:21:59.761Z

2022-04-07T18:21:59.764Z DEBUG @wdio/utils:initialiseServices: initialise service "chromedriver" as NPM package
2022-04-07T18:21:59.828Z INFO @wdio/cli:launcher: Run onPrepare hook
Starting ChromeDriver 100.0.4896.60 (6a5d10861ce8de5fce22564658033b43cb7de047-refs/branch-heads/4896@{#875}) on port 9515
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully.
2022-04-07T18:22:00.374Z INFO @wdio/cli:launcher: Run onWorkerStart hook
2022-04-07T18:22:00.375Z INFO @wdio/local-runner: Start worker 0-0 with arg:
[0-0] 2022-04-07T18:22:01.033Z INFO @wdio/local-runner: Run worker command: run
[0-0] 2022-04-07T18:22:01.038Z DEBUG @wdio/local-runner:utils: init remote session
[0-0] 2022-04-07T18:22:01.040Z INFO webdriverio: Initiate new session using the ./protocol-stub protocol
2022-04-07T18:22:01.560Z DEBUG @wdio/local-runner: Runner 0-0 finished with exit code 0
2022-04-07T18:22:01.561Z INFO @wdio/cli: [0-0] SKIPPED in chrome - C:\Users\xyz-workspace\ui5app\ui\webapp\test\e2e\specs\basic.spec.js
2022-04-07T18:22:01.561Z INFO @wdio/cli:launcher: Run onComplete hook

Spec Files:      0 passed, 1 skipped, 1 total (100% completed) in 00:00:01

2022-04-07T18:22:01.563Z INFO @wdio/local-runner: Shutting down spawned worker
2022-04-07T18:22:01.828Z INFO @wdio/local-runner: Waiting for 0 to shut down gracefully
2022-04-07T18:22:01.828Z INFO @wdio/local-runner: shutting down

My wdio.conf.js is
exports.config = {
    wdi5: {
        screenshotPath: join("webapp","test", "e2e", "screenshots"), // [optional] {string}, default: ""
        screenshotsDisabled: false, // [optional] {boolean}, default: false; if set to true, screenshots won't be taken and not written to file system
        logLevel: "error", // [optional] error | verbose | silent, default: "error"
        url: "", // [mandatory] {string} name of your bootstrap html file. If your server autoredirects to a 'domain:port/'-like root url, use empty string ''
        skipInjectUI5OnStart: false, // [optional] {boolean}, default: false; true when UI5 is not on the start page, you need to later call <wdioUI5service>.injectUI5() manually
        waitForUI5Timeout: 15000 // [optional] {number}, default: 15000; maximum waiting time in milliseconds while checking for UI5 availability
      },
    // Patterns to exclude.
    exclude: [
        // 'path/to/excluded/files'
    ],
    specs: [
        "./webapp/test/e2e/specs/*.spec.js"
    ],
    maxInstances: 10,
    capabilities: [{
        maxInstances: 5,
        browserName: 'chrome',
        acceptInsecureCerts: true,
        "goog:chromeOptions": {
            args: process.env.DEBUG ? ["--auto-open-devtools-for-tabs"] : [],
            prefs: {
              directory_upgrade: true,
              prompt_for_download: false
            }
          }
    }],

    logLevel: 'trace',
    bail: 0,

    baseUrl: 'https://google.com',

    waitforTimeout: 10000,
    connectionRetryTimeout: 120000,
    connectionRetryCount: 3,
    services: [
     "chromedriver",
    "ui5"],

    framework: 'jasmine',

    reporters: ['spec'],

    jasmineOpts: {
        // Jasmine default timeout
        defaultTimeoutInterval: 60000,
        expectationResultHandler: function(passed, assertion) {
            // do something
        }
    }

package.json
"engines": {
    "node": "12.x"
  },
  "devDependencies": {
    "@wdio/cli": "^6.4.0",
    "@wdio/jasmine-framework": "^6.4.0",
    "@wdio/local-runner": "^6.4.0",
    "@wdio/spec-reporter": "^6.4.0",
    "browserify": "16.5.2",
    "chromedriver": "^100.0.0",
    "colors": "1.4.0",
    "express": "4.17.1",
    "grunt": "1.0.3",
    "grunt-cli": "1.3.2",
    "grunt-karma": "3.0.2",
    "grunt-string-replace": "1.3.1",
    "jasmine-core": "3.6.0",
    "karma": "5.1.1",
    "karma-browserify": "6.1.0",
    "karma-chrome-launcher": "3.1.0",
    "karma-cli": "2.0.0",
    "karma-coverage": "2.0.1",
    "karma-html-reporter": "0.2.7",
    "karma-jasmine": "2.0.1",
    "karma-junit-reporter": "1.2.0",
    "karma-openui5": "0.2.3",
    "karma-qunit": "4.1.1",
    "karma-ui5": "1.2.0",
    "karma-webdriver-launcher": "1.0.8",
    "nodemon": "2.0.6",
    "qunit": "2.10.0",
    "rimraf": "2.7.1",
    "start-server-and-test": "1.11.3",
    "watchify": "3.11.1",
    "wdio-chromedriver-service": "^6.0.4",
    "wdio-ui5-service": "^0.6.2",
    "webdriverio": "6.4.0"
  }

Hi Siddarth,
it seems like something is a little bit off with your spec file. In the console log you can actually see, that it skips your tests:
Spec Files:      0 passed, 1 skipped, 1 total (100% completed) in 00:00:01
Could you maybe share your spec file as well?
A few more things I noticed with your config:

your current wdio-ui5-service version is not up to date. As we made - and still will - a lot of changes in the last couple of weeks we recommend to update the module regularly as long as we have not reached our 1.0.0 release.
it seems like for your first dummy test you just want to open google.com and check for the title. Unfortunately you can't use wdi5 for this, as it is a non UI5 application. WDI5 needs a UI5 application to be used in a meaningful way. If you start your tests with a non ui5 application and only later navigate to an UI5 Application you should set skipInjectUI5OnStart: true and later on inject WDI5 as described here

Regards
Simon

Hell Simon,
Thanks for looking. I made few changes, upgraded dependencies to the latest and set base URL to https://sapui5.hana.ondemand.com/
upgraded depdencies
  "devDependencies": {
    "@wdio/cli": "^7.19.3",
    "@wdio/jasmine-framework": "^7.19.3",
    "@wdio/local-runner": "^7.19.3",
    "@wdio/spec-reporter": "^7.19.1",
    "browserify": "16.5.2",
    "chromedriver": "^100.0.0",
    "colors": "1.4.0",
    "express": "4.17.1",
    "grunt": "1.0.3",
    "grunt-cli": "1.3.2",
    "grunt-karma": "3.0.2",
    "grunt-string-replace": "1.3.1",
    "jasmine-core": "3.6.0",
    "karma": "5.1.1",
    "karma-browserify": "6.1.0",
    "karma-chrome-launcher": "3.1.0",
    "karma-cli": "2.0.0",
    "karma-coverage": "2.0.1",
    "karma-html-reporter": "0.2.7",
    "karma-jasmine": "2.0.1",
    "karma-junit-reporter": "1.2.0",
    "karma-openui5": "0.2.3",
    "karma-qunit": "4.1.1",
    "karma-ui5": "1.2.0",
    "karma-webdriver-launcher": "1.0.8",
    "nodemon": "2.0.6",
    "qunit": "2.10.0",
    "rimraf": "2.7.1",
    "start-server-and-test": "1.11.3",
    "watchify": "3.11.1",
    "wdio-chromedriver-service": "^7.3.2",
    "wdio-ui5-service": "^0.9.0-rc3",
    "webdriverio": "^7.19.3"

basic.test.js
const Main = require("../pageObjects/Main")

describe("ui5 basic", () => {
    before(async () => {
        await Main.open()
    })

    it("should have the right title", async () => {
        const title = await browser.getTitle()
        expect(title).toEqual("Sample UI5 Application")
    })
});

Main.js
const { wdi5 } = require("wdio-ui5-service")
module.exports = class Main {
    async open(path) {
        wdi5.goTo(path)
    }
}

I am still getting the same response. Not sure what is missing now.
$ npx wdio

Execution of 1 workers started at 2022-04-08T09:47:18.847Z

2022-04-08T09:47:18.850Z DEBUG @wdio/utils:initialiseServices: initialise service "chromedriver" as NPM package
2022-04-08T09:47:18.932Z DEBUG @wdio/utils:initialiseServices: initialise service "ui5" as NPM package
2022-04-08T09:47:19.006Z INFO @wdio/cli:launcher: Run onPrepare hook
2022-04-08T09:47:19.010Z INFO chromedriver: Start Chromedriver (C:\Users\abc-workspace\xyz\ui\node_modules\chromedriver\lib\chromedriver\chromedriver.exe) with args --port=9515 --url-base=/
2022-04-08T09:47:19.757Z INFO chromedriver: Starting ChromeDriver 100.0.4896.60 (6a5d10861ce8de5fce22564658033b43cb7de047-refs/branch-heads/4896@{#875}) on port 9515
2022-04-08T09:47:19.758Z INFO chromedriver: Only local connections are allowed.
2022-04-08T09:47:19.759Z INFO chromedriver: Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
2022-04-08T09:47:19.772Z INFO chromedriver: ChromeDriver was started successfully.
2022-04-08T09:47:19.818Z DEBUG @wdio/cli:utils: Finished to run "onPrepare" hook in 811ms
2022-04-08T09:47:19.819Z INFO @wdio/cli:launcher: Run onWorkerStart hook
2022-04-08T09:47:19.820Z DEBUG @wdio/cli:utils: Finished to run "onWorkerStart" hook in 0ms
2022-04-08T09:47:19.821Z INFO @wdio/local-runner: Start worker 0-0 with arg:
[0-0] 2022-04-08T09:47:20.637Z INFO @wdio/local-runner: Run worker command: run
[0-0] 2022-04-08T09:47:20.645Z DEBUG @wdio/config:ConfigParser: No compiler found, continue without compiling files
[0-0] 2022-04-08T09:47:20.651Z DEBUG @wdio/local-runner:utils: init remote session
[0-0] 2022-04-08T09:47:20.656Z DEBUG @wdio/utils:initialiseServices: initialise service "chromedriver" as NPM package
[0-0] 2022-04-08T09:47:20.765Z DEBUG @wdio/utils:initialiseServices: initialise service "ui5" as NPM package
2022-04-08T09:47:21.170Z DEBUG @wdio/local-runner: Runner 0-0 finished with exit code 0
2022-04-08T09:47:21.170Z INFO @wdio/cli: [0-0] SKIPPED in chrome - C:\Users\abc-workspace\xyz\ui\webapp\test\e2e\specs\basic.test.js
2022-04-08T09:47:21.171Z INFO @wdio/cli:launcher: Run onWorkerEnd hook
2022-04-08T09:47:21.171Z DEBUG @wdio/cli:utils: Finished to run "onWorkerEnd" hook in 0ms
2022-04-08T09:47:21.172Z INFO @wdio/cli:launcher: Run onComplete hook
2022-04-08T09:47:21.172Z DEBUG @wdio/cli:utils: Finished to run "onComplete" hook in 0ms

Spec Files:      0 passed, 1 skipped, 1 total (100% completed) in 00:00:02

2022-04-08T09:47:21.174Z INFO @wdio/local-runner: Shutting down spawned worker
2022-04-08T09:47:21.429Z INFO @wdio/local-runner: Waiting for 0 to shut down gracefully
2022-04-08T09:47:21.429Z INFO @wdio/local-runner: shutting down

Hi Siddarth,
I had a look at you're spec file and I think we have 2 Problems here:
The main reason why your test is not executed, is the before function. In your configuration file you decided to use jasmine and in jasmine there is no before function . This function only exists in mocha, which we use in all our tests. The equivalent function in Jasmine would be beforeAll.
The second problem, after you use the correct before function, will be in your Main.js. You have to instantiate the pageObject otherwise this will not work. Your file could look something like this:
const { wdi5 } = require("wdio-ui5-service");

class Main {
    async open(path) {
        wdi5.goTo(path);
    }
}

module.exports = new Main();

I hope this will help you to solve the problem.
Best regards,
Simon

@siddharthmlk still a thing? Or solved with the last answer from @Siolto ?


ECDSA should use new prime type constraint

https://github.com/GaloisInc/cryptol-specs/blob/f60e109f176d10d6868ddf4cd029c80d1addf2f2/Primitive/Asymmetric/Signature/ECDSA/ECDSA.cry#L74
rather:
 type constraint Constraints a = (fin a, prime a, a >= 4)

This was added in #96!


Case 6 date_onset and date_quarantine

I can't read Korean, but this report seems to indicate that Case #6 was quarantined on Jan 27 and symptomatic before then. I'd appreciate it if you could confirm or deny. (This repo is excellent, thanks for your work!)
https://www.cdc.go.kr/board/board.es?mid=a20501000000&bid=0015

Hi,
Thank you very much for noticing. I had missed that Case #6 was under self-isolation. I didn't enter the onset date because they did not report the exact date. Would it be useful if I made an extra column for ranges of possible onset dates? By the way, all links from KCDC are broken; that link sends me to the list of reports. It'd be great if you can send me the report number. Meanwhile, here's the list of reports that I used (see KCDC_no column):

Article 3625 (Jan 30) reported that Case #6 was confirmed and quarantined on the same day:

"여섯 번째 환자(56세 남자, 한국인)는 세 번째 환자의 접촉자로 능동감시 중 시행한 검사 결과, 검사 양성이 확인되어 금일 서울대병원에 격리조치 되었다."

Article 3630 (Jan 31) reported that Case #6 had a meal with Case #3 on Jan 22. On Jan 26, Case #6 was classified as a close contact of Case #3 and had been under active-surveillance:

"6번째 환자(55세 남자, 한국인)는 1월 22일 한일관(서울 강남구 소재)에서 3번째 환자와 함께 식사를 하였으며, 1월 26일 3번째 환자 확진 후 접촉자로 분류되어 능동감시가 실시 중이었다."

Article 3632 (Feb 1) reported that case Case #6 visited church after symptom onset but had been under self-isolation since Jan 27:

"환자는 증상 발현 후 교회를 방문한 바 있으나, 1월 27일 3번째 확진환자 접촉자로 통보 받은 이후 자가격리 상태였다."

Article 3695 (Feb 19) reported that Case #6 will be discharged on the same day:

"6번째, 10번째, 16번째, 18번째 환자 총 4명 금일 추가 격리해제 예정"
I have updated the spreadsheet to include the self-isolation date.

It would be useful if you made an extra column for ranges of possible onset dates!
I was trying to send you Article 3632. I'll keep that in mind if I have any other issues in the future.
Thanks for the quick response!

No problem. Thank you as well! I will try to add new columns tonight. Please let me know if you have any other questions.

Sorry, I got distracted with other work and couldn't get to this earlier. I added date_onset_max column and am currently filling it out... I added date_onset_min column as well but it's currently empty as it's often not reported. I would probably assume  date_contact_min==date_onset_min for now. Or I would probably use a latent variable approach and draw a uniform random variable from the date of infection (another latent variable) to date_onset_max...

No prob! We just finished up a resubmission of a paper, where we collected a lot of this kind of data (final dataset is here https://github.com/HopkinsIDD/ncov_incubation/blob/master/data/nCoV-IDD-traveler-data.csv). We left unknown fields blank then deal with them in the data cleaning code (https://github.com/HopkinsIDD/ncov_incubation/blob/master/manuscript/nCoV_Incubation.Rmd). We also describe our data collection and cleaning procedure in our paper, which will hopefully be accepted soon (here's the preprint https://www.medrxiv.org/content/10.1101/2<IP_ADDRESS>20016v1). I hope those can give you some ideas for how to fill things out going forward. Keep up the good work!

Looks awesome. Thanks for sharing!


Add shift resource bindings in Vulkan

Hi @gongminmin ,
I added 4 new parameters in Options struct:
int shiftAllTexturesBindings: First binding number for Vulkan textures.
int shiftAllSamplersBindings: First binding number for Vulkan samplers.
int shiftAllCBuffersBindings: First binding number for Vulkan constant buffers.
int shiftAllUABuffersBindings: First binding number for Vulkan unordered access buffers.
It is equivalent to use -fvk-{b|s|t|u}-shift in DXC command-line. That is a very important option when you compile HLSL to SPIRV HLSL register and Vulkan binding.
Finally, I inverted packMatricesInRowMajor option to fix the issue.
Resolve #37
Resolve #41

I restart the CI but it's still fail. The problem is you need to update the expected test results under Source\Tests\Data\Expected to reflect your changes to -Zpr.


Mixin Parse error: $breadcrumbs-item-separator-item-rtl using leafo/scssphp

What should happen?
I'm using https://github.com/leafo/scssphp to compile the foundation scss.
I get the final css properly rendered.
What happens instead?
Parse error with mixin for components > breadcrumbs:
Parse error: parse error: failed at `$breadcrumbs-item-separator-item-rtl: '\\' !default;` components/_breadcrumbs.scss on line 52

Possible Solution

If I change it to this, it works fine:
$breadcrumbs-item-separator-item-rtl: "\\" !default;

I can always adjust it myself, but would be great if it can be solved in the Foundation mixin.
Same fragment is in _settings file too.
I know foundation explicitly changed to single quotes, but these give different results:
'\\' != "\\"
Test Case and/or Steps to Reproduce (for bugs)

Test Case:

How to reproduce:
1.
2.
3.
Context

Your Environment

Foundation version(s) used: 6.5.0
Browser(s) name and version(s): Safari 12
Device, Operating System and version: Mac
Link to your project: compiled by scssphp v0.7.6

Checklist

[ x] I have read and follow the CONTRIBUTING.md document.
[ x] There are no other issues similar to this one.
[x ] The issue title and template are correctly filled.

_settings is generated from the other files for each release

Related to https://github.com/zurb/foundation-sites/issues/7204
I would agree with @gakimball that said the following 3 years ago:

Unfortunately the only two Sass compilers we support are Ruby Sass and Libsass. There is a PHP port of Libsass, but it doesn't appear to be under active development.
I would report this issue to the scssphp developers, as the behavior is inconsistent with Ruby Sass.

There is enough difficulties with trying to support both RubySass, libSass and now Dart Sass. We cannot add to this scssphp. Our Sass code is valid, please report the issue to scssphp (poke @robocoder).

Won't fix. Closing.


fix: Properly show readme images

Reason: Images dropped in #3 are not accessible due to JWT rotation
This had the effect of making the images not shown in the README, at least for non JetBrains org I think.
By uploading them in the repo itself this should work without jwt

Thanks for reporting the problem.
The images stopped working for me as well. But I was planning on updating them anyway (new logo), so once I do that, I will re-upload them into the repository.


Adding options for disabling and enabling tabbable elements

These new functions are useful for disabling tabbing functionality behind modals, or in any other logical group.
One would either use this before creating a modal:
$.disableTabbing();

or if the element exists on the page:
$.disableTabbing({exclude: $(".modal")});

Either way, using this will return the page to normal:
$.enableTabbing();

It's important to note my changes update a core filter in jQuery, :hidden. It incorrectly includes inline elements with 0 offsetHeight & offsetWidth. I'm happy to resubmit without it, but in testing it seems core that it needs to be done. I've submitted a bug to jQuery on the matter.
Future updates:
I'll likely teach tabIndexes[] to keep track of when the index doesn't actually exist as an attribute so it doesn't get added to elements which didn't have it previously.

@marklagendijk We had discussed via email regarding transferring this repo?


Unable to run a prediction on custom image not following the TF V1 REST API

/kind bug
What steps did you take and what happened:
Deployed a prebuilt image of codait/max-object-detector from this WIP PR here https://github.com/kubeflow/kfserving/pull/698
The Max Object Detector api server expects a POST request to the /model/predict endpoint and does not follow the TF V1 REST API
Try to run a prediction using the inference service  but get a 404.
MODEL_NAME=custom-prebuilt-image
CLUSTER_IP=$(kubectl -n istio-system get service istio-ingressgateway -o jsonpath='{.status.loadBalancer.ingress[0].ip}')
SERVICE_HOSTNAME=$(kubectl get inferenceservice ${MODEL_NAME} -o jsonpath='{.status.url}' | cut -d "/" -f 3)
curl -v -F<EMAIL_ADDRESS>http://${CLUSTER_IP}/model/predict -H "Host: ${SERVICE_HOSTNAME}"
*   Trying <IP_ADDRESS>...
* TCP_NODELAY set
* Connected to <IP_ADDRESS> (<IP_ADDRESS>) port 80 (#0)
> POST /model/predict HTTP/1.1
> Host: custom-prebuilt-image.default.example.com
> User-Agent: curl/7.64.1
> Accept: */*
> Content-Length: 125759
> Content-Type: multipart/form-data; boundary=------------------------5edc0fa1ae51c04d
> Expect: 100-continue
>
< HTTP/1.1 100 Continue
* We are completely uploaded and fine
< HTTP/1.1 404 Not Found
< date: Mon, 02 Mar 2020 23:05:22 GMT
< server: istio-envoy
< connection: close
< content-length: 0
<
* Closing connection 0

What did you expect to happen:
Able to run a prediction using the custom image.
Anything else you would like to add:
Related to #684
custom-prebuilt-image.default.example.com maps to custom-prebuilt-image-predictor-default.default.example.com only when prefix /v1/models/custom-prebuilt-image:predict is matched so running the prediction on the custom container does not work.
Http:
    Match:
      Uri:
        Prefix:  /v1/models/custom-prebuilt-image:predict

k describe virtualservice custom-prebuilt-image
Name:         custom-prebuilt-image
Namespace:    default
Labels:       controller-tools.k8s.io=1.0
Annotations:  kubectl.kubernetes.io/last-applied-configuration:
                {"apiVersion":"serving.kubeflow.org/v1alpha2","kind":"InferenceService","metadata":{"annotations":{},"labels":{"controller-tools.k8s.io":"...
API Version:  networking.istio.io/v1alpha3
Kind:         VirtualService
Metadata:
  Creation Timestamp:  2020-02-26T18:12:03Z
  Generation:          1
  Owner References:
    API Version:           serving.kubeflow.org/v1alpha2
    Block Owner Deletion:  true
    Controller:            true
    Kind:                  InferenceService
    Name:                  custom-prebuilt-image
    UID:                   c5a4288c-1a3f-4681-9307-48f22ddda67a
  Resource Version:        15100679
  Self Link:               /apis/networking.istio.io/v1alpha3/namespaces/default/virtualservices/custom-prebuilt-image
  UID:                     152ddbd2-2400-41de-8cb3-de3119c6f19b
Spec:
  Gateways:
    kubeflow-gateway.kubeflow
  Hosts:
    custom-prebuilt-image.default.example.com
  Http:
    Match:
      Uri:
        Prefix:  /v1/models/custom-prebuilt-image:predict
    Route:
      Destination:
        Host:  istio-ingressgateway.istio-system.svc.cluster.local
        Port:
      Headers:
        Request:
          Set:
            Host:  custom-prebuilt-image-predictor-default.default.example.com
      Weight:      100
Events:            <none>

Environment:

Istio Version:
Knative Version:
KFServing Version:
Kubeflow version:
Minikube version:
Kubernetes version: (use kubectl version):
OS (e.g. from /etc/os-release):

This has been relaxed and should be fixed in v0.3.0
/close

Hi there
I am using KFServing 0.3.0 and am still running into this problem.
I installed locally using kind and the install script.
Following the instructions:
(in both cases below, using port-forwarding for the svc/istio-ingressgateway 8080->80)
SERVICE_HOSTNAME=$(kubectl get inferenceservice -n kfserving-test ${MODEL_NAME} -o jsonpath='{.status.url}' | cut -d "/" -f 3)
curl -v -F<EMAIL_ADDRESS>http://localhost:8080/model/predict -H "Host: ${SERVICE_HOSTNAME}"

*   Trying ::1...
* TCP_NODELAY set
* Connected to localhost (::1) port 8080 (#0)
> POST /model/predict HTTP/1.1
> Host: custom-prebuilt-image.kfserving-test.example.com
> User-Agent: curl/7.64.1
> Accept: */*
> Content-Length: 125759
> Content-Type: multipart/form-data; boundary=------------------------4c769b79c488a061
> Expect: 100-continue
>
< HTTP/1.1 100 Continue
< HTTP/1.1 404 Not Found
< date: Tue, 21 Jul 2020 12:53:35 GMT
< server: istio-envoy
< connection: close
< content-length: 0
<

If I use the "old" bypass (from the PR), it does work (so the service is working):
SERVICE_HOSTNAME=$(kubectl get route -n kfserving-test custom-prebuilt-image-predictor-default -o jsonpath='{.status.url}' | cut -d "/" -f 3)

echo $SERVICE_HOSTNAME
custom-prebuilt-image-predictor-default.kfserving-test.example.com

curl -v -F<EMAIL_ADDRESS>http://localhost:8080/model/predict -H "Host: ${SERVICE_HOSTNAME}"

*   Trying ::1...
* TCP_NODELAY set
* Connected to localhost (::1) port 8080 (#0)
> POST /model/predict HTTP/1.1
> Host: custom-prebuilt-image-predictor-default.kfserving-test.example.com
> User-Agent: curl/7.64.1
> Accept: */*
> Content-Length: 125759
> Content-Type: multipart/form-data; boundary=------------------------1084efc30d1fd797
> Expect: 100-continue
>
< HTTP/1.1 100 Continue
* We are completely uploaded and fine
< HTTP/1.1 200 OK
< content-length: 380
< content-type: application/json
< date: Tue, 21 Jul 2020 12:56:08 GMT
< server: istio-envoy
< x-envoy-upstream-service-time: 4257
<
{"status": "ok", "predictions": [{"label_id": "1", "label": "person", "probability": 0.9440352320671082, "detection_box": [0.12420991063117981, 0.12507185339927673, 0.8423266410827637, 0.5974075794219971]}, {"label_id": "18", "label": "dog", "probability": 0.8645509481430054, "detection_box": [0.10447663068771362, 0.17799147963523865, 0.8422801494598389, 0.7320016622543335]}]}
* Connection #0 to host localhost left intact
* Closing connection 0

@MLnick we are publishing KFServing 0.4 now so the doc is reflecting how it works in 0.4. Yes in 0.3 you have to get the host for custom-prebuilt-image-predictor-default.

Ah I see, thanks @yuzisun


Missing mediaTypes/knownMediaTypes

In FormRecognizer:
https://github.com/iscai-msft/azure-rest-api-specs/blob/4cacb377a71fff18cb90276f0158e1e7588fa52e/specification/cognitiveservices/data-plane/FormRecognizer/preview/v2.0/FormRecognizer.json#L217-L223
I would expect to see:

the full list of mediaTypes of "consumes"
solved knownMediaType: JSON + bytes

Where I see JSON for now only:

After talking with @lmazuel  on this, I think we'll have to infer multiple distinct requests for this operation.
This either means that Operation in the code model will have to support multiple possible Requests  (ie, Array<Request> (which means generating overloads or a suitable experience in a given language)
All the  Responses/Exceptions  would all apply to all the Requests  - if that's not what's required, the spec would have to split the operation into separate operations using x-ms-paths and a ?Binary  and ?Json suffixes.
Conversely, this effect could be synthesized with #162 and grouping two operations into one logical grouping (and would still have to have the same Response/Exceptions for the logical operation.

Hmm. That still wouldn't clearly solve the different payloads tho'
We're going to have to do #162 to fix this either way, since assuming binary stream payload based solely on mediatype is IMHO a bit dangerous

4.7.207+ has the new media type/multi request modeling

Didn't try yet, will soon!

Fixed


reverse chaining (_has parameter)

Is your feature request related to a problem? Please describe.
reverse chaining (_has parameter)
Describe the solution you'd like
This feature was introduced to FHIR Searchin STU3. Its very useful for implementing queries like "find me all the patients that have a condition with a code of xyz".
https://www.hl7.org/fhir/search.html#has
the format is like: Patient?_has:Condition:patient:code=xyz
Describe alternatives you've considered
None, standards based
Additional context
Original Git Issue  reverse chaining (_has parameter) #458

I've deployed these changes and tested reverse chaining with the following queries like the following:
get(base + '/Patient?gender=female' + '&' + '_has:Condition:patient:code=http://snomed.info/sct|44054006' + '&_count=1')


Changed request to use the right access token solving #118

Changed request to use the right access token solving #118

Coverage remained the same at 100.0% when pulling 0d23514b410e3733a31a4ded040b4eb152551f0c on waldekmastykarz:fix-auth-app into a771a94c162273162c6e7170be384c969066af99 on SharePoint:dev.

Merged manually


Pressure perturbation equation

Hello,
I'm working with the dynamic pressure perturbation equation (Laplacian of p = -roh*((dudx)**2+(dvdy)**2+(dwdz)**2)). At small scales, what boundary conditions, mxLoop, and tolerance would you reccomend?

Hi, you can use latex here.  So the equation looks like:
\nabla^2 p = - \rho \left[\left(\frac{\partial u}{\partial x}\right)^2 + \left(\frac{\partial v}{\partial y}\right)^2 + \left(\frac{\partial w}{\partial z}\right)^2\right]

For mxLoop and tolerance, both determine the end of iteration.  So larger mxLoop or smaller tolerance will give you a more converged result (this case is certainly convergent).  You could practice with different parameters to see if the final results change a lot or not.  If the difference is invisible, then it could be very close to the solution.  For extreme case, you could use mxLoop=1 and compare the result with mxLoop=10, you will see very large difference.
For boundary conditions (BCs), it is a bit complex.

If your domain is global, then just use periodic in the zonal and extend in the meridional;
For regitional case, the solutions heavily depend on your BCs.  See here for a discussion.  Physically, the Laplacian operator is a smooth operator.  So the forcing (on the right-hand-side of equation) outside the domain will also influence the solution inside, right through the BCs.  So without setting the forcing outside the domain, you cannot uniquely determine the solution.  But there are a lot of papers talking about solving Poission equation in a limited region.  All of them focus on how to specify the BCs.  You can search them on google.
But if you could specified the "observed" pressure anomaly at boundaries, then you can get the solution close to what you expect.

Just remember that the solution has two parts: one induced by BCs, and the other induced by forcings on the r.h.s.  The one induced by BCs could be understood as that induced by forcings outside the region.

So mxLoop=1 is an extreme and likely not producing a converged result?

mxLoop=1 means you only iterate one time and then break the loop of iteration.  If the equation is exactly Poisson-type, it should converge.


feat: icao

@fOppenheimer any progress on this?

Hello @janhoffmann,
we can't decide it ourselves, we have to wait for some customer decisions.

@fOppenheimer
"Customer" = RKI/BMG
or
"Customer" = Testing stations
?

"Customer" = RKI/BMG

@fOppenheimer any progress on this?


responsive figs

@jread-usgs
.svgFig had a width declaration on it in the mobile CSS area, removed it from the mobile area and inside the media query for 768px. The svg now responds to all screen sizes.

@mwernimont still seeing clipping

That also wasn't there yesterday. Did you add the svgFig class to it?

my bad. I must not have deleted the template/layout target. 👍


Fixed The Index in the Map Function

What does this PR do?
While running locally there is a Console error in key field.
In this modified code, I replaced (index) with (_, index) in the map function, which ensures that each element has a unique key based on its index.

Type of change
Before

After

Bug fix (non-breaking change which fixes an issue)

Awesome 🔥

Do you also want to remove the unwanted lines from the console?

Yeah. If you can do that. Why not

ok give me a moment ;)

I was thinking about adding tags to it. If you can help with that @ArnabBCA


Subscription Type Support

The transfer hub page - https://docs.microsoft.com/en-us/azure/cost-management-billing/manage/subscription-transfer - lists new offer in Azure CSP Azure Plan as a supported offer, detailed as MPA. Which links to this page. But for clarity, there is no MPA listed on the supported sub types section. Could this be clarified please? Or does the listing of Azure Plan now mean transfer requests are supported for sources such as MCA to CSP Azure Plan MPA?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 39e27055-9b5c-3fb6-2a01-912ebbc302dc
Version Independent ID: 13e129d7-0973-3a10-4b1b-5a8da7f0a03d
Content: Azure subscription and reservation transfer hub
Content Source: articles/cost-management-billing/manage/subscription-transfer.md
Service: cost-management-billing
Sub-service: billing
GitHub Login: @bandersmsft
Microsoft Alias: banders

@wedoazure Thanks for your comment. We will review the issue and get back to you shortly.

@bandersmsft For visibility.


 The divisions are different than what you have in dataframe.from_pandas. More critically, the indices repeat from chunk to chunk which causes dataframe.concatto not be able to concat properly when you have more than 1 chunk.
Thanks for your consideration.

This looks great.  Is there an integrated test we can add for the dd.from_bcolz function to make sure that this good behavior doesn't get reverted by future work?

I added an assert test to make sure that when the dataframe is imported, the index is correct.
Have a look.

This looks great to me.  Merging.
Thanks @thequackdaddy


Fix styled components rendering issues

This PR is intended to fix the issues with styled-components not rendering properly on page loads

I notice we have the chore: updates graphql schema bundled into this PR. Can we split out a PR for validating the graphql schema is in sync with the sqitch schema definitions + graphile plugins?

I notice we have the chore: updates graphql schema bundled into this PR. Can we split out a PR for validating the graphql schema is in sync with the sqitch schema definitions + graphile plugins?

Yeah I can do that but I seem have a knowledge gap as to why we would want to validate the graphql schema is in sync with the sqitch schema definitions + graphile plugins and why it can't be included in this PR.

why it can't be included in this PR
No concerns with it being in this PR; part of the peer review process is identifying opportunities for improvement. A guardrail would ensure we end up having changes merged as logic units: clearly the chore done here was missed when the schema was last updated.

Manually tested & looking great


Return string to allow string parsing

Hubot-Slack attempts to replace any @ notifications using String.replace. Returning a number breaks that functionality.
Changed to return a string

OK. But you should not edit *.js.

Thanks, Kamran.


Stacked column legend toggle does not work on builds beyond 1.1.2

The example at: bit.ly/1D0EAEN does not work on builds above version 1.1.2. If I use a higher build I end up getting an error: TypeError: Cannot read property 'y' of undefined
TypeError: Cannot read property 'y' of undefined
    at http://localhost:3000/js/lib/line-chart.js:1258:37

From what I was able to find is that in the function getVerticalDomain it calls a filter as so:
domain = this.yExtent(series.filter(function(s) {
          return s.axis === key && s.visible !== false;
        })

The logic && s.visible !== false seems to be stripping off the series that is not currently visible. This later causes an issue because it tries to read off a property of undefined in the function yExtent.
 return maxY = Math.max(maxY, d3.max(data, function(d) {
            return group.reduce((function(a, s) {
              return a + d[s.y];
            }), 0);
          }));

is where the error is thrown. I ended up removing that logic but it did not solve the issue completely. When removing that logic, if all keys are toggled off in the legend the y axis disappears completely and breaks the graph. From what I can tell this is only happening with stacked graphs like the one shown at bit.ly/1D0EAEN.
Here is a fiddle replicating the issue:
http://jsfiddle.net/bloodhawk/ozx38asw/

See PR. Thanks :-)

Thanks for getting back to me. Does this mean an alternative fix will be implemented at some point for this issue. Legend toggles cease to work with stacked bar graphs. Do I need to wait on https://github.com/n3-charts/line-chart/issues/146?

Hm. I've closed that issue a little bit too fast. I'll take a look at this legend toggle problem.

Allright, can you try with master please ?

reproduced with master (and also not working on the examples page)

Okay, this is fixed in current (1.1.8).


Clip_back H14: making it work on an SSD < 2TB; making it fast

Goal: My end goal is to use the clip back-end as part of an image-captioning pipeline (will be needing to process many millions of images). The constraint I'm presently working under is that my SSD is only 2TB in capacity, so my intent is to only use the English metadata in conjunction with the H14 index.
Hardware is as follows:
CPU: 13900k
SSD: Samsung 990 pro 2TB
GPU: 4090
RAM: 96GB (@6400hz)
I have managed to get the clip-backend up and running, but I still need to figure out how to align the laion 2B english-only metadata with the H-14 5B index. The guide indicates that the no-language and the multi-language metadata should also be used, but I simply don't have the storage capacity for them.
I converted the metadata I did get into a single pyarrow file (as the guide instructs), and the backend will run, but the results being returned by front-end searches are mostly incorrect. Any guidance on this would be very much appreciated.
I'm also interested in any sort of performance tweaks that might improve performance; eg: reorder_metadata_by_ivf_index (I wonder if this would address my metadata dilemma...).
Thanks in advance for any help or insights.

About correctness: did you get the metadata from the same source as the
index?
About English only: you could change the clip back code to filter out
results ids above 2B
On Sun, Aug 13, 2023, 08:05 Chris @.***> wrote:

Goal: My end goal is to use the clip back-end as part of an
image-captioning pipeline (will be needing to process many millions of
images). The constraint I'm presently working under is that my SSD is only
2TB in capacity, so my intent is to only use the English metadata in
conjunction with the H14 index.
Hardware is as follows:
CPU: 13900k
SSD: Samsung 990 pro 2TB
GPU: 4090
RAM: 96GB @.***)
I have managed to get the clip-backend up and running, but I still need to
figure out how to align the laion 2B english-only metadata with the H-14 5B
index. The guide indicates that the no-language and the multi-language
metadata should also be used, but I simply don't have the storage capacity
for them.
I converted the metadata I did get into a single pyarrow file (as the
guide instructs), and the backend will run, but the results being returned
by front-end searches are mostly incorrect. Any guidance on this would be
very much appreciated.
I'm also interested in any sort of performance tweaks that might improve
performance; eg: reorder_metadata_by_ivf_index (I wonder if this would
address my metadata dilemma...).
Thanks in advance for any help or insights.
—
Reply to this email directly, view it on GitHub
https://github.com/rom1504/clip-retrieval/issues/304, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAR437TBKYTUVEHXUG54NVDXVBVBJANCNFSM6AAAAAA3ONQZUU
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

About correctness: did you get the metadata from the same source as the index?

As far as I can tell, they're the correct ones. Following the H-14 guide
This is the index file
This is the english metadata

About English only: you could change the clip back code to filter out results ids above 2B

This sounds like the perfect fix; some of my results are correct (about 1/3rd of them), so I suspect this will work. Any pointers or specifics to achieve this most succinctly? (eg: perhaps modifying the load_clip_indices() function in clip_back?). I would also be interested to trim down the index file instead given that would free up a non trivial amount of storage space.
Thanks very much in any case!

my suggestion is to filter as soon as possible right after the search so here https://github.com/rom1504/clip-retrieval/blob/main/clip_retrieval/clip_back.py#L366
filtering the index itself is also possible but it would require you to process all the index files and remove any ids > 2B

my suggestion is to filter as soon as possible right after the search so here https://github.com/rom1504/clip-retrieval/blob/main/clip_retrieval/clip_back.py#L366
filtering the index itself is also possible but it would require you to process all the index files and remove any ids > 2B

I narrowed down my issue a bit further after implementing your suggestion but am unsure how to proceed: after setting an id threshold, it turns out that any id above roughly 100 million is misaligned in the front-end or ClipClient results. I can't be sure whether it's malformed index files or a bad metadata arrow file (I'm guessing the latter), but I did re-download and re-merge both of them (one at a time) as a sanity check.
Been trying many things in hopes that I missed a step, but no luck so far. One of my suspicions is that a recent change to the instructions may have messed something up, specifically where
for i in {00..79}; do aria2c -x 16 https://huggingface.co/datasets/laion/laion5b-h14-index/resolve/main/index-parts/$i.index; done
was changed to:
for i in {00..79}; do aria2c -x 16 https://huggingface.co/datasets/laion/laion5b-h14-index/resolve/main/index-parts/$i.index -o $i.parquet; done
Which was done to prevent default names being incorrect, but the index files are in fact .index files, so perhaps saving them as .parquet before merging them could affect the alignment somehow?
It seems like my issue is with metadata alignment; the only other suspicion I have right now is that by simply not having the rest of the metadata (by only compiling the English metadatas), the alignment of the metadata is somehow messed up.
Hoping to get your thoughts on this before I potentially re-download the index file with the correct name scheme.
In case it helps, my 0.arrow (english metadata) file is 385.8 GB, the merged_index_ivfdata (5B_H-14) file is 754.9 GB, and the populated.index file is 513.2 MB

I managed to get everything working and aligned. Although I'm not positive which of the following was the fix (mostly due to my inability to systematically test because of storage capacity limits), here was how I modified steps from the guide:
for i in {00..79}; do aria2c -x 16 https://huggingface.co/datasets/laion/laion5b-h14-index/resolve/main/index-parts/$i.index -o $i.parquet; done
becomes:
for i in {00..79}; do aria2c -x 16 https://huggingface.co/datasets/laion/laion5b-h14-index/resolve/main/index-parts/$i.index -o $i.index; done
and
for i in {0000..2313}; do aria2c -x 16 https://huggingface.co/datasets/laion/laion2b-en-vit-h-14-embeddings/resolve/main/metadata/metadata_$i.parquet -o $i.parquet; done
becomes (along with the other metadata downloads)
for i in {0000..2313}; do aria2c -x 16 https://huggingface.co/datasets/laion/laion2b-en-vit-h-14-embeddings/resolve/main/metadata/metadata_$i.parquet -o metadata_$i.parquet; done
Other than that, a final sanity check that may have been at play was validating that I did have all 2314 of the English metadata files before compiling them. After the first download of the datasets I stopped checking to make sure they were all there (I assumed aria2 was fool-proof), but on this last attempt i checked and found a few missing files. I'll make a pull request and include a warning that advises people check for missing files, in addition to the above changes just to keep consistent with the database filenames.
I'm still interested in figuring out how to maximize clip back's performance for my use case, so I'll leave this issue open and eventually complete it with my findings (or perhaps ask some related questions :D )
Thanks again for your help @rom1504 , I'm looking forward to using this for big data jobs!


Update backend route for registering messaging groups

According to this post by @diamondhands0, group chat should be already supported, however I see that this PR to enable adding group members to messaging group keys is not yet merged yet. Please enable this to fully unlock what DESO already supports :D


feat: Add PEM format output for trust stores

ref: cloud-2920

Do I infer this encodes the PEM format, but we dont yet generate PEM certs in native go code?

This write the public bits as PEM format. The CA and other TLS/SSL certs are generated in go, but are imported to keystore. We do have some types for AM that generate key pairs via key tool. I made a new epic in jira to cover the alignment with commons secrets.


Added DSK

I've added DSK as a new Design System Tool. It'd be great to have it listed. If anything is missing, I can provide additional information. Thanks a lot for keeping and maintaining this list.
DSK, short for “Design System Kit” – a workbench for collaboratively creating
Design Systems. DSK is Open Source and under active development since 2017.
I'm using the link to the project's website, our GitHub is at https://github.com/rundsk/dsk
Checklist

[x] I made something good today 💐.
[X] I put links in the correct format: [Tool](link) — description.
[X] My description starts with the lower-case letter and ends with the full stop.
[X] I put the tool in the alphabetical order.

Optional

[X] I added the appropriate labels: free, open-source or mac.
[X] I put the tool only to one category.
[x] I followed Contribution Guidelines.

Looks very cool! thanks for adding it!


Use the block crate and functions that take blocks instead of boxing callbacks.

Hey Christian,
you would be interested in a PR that adds the block crate and replaces calls to MIDIInputPortCreate with a call to MIDIInputPortCreateWithBlock and call to MIDIClientCreate with call to MIDIClientCreateWithBlock . It would make the codebase easier to understand. I just tried a basic proof of concept and it seems to work.

Hi @adamnemecek, sorry for the late response, I completely missed this issue.
I'm wondering if you are still interested in this topic.
If so, would you please explain the motivation for that change and the advantages?
Thanks

It's been a while since I touched this but there's a crate called block which lets you use objective-c blocks from rust.
I think that this should work mostly
https://github.com/adamnemecek/wmidi_coremidi/blob/4c927e9cafd5ca59061a0a5c450827a61e29664f/src/midi_input.rs#L259

@adamnemecek I appreciate your time, thanks 😉
I have a working solution in #36 so I will close this issue.


Fix: remove server side apply duplicated sentence

Remove the duplicated sentence as it has appeared in pre paragraph.

/assign @tengqm

I don't think this is a simple repeat.
/close


[SPARK-11336] Add links to example codes

https://issues.apache.org/jira/browse/SPARK-11336
@mengxr I add a hyperlink of Spark on Github and a hint of their existences in Spark code repo in each code example. I remove the config key for changing the example code dir, since we assume all examples  should be in spark/examples.
The hyperlink, though we cannot use it now, since the Spark v1.6.0 has not been released yet, can be used after the release. So it is not a problem.
I add some screen shots, so you can get an instant feeling.

Merged build triggered.

Merged build started.

Test build #44500 has started for PR 9320 at commit a556c50.

Test build #44500 has finished for PR 9320 at commit a556c50.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44500/
Test PASSed.

LGTM except some minor issues mentioned inline.

Merged build triggered.

Merged build started.

Test build #44873 has started for PR 9320 at commit 0f5528d.

Test build #44873 has finished for PR 9320 at commit 0f5528d.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44873/
Test PASSed.

Merged build finished. Test PASSed.

When we build the doc, there is a flag PRODUCTION. I think when this flag is on, we should use Spark version in the GitHub link, otherwise we should use master instead. There is a link verification step in our release process. I'm a little worried about having broken links.

@mengxr  I am not sure how to use the PRODUCTION flag. But how about using the comparison between SPARK_VERSION_SHORT and SPARK_VERSION in the _config.yml file? In release version, the two tags are equal, while in develop mode, these two are not equal.

Merged build triggered.

Merged build started.

Test build #44994 has started for PR 9320 at commit 9f8b7b5.

Test build #44994 has finished for PR 9320 at commit 9f8b7b5.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

@yinxusen Let's take a safe approach. Remove the link but leave the text:
Find full example code at examples/src/main/#{clean_markup} in the Spark repo.

We can discuss more about the semantics in 1.7.

I delete the hyperlink and add an underscore of the file address. It looks more clear.

Merged build triggered.

Merged build started.

Test build #45714 has started for PR 9320 at commit f7e6618.

Test build #45714 has finished for PR 9320 at commit f7e6618.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/45714/
Test PASSed.

Merged build finished. Test PASSed.

The underline is confusing because people would treat it as a hyperlink, which is actually not. We can simply say: Find full example code at "examples/src/main/#{clean_markup}" in the Spark repo.

@mengxr fixed

Merged build triggered.

Merged build started.

Test build #45832 has started for PR 9320 at commit 128eb70.

Test build #45832 has finished for PR 9320 at commit 128eb70.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/45832/
Test PASSed.

LGTM. Merged into master and branch-1.6. Thanks!


Update hello.ts

Modified '_' to 'req' object in export function and modified text for clear understanding to beginners.

Looks like there's a merge conflict here

Closing for merge conflict, but happy to reopen.


C# LINQ Samples - Join Operators

Add LINQ samples for join operators for #90

Assign to me please


Fixed incorrect ERROR message when setting new PrimitiveMesh

If calling set_mesh with a PrimitiveMesh that has pending update, the _mesh_changed function would be called twice. The first time before set_base had been called, which could lead to an ERROR message about trying to set an invalid surface override material.

Thanks!

Cherry-picked for 4.0.1.


Only run coverage on merges/pushes to master

Our CI builds are really slow (routinely over 40 minutes), and running the unit tests takes a large portion of the CI duration.
From running locally, it seems that running tests without coverage reports is much faster (~6x) than running with coverage reports (partly because they can be run in parallel, partly because shared code only needs to be compiled once). We don't really need coverage reports for commits/changes that aren't part of master, so only run a coverage report when changes are pushed/merged to master.
Changes the make test to only runs test (no coverage report), and adds the make test-coverage rule for generating a coverage report.
NOTE: needs signature for changes to drone.yml

LGTM. This will need a new sign ( cc @lunny )

LGTM, @sapk it seems no need anymore?

@lunny The CI build (https://drone.gitea.io/go-gitea/gitea/3191) has a warning

Please rebase master branch.

Bad idea to do it like that, plugins don't support commands attribute

@tboerger did you mean this PR will result the tag will not be released automatically?

The added commands should be ignored


LBRY version 0.46.1 downloads page missing signature

Bug
When I check the releases page - https://github.com/lbryio/lbry-desktop/releases/tag/v0.46.1 - the downloadable assets do not include a signature file, whose contents contain a signed list of hashes of the LBRY AppImage file.
This information is helpful for users to verify that the released LBRY packages are the packages the developer intends users to download and use.
To Reproduce
Steps to reproduce the behavior:

Go to https://github.com/lbryio/lbry-desktop/releases/tag/v0.46.1
Expand the "Assets" list.
Scan the Assets list.
Note that a signature file is missing.

Expected behavior
A signature file is present.
Love the work so far!

Thanks for raising the issue. We'll get this added soon.

@afwang Thanks for openeing this issue. I added my signatures to 0.46.0 and 0.46.1


Jobs don't collapse/expand when clicking on the job title text

Jobs don't collapse/expand when clicking on the job title text. This seems to be because in that case, the dom2mx picks up an element that doesn't have any callbacks registered. In this example, the element with id=3340 is picked up:

However, the element with id=3332 has the correct callback set.
dom2mx seems to choose the lowest ancestor of the clicked element that has an id attribute set. Indeed, when I manually remove the id=3340 attribute from that div in Chrome's inspector, then the item expands/collapses correctly when I click on the text.

Thanks, I had observed this but was not sure it was worth fixing since one can click around and eventually find something that works. But it is an easy fix (bubble the event) so I'll sort it out. Thx.

Uh-oh, I had bubbling commented out. Hopefully I did that while thrashing and forgot to re-enable.
Nice detective work, btw.

Please try it now. I think I have the immediate issue addressed, but the bubbling has introduced a new one: if we click on an  tag provided by the story, the browser both navigates to the link and gives the app an onclick event, which now percolates up and gets treated as "toggle details". Working on that now.

Sorry for the late reply!

Nice detective work, btw.

Thanks :D
Seems to work fine! Thanks for making this :)

My pleasure, and thanks for the push on improving the UX.
Cheers, kt
On Fri, Oct 5, 2018 at 11:43 AM Bram Geron<EMAIL_ADDRESS>wrote:

Sorry for the late reply!
Nice detective work, btw.
Thanks :D
Seems to work fine! Thanks for making this :)
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub
https://github.com/kennytilton/whoshiring/issues/2#issuecomment-427409953,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAOqPrIyXI2-EceMTiLceWmmLfk9cFyvks5uh34ngaJpZM4VPJYa
.

--
Kenneth Tilton
http://tiltontec.com/

thank you Kenny!


FileNotFoundError with --no-freesurfer flag

File: /scratch/03763/oesteban/beast-1subj-20170319/out/fmriprep/sub-309/log/20170320-142723_78fb3ce5-5682-4afe-bece-a892daef3579/crash-20170320-142739-oesteban-Ants_T1_Brain_Extraction-d76a2ab8-e2e0-421d-af5d-9e615a009b2c.pklz
Node: workflow_enumerator.309.t1w_preprocessing.ANTsBrainExtraction.Ants_T1_Brain_Extraction
Working directory: /scratch/03763/oesteban/beast-1subj-20170319/work/workflow_enumerator/309/t1w_preprocessing/ANTsBrainExtraction/Ants_T1_Brain_Extraction

Node inputs:

anatomical_image = /scratch/03763/oesteban/beast-1subj-20170319/work/workflow_enumerator/309/t1w_preprocessing/MergeT1s/sub-309_T1w_ras.nii.gz
args = <undefined>
brain_probability_mask = /scratch/03763/oesteban/beast-1subj-20170319/work/workflow_enumerator/309/t1w_preprocessing/ANTsBrainExtraction/Ants_T1_Brain_Extraction/T_template0_BrainCerebellumProbabilityMask.nii.gz
brain_template = /home1/03763/oesteban/.cache/stanford-crn/ants_oasis_template_ras/T_template0.nii.gz
compress_report = auto
debug = False
dimension = 3
environ = {u'NSLOTS': u'12'}
extraction_registration_mask = /home1/03763/oesteban/.cache/stanford-crn/ants_oasis_template_ras/T_template0_BrainCerebellumRegistrationMask.nii.gz
generate_report = True
ignore_exception = False
image_suffix = nii.gz
keep_temporary_files = 1
num_threads = 12
out_prefix = highres001_
out_report = report.html
terminal_output = stream
use_floatingpoint_precision = 1
use_random_seeding = <undefined>

Traceback:
Traceback (most recent call last):
  File "/work/01329/poldrack/software/anaconda2-4.2.0/lib/python2.7/site-packages/nipype-0.13.0_ga9b6ac0.dev-py2.7.egg/nipype/pipeline/plugins/linear.py", line 43, in run
    node.run(updatehash=updatehash)
  File "/work/01329/poldrack/software/anaconda2-4.2.0/lib/python2.7/site-packages/nipype-0.13.0_ga9b6ac0.dev-py2.7.egg/nipype/pipeline/engine/nodes.py", line 366, in run
    self._run_interface()
  File "/work/01329/poldrack/software/anaconda2-4.2.0/lib/python2.7/site-packages/nipype-0.13.0_ga9b6ac0.dev-py2.7.egg/nipype/pipeline/engine/nodes.py", line 476, in _run_interface
    self._result = self._run_command(execute)
  File "/work/01329/poldrack/software/anaconda2-4.2.0/lib/python2.7/site-packages/nipype-0.13.0_ga9b6ac0.dev-py2.7.egg/nipype/pipeline/engine/nodes.py", line 607, in _run_command
    result = self._interface.run()
  File "/work/01329/poldrack/software/anaconda2-4.2.0/lib/python2.7/site-packages/nipype-0.13.0_ga9b6ac0.dev-py2.7.egg/nipype/interfaces/base.py", line 1085, in run
    runtime = self._run_wrapper(runtime)
  File "/work/01329/poldrack/software/anaconda2-4.2.0/lib/python2.7/site-packages/nipype-0.13.0_ga9b6ac0.dev-py2.7.egg/nipype/interfaces/base.py", line 1728, in _run_wrapper
    runtime = self._run_interface(runtime)
  File "/work/01329/poldrack/software/anaconda2-4.2.0/lib/python2.7/site-packages/niworkflows-99.99.99-py2.7.egg/niworkflows/common/report.py", line 63, in _run_interface
    self._post_run_hook(runtime)
  File "/work/01329/poldrack/software/anaconda2-4.2.0/lib/python2.7/site-packages/niworkflows-99.99.99-py2.7.egg/niworkflows/interfaces/masks.py", line 69, in _post_run_hook
    brain_extraction_mask = self.aggregate_outputs().BrainExtractionMask
  File "/work/01329/poldrack/software/anaconda2-4.2.0/lib/python2.7/site-packages/nipype-0.13.0_ga9b6ac0.dev-py2.7.egg/nipype/interfaces/base.py", line 1180, in aggregate_outputs
    raise FileNotFoundError(msg)
FileNotFoundError: File/Directory '/scratch/03763/oesteban/beast-1subj-20170319/work/workflow_enumerator/309/t1w_preprocessing/ANTsBrainExtraction/Ants_T1_Brain_Extraction/highres001_BrainExtractionPrior1Warp.nii.gz' not found for BrainExtractionRPT output 'BrainExtractionPrior1Warp'.
Interface BrainExtractionRPT failed to run.

Is the file there?
On Mon, Mar 20, 2017 at 1:11 PM, Oscar Esteban<EMAIL_ADDRESS>wrote:

File: /scratch/03763/oesteban/beast-1subj-20170319/out/fmriprep/sub-309/log/20170320-142723_78fb3ce5-5682-4afe-bece-a892daef3579/crash-20170320-142739-oesteban-Ants_T1_Brain_Extraction-d76a2ab8-e2e0-421d-af5d-9e615a009b2c.pklz
Node: workflow_enumerator.309.t1w_preprocessing.ANTsBrainExtraction.Ants_T1_Brain_Extraction
Working directory: /scratch/03763/oesteban/beast-1subj-20170319/work/workflow_enumerator/309/t1w_preprocessing/ANTsBrainExtraction/Ants_T1_Brain_Extraction
Node inputs:
anatomical_image = /scratch/03763/oesteban/beast-1subj-20170319/work/workflow_enumerator/309/t1w_preprocessing/MergeT1s/sub-309_T1w_ras.nii.gz
args =
brain_probability_mask = /scratch/03763/oesteban/beast-1subj-20170319/work/workflow_enumerator/309/t1w_preprocessing/ANTsBrainExtraction/Ants_T1_Brain_Extraction/T_template0_BrainCerebellumProbabilityMask.nii.gz
brain_template = /home1/03763/oesteban/.cache/stanford-crn/ants_oasis_template_ras/T_template0.nii.gz
compress_report = auto
debug = False
dimension = 3
environ = {u'NSLOTS': u'12'}
extraction_registration_mask = /home1/03763/oesteban/.cache/stanford-crn/ants_oasis_template_ras/T_template0_BrainCerebellumRegistrationMask.nii.gz
generate_report = True
ignore_exception = False
image_suffix = nii.gz
keep_temporary_files = 1
num_threads = 12
out_prefix = highres001_
out_report = report.html
terminal_output = stream
use_floatingpoint_precision = 1
use_random_seeding =
Traceback:
Traceback (most recent call last):
File "/work/01329/poldrack/software/anaconda2-4.2.0/lib/python2.7/site-packages/nipype-0.13.0_ga9b6ac0.dev-py2.7.egg/nipype/pipeline/plugins/linear.py", line 43, in run
node.run(updatehash=updatehash)
File "/work/01329/poldrack/software/anaconda2-4.2.0/lib/python2.7/site-packages/nipype-0.13.0_ga9b6ac0.dev-py2.7.egg/nipype/pipeline/engine/nodes.py", line 366, in run
self._run_interface()
File "/work/01329/poldrack/software/anaconda2-4.2.0/lib/python2.7/site-packages/nipype-0.13.0_ga9b6ac0.dev-py2.7.egg/nipype/pipeline/engine/nodes.py", line 476, in _run_interface
self._result = self._run_command(execute)
File "/work/01329/poldrack/software/anaconda2-4.2.0/lib/python2.7/site-packages/nipype-0.13.0_ga9b6ac0.dev-py2.7.egg/nipype/pipeline/engine/nodes.py", line 607, in _run_command
result = self._interface.run()
File "/work/01329/poldrack/software/anaconda2-4.2.0/lib/python2.7/site-packages/nipype-0.13.0_ga9b6ac0.dev-py2.7.egg/nipype/interfaces/base.py", line 1085, in run
runtime = self._run_wrapper(runtime)
File "/work/01329/poldrack/software/anaconda2-4.2.0/lib/python2.7/site-packages/nipype-0.13.0_ga9b6ac0.dev-py2.7.egg/nipype/interfaces/base.py", line 1728, in _run_wrapper
runtime = self._run_interface(runtime)
File "/work/01329/poldrack/software/anaconda2-4.2.0/lib/python2.7/site-packages/niworkflows-99.99.99-py2.7.egg/niworkflows/common/report.py", line 63, in _run_interface
self._post_run_hook(runtime)
File "/work/01329/poldrack/software/anaconda2-4.2.0/lib/python2.7/site-packages/niworkflows-99.99.99-py2.7.egg/niworkflows/interfaces/masks.py", line 69, in _post_run_hook
brain_extraction_mask = self.aggregate_outputs().BrainExtractionMask
File "/work/01329/poldrack/software/anaconda2-4.2.0/lib/python2.7/site-packages/nipype-0.13.0_ga9b6ac0.dev-py2.7.egg/nipype/interfaces/base.py", line 1180, in aggregate_outputs
raise FileNotFoundError(msg)
FileNotFoundError: File/Directory '/scratch/03763/oesteban/beast-1subj-20170319/work/workflow_enumerator/309/t1w_preprocessing/ANTsBrainExtraction/Ants_T1_Brain_Extraction/highres001_BrainExtractionPrior1Warp.nii.gz' not found for BrainExtractionRPT output 'BrainExtractionPrior1Warp'.
Interface BrainExtractionRPT failed to run.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/poldracklab/fmriprep/issues/401, or mute the thread
https://github.com/notifications/unsubscribe-auth/AAOkp3NWKwIlquzSaMOabutWZK_4Rge1ks5rnt1mgaJpZM4Mi85C
.

Nope, the file is not generated.

Just to clarify - this is happening for all subjects using master branch?
On Mon, Mar 20, 2017 at 1:23 PM, Oscar Esteban<EMAIL_ADDRESS>wrote:

Nope, the file is not generated.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/poldracklab/fmriprep/issues/401#issuecomment-287885986,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAOkpxgGqR7sl8CNf14iEmh7YBEaQGncks5rnuBDgaJpZM4Mi85C
.

Can't tell: I made 4 subjects, only the "rest" task-id, and 2 of them failed before with #399. The other two failed with this one.

Using the fieldmaps branch, but with latest master merged in.

I'm running one beast subject locally to see if I can replicate.

I cannot replicate this locally with current master (using Docker and Best subject).

It also happened to me with sub-387. Investigating.

Long story short:
$ antsBrainExtraction.sh -h
we cant find the N4 program -- does not seem to exist. please (re)define $ANTSPATH in your environment.
$ echo $?
0

I'll fix the environment in ls5. This should be OK for the docker image as long as $ANTSPATH is defined.
Opened nipype#1901


Problem with dependency mss

I noticed that recently geemap was not being updated from conda-forge.
The problem comes from the inclusion of the mss package as a dependency.
There is a problem since two packages are called the same:
https://bitbucket.org/wxmetvis/mss
https://github.com/BoboTiG/python-mss
Although geemap seems to use the second one (at least it's the one that links), in conda-forge it seems to be available only the first one:
https://anaconda.org/conda-forge/mss
In addition, this package has very strong dependencies (such as a particular version of matplotlib, 3.0.2, or an old version of pillow) making it difficult to update.

Thanks for reporting this! I did not realize that the mss package on conda-forge is not the same as the one on pypi.
Here is the recipe meta.yaml used to build the geemap package on conda-forge. Do you know a way to include a package from pypi in the recipe?
Also, as you can see from the recipe, I did not specify a particular version of matplotlib or pillow. The version is probably determined by conda when taking all dependencies into consideration. I can try switch matplotlib to matplotlib-base to see if it resolves the problem.

Also, as you can see from the recipe, I did not specify a particular version of matplotlib or pillow. The version is probably determined by conda when taking all dependencies into consideration. I can try switch matplotlib to matplotlib-base to see if it resolves the problem.

Sorry, I meant the mss package at conda-forge, not geemap.

Do you know a way to include a package from pypi in the recipe?

I'm sorry to say that I don't have much of an idea, but it seems that this part of the documentation mentions it:
I'm sorry to say that I don't have much of an idea, but it seems that this part of the documentation mentions it:
https://conda-forge.org/docs/maintainer/adding_pkgs.html#source

I just opened an issue on the python-mss repo - https://github.com/BoboTiG/python-mss/issues/170

@giswqs, now that python-mss is available at conda-forge, could you update geemap to that dependency?
Thanks!

It has been updated. Use the following code to install geemap. Do NOT use Python 3.8. There are many people reporting issues with Python 3.8 and conda. This is not unique to geemap. I tested Python 3.8 with conda, it will only install geemap v0.6.10. It won't install the latest version.
https://anaconda.org/conda-forge/geemap
conda create -n gee python=3.7
conda activate gee
conda install mamba -c conda-forge
mamba install geemap -c conda-forge


update README.md

I have changed the fonts-size of heading of README.md file.

It will look more readable. Thankyou I'll wait for your response.

"Export" is intended to be a sub-heading of "Command-Line Interface" so I do not think this is better.

okay @larsgw  Thankyou for your response. Thankyou for correcting me.


Formal documentation?

What is the feature you are proposing?
The current readme is getting pretty long. Can we get a formal documentation repo (similar to Hono) to start moving some of this stuff over?
Or perhaps add a section to the Hono docs specifically for HonoX.

Hi @bruceharrison1984
We don't have to do it "right now", but we should do it soon.
I think those are the two options:

Add a section to Hono's website for HonoX.
Create a new HonoX website using "HonoX".

If we chose "1", we can add that here:

The most likely way is to do "1" first and then "2" later.

@KaiSpencer I agree. I think just carving out a section in the existing docs, similar to some of the middleware, would work for quite some time


Internal handling of signature assignment and management

It was a nightmare and really error-prone to implement correctly all the steps in https://github.com/privacy-scaling-explorations/zkevm-circuits/blob/6abc33eeb81ffd64ff73f2a84c04203f33c161eb/eth-types/src/sign_types.rs#L100 when we migrated to the latest halo2 and halo2wrong tags.
It will be much better if the secp256k1 crate would handle these kind of things for us.
We could maybe even create a secp256k1-sign crate which handles all that for us and abstracts complexity in the downstream crates.
This would help significantly to reduce code there and also, would place in the correct repo all the signature-related logic.

Seolved via https://github.com/privacy-scaling-explorations/halo2wrong/issues/59 when resolved.


Automatically reconnect to social network after restarting the app

I think @jpevarnek was looking into something similar to this for handling app/extension updates

I don't see what this has to do with app updates? this is when you close chrome and open it again.
We'd have to write refresh token etc to local storage and read it when we start up.

The thought with the relationship between those was that we would have to do the same thing when updating the app in order for it to be a seamless experience for the user.

Yeah I think it's similar because in both cases the app will be restarting, and we will have to make sure that it automatically logs in to the social network(s) again after the restart.

Closing, duplicate of #1758


Enable endpoint labels when telemetry is enabled

fixes #20538
[ ] Configuration Infrastructure
[ ] Docs
[ ] Installation
[ ] Networking
[ ] Performance and Scalability
[ ] Policies and Telemetry
[ ] Security
[ ] Test and Release
[ ] User Experience
[ ] Developer Infrastructure
Pull Request Attributes
Please check any characteristics that apply to this pull request.
[ ] Does not have any changes that may affect Istio users.

@mandarjog Not yet, needs to update proxy to get the full functionality.

@bianpengyuan in that case I think this PR should include everything, just enabling without Impl or tests does not make sense.
If you want a separate enablement PR it should go in after the impl PR.

I can block this and wait for proxy update.

/test benchmark_istio

@bianpengyuan: The following test failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

lint_istio
acc6b7865530b2c2078800ccbb912c37d3a400a0
link
/test lint_istio

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@bianpengyuan: The following tests failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

lint_istio
acc6b7865530b2c2078800ccbb912c37d3a400a0
link
/test lint_istio

integ-multicluster-k8s-tests_istio
acc6b7865530b2c2078800ccbb912c37d3a400a0
link
/test integ-multicluster-k8s-tests_istio

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@bianpengyuan: The following tests failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

integ-multicluster-k8s-tests_istio
acc6b7865530b2c2078800ccbb912c37d3a400a0
link
/test integ-multicluster-k8s-tests_istio

integ-pilot-k8s-tests_istio
de3b15f6ddd7155d25d86701b4cad0fcb9593d57
link
/test integ-pilot-k8s-tests_istio

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

test failure seems real

@bianpengyuan: The following tests failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

integ-pilot-k8s-tests_istio
de3b15f6ddd7155d25d86701b4cad0fcb9593d57
link
/test integ-pilot-k8s-tests_istio

lint_istio
9a8c1d82806aee4a51caef4b396c88ba56475809
link
/test lint_istio

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@bianpengyuan: The following test failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

integ-telemetry-k8s-tests_istio
691d277349d61fa5d3e467cdfa807ba75999ca6a
link
/test integ-telemetry-k8s-tests_istio

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@bianpengyuan: The following test failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

integ-telemetry-k8s-tests_istio
f2a803125be78b4276c35e83f319762839218d12
link
/test integ-telemetry-k8s-tests_istio

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/test benchmark_istio

@bianpengyuan: The following tests failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

integ-telemetry-k8s-tests_istio
f2a803125be78b4276c35e83f319762839218d12
link
/test integ-telemetry-k8s-tests_istio

integ-multicluster-k8s-tests_istio
a2d270e1192ffda9b0058ab37b18e53c4b1a47cb
link
/test integ-multicluster-k8s-tests_istio

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/retest


"Dragalina", "Fundu Herții" and "Poiana" are listed in the drop-down menu

Description:
"Dragalina", "Fundu Herții" and "Poiana" are listed in the drop-down menu alongside its corresponding county and commune, according to the law
Precondition:
The website is up an running.

Step 1
Type "Dragalina" in the search bar.

Expected results
The location is listed in the drop-down menu as "Dragalina, Botoșani (Cristinești)".

Step 2
Press "x" button.

Expected results
The location was deleted from the search bar.

Step 3
Type "Fundu Herții" in the search bar.

Expected results
The location is listed in the drop-down menu as "Fundu Herții, Botoșani (Cristinești)".

Step 4
Press "x" button.

Expected results
The location was deleted from the search bar.

Step 5
Type "Poiana" in the search bar.

Expected results
The location is listed in the drop-down menu as "Poiana, Botoșani (Cristinești)".


Docs: Change 'decoratorsProvider' to 'schemaFormDecoratorsProvider'

Just a small change, the documentation referred to decoratorsProvider when it should be schemaFormDecoratorsProvider.
It was a little confusing when trying out the decorators ;)

Coverage remained the same at 80.81% when pulling 6f265988c98bac553d3c234bb966a4d158548173 on Coridyn:docs/decorators-provider-update into 0475d36e2dfd50b0c5606aeaae9e92d897ba4a3a on Textalk:development.

Brilliant!


Ignore .github as a directory

Description
The .github directory should be no longer ignored by newer versions of chef.
Issues Resolved
After migrating to chef 14 the .github directory was no longer ignored.

Nice one, thank you.


Macro does_table_exist causes ambiguity issue in get_relation macro

We recently upgraded the fivetran_log version from 0.5.2 to 0.6.2, this introduced a new macro does_table_exist which looks like this:
{%- macro does_table_exist(table_name) -%}
    {%- if execute -%} -- returns true when dbt is in execute mode
    {%- set ns = namespace(has_table=false) -%} -- declare boolean namespace and default value
        {%- for node in graph.sources.values() -%} -- grab sources from the dictionary of nodes
        -- call the database for the matching table
            {%- set source_relation = adapter.get_relation(
                    database=node.database,
                    schema=node.schema,
                    identifier=node.name) -%}
            {%- if source_relation == None and node.name | lower == table_name | lower -%}
                {{ return(False) }} -- return false if relation identified by the database.schema.identifier does not exist for the given table name
            {%- elif source_relation != None and node.name | lower == table_name | lower -%}
                {{ return(True) }} -- otherwise return True
            {% endif %}
        {%- endfor -%}
    {%- endif -%}
{%- endmacro -%}

We are currently running our dbt project on Snowflake and our typical src.yml looks like this:
version: 2

sources:
  - name: source_name
    database: '{{ env_var("SNOWFLAKE_LOAD_DATABASE") }}'
    schema: SCHEMA_NAME
    loader: fivetran
    loaded_at_field: _FIVETRAN_SYNCED

    quoting:
      database: true
      schema: true
      identifier: false

    tables:
      - name: table_name

This raises an error on compilation about ambiguity. This is most of the time a quoting issue. Here is a sample error message we got:
dbt.exceptions.RuntimeException: Runtime Error
  Compilation Error in model stg_fivetran_log__credits_used (models/staging/stg_fivetran_log__credits_used.sql)
    When searching for a relation, dbt found an approximate match. Instead of guessing
    which relation to use, dbt will move on. Please delete "RAW"."FACEBOOK_ADS_FIVETRAN"."ACCOUNT_HISTORY", or rename it to be less ambiguous.
    Searched for: RAW.FACEBOOK_ADS_FIVETRAN.account_history
    Found: "RAW"."FACEBOOK_ADS_FIVETRAN"."ACCOUNT_HISTORY"

    > in macro does_table_exist (macros/does_table_exist.sql)
    > called by model stg_fivetran_log__credits_used (models/staging/stg_fivetran_log__credits_used.sql)

We found that the issue resides in the get_relation macro, to be more precise the fact that the name gets passed as the argument for the identifier. We solved this issue locally in two different ways, either adding an upper to the name, or directly changing the name to identifier.
{%- macro does_table_exist(table_name) -%}
    {%- if execute -%} -- returns true when dbt is in execute mode
    {%- set ns = namespace(has_table=false) -%} -- declare boolean namespace and default value
        {%- for node in graph.sources.values() -%} -- grab sources from the dictionary of nodes
        -- call the database for the matching table
            {%- set source_relation = adapter.get_relation(
                    database=node.database,
                    schema=node.schema,
                    identifier=node.identifier) -%}
            {%- if source_relation == None and node.name | lower == table_name | lower -%}
                {{ return(False) }} -- return false if relation identified by the database.schema.identifier does not exist for the given table name
            {%- elif source_relation != None and node.name | lower == table_name | lower -%}
                {{ return(True) }} -- otherwise return True
            {% endif %}
        {%- endfor -%}
    {%- endif -%}
{%- endmacro -%}

{%- macro does_table_exist(table_name) -%}
    {%- if execute -%} -- returns true when dbt is in execute mode
    {%- set ns = namespace(has_table=false) -%} -- declare boolean namespace and default value
        {%- for node in graph.sources.values() -%} -- grab sources from the dictionary of nodes
        -- call the database for the matching table
            {%- set source_relation = adapter.get_relation(
                    database=node.database,
                    schema=node.schema,
                    identifier=node.name | upper) -%}
            {%- if source_relation == None and node.name | lower == table_name | lower -%}
                {{ return(False) }} -- return false if relation identified by the database.schema.identifier does not exist for the given table name
            {%- elif source_relation != None and node.name | lower == table_name | lower -%}
                {{ return(True) }} -- otherwise return True
            {% endif %}
        {%- endfor -%}
    {%- endif -%}
{%- endmacro -%}

We would like to bring this to your attention and see if it would make sense to modify this macro to avoid this issue since we also saw that the dbt team used the identifier in one of the packages we use, see here.
Many thanks in advance and let us know if more information is needed.

Hi @ggmblr thanks so much for raising this to our team!
We have actually encountered a similar issue in other implementations that leverage the get_relations macro and have solved it by using your suggested identifier in place of name edit. This is definitely something we will want to account for within our package to ensure other users do not encounter this compilation error.
If you would like to open a PR to account for this change I would be happy for myself or someone on my team to review it and work to merge it into our next release. We really appreciate you raising this with our team and contributing your insight into the fix! Let me know if you are open to contributing a PR. Otherwise, my team can address this issue in our next sprint.

PR has been merged and v0.6.3 should be live on the hub shortly!! thanks @ggmblr


[BUG] Doctest fail for sol! macro

Bug Report
When defining Solidity code using sol! macro, the doctest for macro fails with:

could not find option in core

and

could not find convert in core

Steps to Reproduce

Create a start project using create-steel-app tool
Create a new lib package with any name
Add alloy-primitives, alloy-sol-types and risc0-steel targeting workspace
Add

use alloy_sol_types::sol;

sol! {
    /// ERC-20 balance function signature.
    interface IERC20 {
        function balanceOf(address account) external view returns (uint);
    }
}

Run cargo test

Expected behavior
Test pass
Your Environment

risc0-ethereum version: release-1.1 branch
Rust version: 1.82
Platform/OS: MacOS 15.1

Closing an issue since it was due to a personal mistake of naming the crate core which conflicted with the "rust-native" core crate


Add In-app update feature

https://developer.android.com/guide/playcore/in-app-updates

Hi! Assign me please


PT006 autofix: should maintain the replaced string's quote style instead of always using "

Currently the PT006 autofix replaces e.g. 'first, second' with ("first", "second"). It would be better if it would maintain the string's quote style, in this example ('first', 'second').
Code where " is hardcoded currently:
https://github.com/charliermarsh/ruff/blob/8b277138de351801560d903658958b7967f80dde/src/flake8_pytest_style/plugins/parametrize.rs#L142-L160
I couldn't quickly find a way to get the quote style of the string (is this info available on a string literal ast Expr?) so I'm just lazily opening an issue :)

You can use checker.style.quote() to get the quotation style for the file, if you want to add to your PR or open a separate PR :)

Actually, I'm in this code anyway so will fix real quick.

@charliermarsh I was about to send a PR for this. :laughing:

@saadmk11 - Feel free!

@saadmk11 - I think it'd be nice to use SourceCodeGenerator entirely instead of manually crafting the expression, e.g.:
generator.unparse_expr(
    &create_expr(ExprKind::Tuple {
            ...
    })
)

@saadmk11 - I think it'd be nice to use SourceCodeGenerator entirely instead of manually crafting the expression, e.g.:
generator.unparse_expr(
    &create_expr(ExprKind::Tuple {
            ...
    })
)

Yup That's what I did. :) It was quite interesting to learn how SourceCodeGenerator works.

TIL about SourceCodeGenerator . Thanks for fixing this @saadmk11 !


show ivyReport shows incorrect directory

sample repo: https://github.com/anuccio1/sbt-test
when show ivyReport is run, this is shown:
sbt-test/target/scala-2.11/resolution-cache/reports/com.alex.test-alex-test_2.11-compile.xml
when really the file was written to
sbt-test/target/resolution-cache/reports/com.alex.test-alex-test_2.11-compile.xml

Seems that the directory was changed in 0.13.16 (in https://github.com/sbt/sbt/commit/ff017eb475fbf18b8066125596bcd1a8cd8fb3ff#diff-6373e7f7122325e753b75fe1cc76ff5fR1419) and already "fixed" here. So it should work for sbt > 0.13.16.
We could fix it by retrieving the right directory from the ivyConfiguration key instead of building the directory ourselves.


Http.send's output Signal sends duplicate events

Reproduced here: http://share-elm.com/sprout/5431fc1fe4b017b21db2f925
In the example above, 4 requests are sent to Http.sendGet, and the responses are counted.  I would expect 4 responses, but there are 7.

With the modern Http problem we can safely say this issue does not exist ;) Thanks for the report!


Using fields for embedded document

Am using mongo-connector to sync the data between mongodb and elasticsearch and i dont want to sync complete data of mongodb so i used --fields to select only  needed fields to be indexed in ES.
I have in the below format, i want to index add1 of ds1 how can i do?
{
mname:
fnmae:
lname:
ds1:
{
add1:
add2:
}
}
i tried with the below command but it didn't worked for me.
mongo-connector -m localhost:27017 -t localhost:9201 --fields mname,fname,ds1.add1 -d elastic_doc_manager

Sorry its my mistake its working.