Skipping tests

It would be really nice if there was a facility to skip tests.
My use case is this: Library A should test its interaction with Library B, but only if Library B is installed.  Otherwise, it should skip the Library B interaction tests and inform the user that Library B could not be found.  Of course, this could be thrown as an error, but there are many use cases where skipping the impossible tests and making a note of them is useful.

Hi, I am curious whether it is also possible to skip tests at run-time.
Assume I had a unit test which requires a specific OpenGL version not present on the test machine where the test is currently run. It would be great to be able to skip such a test if I determine at run-time that I cannot reasonably perform it. As of today, I can skip but not invoking the respective assertion macro but I cannot log or report that I skipped a test. I looked at the code and tried to find out whether I could e.g. adapt the return value of a user specified main() but the return value of Session::run() seems to be already used otherwise.


PandaTV API has been upgraded to version 2

Some request url has been changed.
If you are free of time, it's nice for you to update it :)

Thanks for the heads up, added the call. Looks like v2 is basically the same but without the "is_following" and "fans", the new way to get it is through the room_followinfo.


Drop in and alls

Hi,
Does AlexaPi support drop in and calls from other echo devices?

No, see https://github.com/alexa-pi/AlexaPi/issues/391#issuecomment-379570699


Page is totally broken :(

Anybody know why?

Looks like it was this commit that destroyed everything
547e119

får jag titta på detta?

@albanmahmut yes 👍

@albanmahmut yes

Ok, Lets see if we can find the solution.

Which page has the issue? Is this solved?

@NitinNair89 I think this is solved forgot to close this :)


Compat: header validation refactor and tests

Refactor and tests the header validation to ensure compatibility against real AWS S3 api

Best pr ever 👍

Updated :)

👍

@ironman-machine thoughts on the matter?

Hello @LaurenSpiegel,
Starting end to end procedure using the following payload:
{"DEFAULT_BRANCH":"master","SCALITY_S3_BRANCH":"compat/headerValidation-tests"}
Please follow http://ci.ironmann.io/gh/scality/Integration/2565 for circle status.

:+1: (for Lauren part ^^)

end to end passed


Ddos apk

How can I download Ddos apk

🧐

I'm busy with other project, I'm very sorry.
However, please check release page. (On this GitHub repo)


when I try sfdx force:org:list, got an MaxListenersExceededWarning error

Summary
When I use the sfdx force:org:list command, I always get an error:
-- (node:51109) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 11 value listeners added. Use emitter.setMaxListeners() to increase limit
Steps To Reproduce:

sfdx force:org:list

Expected result
List all the org infos.
Actual result
got an error.
Error information: (node:51109) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 11 value listeners added. Use emitter.setMaxListeners() to increase limit
Additional information
sfdx force:alias:list command works correctly.
SFDX CLI Version: sfdx-cli/6.52.2-c6cdc99881 (darwin-x64) node-v8.9.4
OS and version: masOS Mojave 10.14.2

@daniel3Github can you run sfdx plugins --core to get the version salesforcedx that you are on?  I am filing a bug, but I am unable to reproduce the error so any other information would be helpful.
How many orgs are you currently authenticated into?
Does the CLI preform as expected when you run other org commands, such as org:open?
When did this issue start happening?

@clairebianchi  the version info:
@salesforce/plugin-generator 1.0.1 (core)
@salesforce/sfdx-trust 2.0.1 (core)
builtins 1.0.0 (core)
salesforcedx 45.2.0 (core)
I run the sfdx force:alias:list and get 7 orgs.
yes, the sfdx force:org:open works as expected.
I ran into this issue several days ago.

Update: it works as expected after I marked a scratch org for deletion with  force:org:delete  command.


Division-by-zero with Kvaerno solvers, when jit is disabled.

When using Kvaerno[345], I get a division-by-zero if I disable jit, and not otherwise. Doesn't happen at least with dopri5. In the past I've viewed "crash without jit but not with jit" as an indication that the jit'd code is still buggy, so I find this worrying even if it seems to "work" as long as I keep jit on.
Demonstration:
from diffrax import PIDController, diffeqsolve, ODETerm, Kvaerno3, Kvaerno4, Kvaerno5, Dopri5
import jax
import jax.numpy as jnp

# Without jit, there's a divide-by-zero no matter what we flow.
jax.config.update("jax_disable_jit", True)

@ODETerm
def term(t, y, args):
    return jnp.zeros_like(y)

y = jnp.zeros((1,))
stepsize_controller = PIDController(rtol=1e-5, atol=1e-5)
sol = diffeqsolve(term, Kvaerno4(),
                  t0=0,
                  t1=1e-2,
                  dt0=1e-3,
                  stepsize_controller=stepsize_controller,
                  y0=y)

The traceback is:
    sol = diffeqsolve(term, Kvaerno4(),
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/equinox/_jit.py", line 107, in __call__
    return self._call(False, args, kwargs)
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/equinox/_jit.py", line 103, in _call
    out = self._cached(dynamic, static)
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/equinox/_jit.py", line 41, in fun_wrapped
    out = fun(*args, **kwargs)
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/diffrax/integrate.py", line 794, in diffeqsolve
    final_state, aux_stats = adjoint.loop(
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/diffrax/adjoint.py", line 286, in loop
    final_state = self._loop(
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/diffrax/integrate.py", line 401, in loop
    final_state = outer_while_loop(
  File "/opt/anaconda3/envs/env/lib/python3.10/contextlib.py", line 79, in inner
    return func(*args, **kwds)
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/equinox/internal/_loop/loop.py", line 107, in while_loop
    return checkpointed_while_loop(
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/equinox/internal/_loop/checkpointed.py", line 247, in checkpointed_while_loop
    body_fun_ = filter_closure_convert(body_fun_, init_val_)
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/equinox/_ad.py", line 504, in filter_closure_convert
    closed_jaxpr, out_dynamic_struct, out_static = filter_make_jaxpr(fn)(
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/equinox/_make_jaxpr.py", line 43, in __call__
    jaxpr, out_struct = jax.make_jaxpr(_fn, return_shape=True)(
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/equinox/internal/_loop/common.py", line 418, in new_body_fun
    buffer_val2 = body_fun(buffer_val)
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/diffrax/integrate.py", line 197, in body_fun
    (y, y_error, dense_info, solver_state, solver_result) = solver.step(
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/diffrax/solver/runge_kutta.py", line 986, in step
    final_val = eqxi.while_loop(
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/equinox/internal/_loop/loop.py", line 107, in while_loop
    return checkpointed_while_loop(
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/equinox/internal/_loop/checkpointed.py", line 247, in checkpointed_while_loop
    body_fun_ = filter_closure_convert(body_fun_, init_val_)
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/equinox/internal/_loop/common.py", line 418, in new_body_fun
    buffer_val2 = body_fun(buffer_val)
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/diffrax/solver/runge_kutta.py", line 869, in rk_stage
    nonlinear_sol = self.nonlinear_solver(
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/diffrax/nonlinear_solver/base.py", line 92, in __call__
    root, nsol_no_root = implicit_jvp(_primal, _rewrite, diff_args, closure)
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/diffrax/ad.py", line 64, in implicit_jvp
    root, residual = _implicit_backprop(
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/diffrax/ad.py", line 42, in __call__
    return self.fn(nondiff_args_nontracer, nondiff_args_tracer, diff_args)
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/diffrax/ad.py", line 19, in fn_wrapper
    return fn(*nondiff_args, *diff_args)
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/diffrax/ad.py", line 75, in _implicit_backprop
    return fn_primal(args, closure)
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/diffrax/nonlinear_solver/base.py", line 27, in _primal
    nsol = self._solve(fn, x, jac, nondiff_args, diff_args)
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/diffrax/nonlinear_solver/newton.py", line 145, in _solve
    val = lax.while_loop(cond_fn, body_fn, val)
  File "/opt/anaconda3/envs/env/lib/python3.10/site-packages/diffrax/nonlinear_solver/newton.py", line 119, in cond_fn
    rate = diffsize / diffsize_prev
ZeroDivisionError: float division by zero

Thanks for the report! In this case the algorithm itself is fine, it's just an issue with JAX having different rules for promoting floats to arrays when using disable_jit. This should be fixed in #322, which will appear in the next Diffrax release.


Add functionality to skip non-applicable timelines

Some cohorts do not collect data for certain timelines.  For example, the BLADDER cohort does not (yet?) collect tumor marker instruments used to create the data_timeline_labtest.txt file.  Currently, some of the timelines are not run with a conditional statement checking the cohort inside of the processing code.  For example:
https://github.com/Sage-Bionetworks/GENIE-Sponsored-Projects/blob/ea33ed8a587a3e8f53c4d504842606da83cb6f7b/geniesp/bpc_redcap_export_mapping.py#L907
It would be more robust to make this more generic to new cohorts or changes in existing cohorts.  Perhaps, could the class definitions of each cohort include a flag for each timeline type that is checked during processing in order to proceed with that specific timeline's generation?   Or could the potential to create a certain timeline be determined programmatically from the mapping and variables included in the underlying dataset?

This can probably be in the yaml configuration.


add TaskResponseProcessor

Codecov Report

Merging #1983 into refactor-worker will decrease coverage by 0.1%.
The diff coverage is 0%.

@@                  Coverage Diff                  @@
##             refactor-worker    #1983      +/-   ##
=====================================================
- Coverage              29.94%   29.84%   -0.11%
  Complexity              1367     1367
=====================================================
  Files                    299      301       +2
  Lines                  15170    15222      +52
  Branches                1817     1821       +4
=====================================================
  Hits                    4543     4543
- Misses                 10176    10228      +52
  Partials                 451      451

Impacted Files
Coverage Δ
Complexity Δ

...duler/server/worker/runner/TaskScheduleThread.java
0% <ø> (ø)
0 <0> (ø)
:arrow_down:

...e/dolphinscheduler/server/worker/WorkerServer.java
0% <0%> (ø)
0 <0> (ø)
:arrow_down:

...e/dolphinscheduler/server/master/MasterServer.java
0% <0%> (ø)
0 <0> (ø)
:arrow_down:

...server/master/runner/MasterBaseTaskExecThread.java
0% <0%> (ø)
0 <0> (ø)
:arrow_down:

...dolphinscheduler/common/enums/ExecutionStatus.java
54.83% <0%> (-8.13%)
2 <0> (ø)

...server/master/processor/TaskResponseProcessor.java
0% <0%> (ø)
0 <0> (?)

...phinscheduler/server/master/future/TaskFuture.java
0% <0%> (ø)
0 <0> (?)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6bf9814...63b76d7. Read the comment docs.


Updated the JNats Publish and Receive article to latest version.

Updated the JNats Publish and Receive article to latest version of JNats including the example NatsClient and the unit tests.

Thanks, only concern remaining is the unused methods
I'll add some more tests to cover these.

I added this note to tests:
IMPORTANT: Using Thread.sleep() is not a generally recommended development concept.
In the case of tests, it is the easiest way to simulate the real behavior
that messages take some amount of time to go from being published
to being received. This amount of time will vary depending on many factors including:

network latency
server cluster configuration
server computing power relative to the load of work

@scottf the latch approach is not "forced by an external behavior in the test", if you introduced a bug in the production code then the test would fail (time out)
The problem with the Thread.sleep approach is that the test becomes flaky and non deterministic via false negative failures - we can't guarantee how long we need to sleep - I don't want to encourage readers to write flaky tests that could cause them issues in CI. And I also don't want to encourage putting very large sleep values in tests.
If you have an alternative suggestion to avoid writing flaky tests happy to hear it

We've also used awaitility https://www.baeldung.com/java-thread-sleep-vs-awaitility-await in the past for these kinds of cases - a polling based solution that abstracts away the waiting logic

Replaced Thread.sleep with Awaitility.await


fix: add static member for multicodec

Added static member for allowing multicodec to be required from Gossipsub

Codecov Report

Merging #81 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master      #81   +/-   ##
=======================================
  Coverage   80.00%   80.00%
=======================================
  Files           1        1
  Lines          10       10
=======================================
  Hits            8        8
  Misses          2        2

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update df12156...2010876. Read the comment docs.


Package the schema

We need to package the schema/kernelSchema.json in the pypi release, relying on the latest jupyter-packaging.
I have defined in MANIFEST.in include schema/kernelSchema.json without luck
Do we need to add that path in the setup.pyunder data_files_spec key?

@blink1073 Any advice on this?

This is fixed in master.

This related PR for this is https://github.com/Quansight/ksmm/pull/47


evolution repeatedly prompts for password

Describe the bug
evolution asks for my password repeatedly. When it receives my password, it prints eg.

(evolution:6337): e-data-server-ui-WARNING **: 21:15:49.357: credentials_prompter_store_credentials_cb: Failed to store source credentials: Error calling StartServiceByName for org.freedesktop.secrets: Failed to execute program org.freedesktop.secrets: No such file or directory

and then prompts me again soon after, sometimes every few seconds of actively using evolution.
To Reproduce
Steps to reproduce the behavior:

don't have gnome-keyring-daemon running
start evolution, sign into your IMAP account
use evolution for a while, like, browse through your folders and click a bunch of emails or something.

Expected behavior
evolution should need my password just once per session, or at least once per a few minutes.
Screenshots

Additional context
I'm not running gnome. I think this is down to not having gnome-keyring-daemon running. I guess ideally evolution would arrange for gnome-keyring-daemon to be running if it requires it for its own proper functioning, but I don't know how to say that in nix. If I install and run gnome-keyring-daemon by hand, evolution behaves as expected.
Metadata

system: "x86_64-linux"
host os: Linux 4.19.98, NixOS, 20.03.git.8a9807f (Markhor)
multi-user?: yes
sandbox: yes
version: nix-env (Nix) 2.3.2
channels(ben): ""
channels(root): "nixos-20.03pre210422.8a9807f1941"
nixpkgs: /nix/var/nix/profiles/per-user/root/channels/nixos

Maintainer information:
# a list of nixpkgs attributes affected by the problem
attribute: gnome3.evolution
# a list of nixos modules affected by the problem
module:

I'm not running gnome. I think this is down to not having gnome-keyring-daemon running.

I don't expect most gnome application to even run if the keyring is not available. IIRC the Fractal used to crash instantly on login.

I guess ideally evolution would arrange for gnome-keyring-daemon to be running if it requires it for its own proper functioning

This could be implemented with an option programs.evolution.enable, that will install the package systemwide and enable the keyring service, dconf and whatever gnome needs.
But I'm not sure about this because I don't know to which extent gnome applications are expected to work outside of gnome.

Can nixpkgs express that dependency between the evolution der and gnome

... my hand slipped. Sorry.
Can nixpkgs express that dependency between the evolution derivation and gnome services somehow?

I don't know of anything like this in nixpkgs.
In general if a program needs some non-trivial configuration or has to interact with some other software a NixOS module is written for it, not the way around.  I'm sure a derivation could be made to signal that it needs some service (using something like .passthru) but it's not so clear how and when the system should react to this. Nix would have to

detect is being run on NixOS (because the package could be built and run on any other distro, darwin, BSD...)
generate NixOS configuration that enables the service
trigger a rebuild and activate the configuration

But when would it do all of this? Definitely not after the package is built (you don't want you system to change when just testing a package), maybe after it's installed in the system or in your Nix profile but it won't work for a nix-shell.
So, I don't think it's impossible but this looks pretty complicated and would require changes in Nix and NixOS.

Hm, I'm a bit distressed that it's this easy to end up with basically non-functioning applications. :/

Still important to me; I want to try Evolution on XFCE and I'm having difficulty figuring out which services I need to enable. I've got programs.evolution.enable, services.gnome3.evolution-data-server.enable, and services.gnome3.gnome-keyring.enable all set to true (and have restarted &c.) and I still get an error about a timeout in starting org.freedesktop.secrets whenever I try to authenticate Evolution with my email/calendar provider.

Update: It looks like in my case this might be related to / caused by #61539


[Test] Added kubernetes 1.8 stage on Jenkins

Hello!
Added support to k8s 1.8 on Ginkgo Tests.
Regards

Looks great!
One concern I have here is how this will affect the Jenkins slaves w.r.t. load. Currently we have two executors per node, and each node has 8 cores. Given that the Ginkgo build takes 30 minutes as opposed to 1 hour 45 minutes with the bash script based build, maybe we can go with one executor per node instead of two executors per node to allow for each build to use more resources. Alternatively, maybe we can test other K8s versions only in nightly builds of master, and test only the latest version of K8s that we support in merge builds. This would allow us to increase the number of executors per node, as we would be using fewer resources per build. @tgraf , @aanm: thoughts?

One concern I have here is how this will affect the Jenkins slaves w.r.t. load. Currently we have two executors per node, and each node has 8 cores. Given that the Ginkgo build takes 30 minutes as opposed to 1 hour 45 minutes with the bash script based build, maybe we can go with one executor per node instead of two executors per node to allow for each build to use more resources. Alternatively, maybe we can test other K8s versions only in nightly builds of master, and test only the latest version of K8s that we support in merge builds. This would allow us to increase the number of executors per node, as we would be using fewer resources per build. @tgraf , @aanm: thoughts?

Let's used dedicated nodes. It also leads to more predictable performance results.

@ianvernon Can't we test the k8s builds for only k8s changes?

@ianvernon Can't we test the k8s builds for only k8s changes?

@aanm can you please elaborate? Are you saying that if there is only a change to the K8s tests, then do not run the other stages of the build?

@ianvernon Can't we test the k8s builds for only k8s changes?
@aanm can you please elaborate? Are you saying that if there is only a change to the K8s tests, then do not run the other stages of the build?

No, you were asking if we could have nightly builds for k8s. I was asking if it wasn't possible to run the kubernetes runtime tests based on the labels of a PR, or the code changes.

@aanm  Could the examples files be in Json format instead of yaml?
In JSON format it's easier to replace, and from examples to manifest there are a few of changes. Etcd settings, geneve &vxlan so if it can be in JSON I can use dot notation to replace and render.

@eloycoto, can't parse the yamls to json with go? or even load yaml with go and replace the values as well?

@eloycoto What's the state of this, can we review and merge it?


Elliptic cylinder.

As requested in https://github.com/joostn/OpenJsCad/pull/89, @kaosat-dev, @z3dev :)
Here's how it goes:
check the PR you want to backport and find out the commits you need, here:
f5a339de9278

Clone the commiters repo (the commit is obviously there), and then run format-patch:
git format-patch -1 f5a339d
# 0001-Elliptic-cylinder.patch

Open your own csg.js fork, checkout a new branch from master and :
# Check you can safely apply the patch
git apply --check 0001-Elliptic-cylinder.patch

If you got an error, you'll need to fiddle with the patch by editing it. I attach the original patch and edited here: Archive.zip.
I basically removed the "-" lines that removes something that is not in the original file, then changes the line number to match the new csg structure.
git apply --check 0002-Elliptic-cylinder.patch
# No errors !
git checkout -b elliptic_cylinder
# --signoff option to register who did the patch adaptation job ;)
git am --signoff < 0002-Elliptic-cylinder.patch
git push origin elliptic_cylinder

There's maybe a better way for doing this, but that's the best I know.

awesome , thanks @dav-m85  I am keeping those explanations around, thanks a lot , that will come in handy !


[terra-embedded-content-consumer] Update documentation to include accessibility guidance

Summary
Add a section around accessibility for the Embedded Content Consumer
What was changed:
Documentation update to include accessibility guidance
Why it was changed:
Provide guidance on the implementation to support accessibility guideline
Testing

This change was tested using:

[ ] WDIO
[ ] Jest
[ ] Visual testing (please attach a screenshot or recording)
[ ] Other (please describe below)
[x] No tests are needed

Reviews
In addition to engineering reviews, this PR needs:

[ ] UX review
[x] Accessibility review
[ ] Functional review

Additional Details

This PR resolves:
UXPLATFORM-8572

Thank you for contributing to Terra.
@cerner/terra

@RayGunY  - I updated with more info. I also added a few things as previously suggested by @scottwilmarth .

@sdadn - can you approve and merge? It's only has a documentation update.


Improve Vector documentation

See this thread.
In addition to writing Vector docs examples for other languages (see https://github.com/codecombat/codecombat/issues/1237 for more), we also need to figure out what we're doing in terms of which Vector methods should have their examples shown as class methods and which should be instance methods. Probably our code related to owner needs to get smarter. Part of it is here.

Is there any reason that any of the Vector methods couldn't be both instance methods as well as class methods? This would remove the confusion referred to in the thread as well as allow for different styles depending on the situation.
var diff = Vector.subtract(vecA, vecB); // I prefer this one
var diff = vecA.subtract(vecB);

var vec = Vector.add(Vector.multiply(Vector.normalize(Vector.subtract(vecA, vecB)), distance), vecA);
var vec = vecA.subtract(vecB).normalize().multiply(distance).add(vecA); // I prefer this one.

Hmm. Those methods already exist and are mutating, used all throughout the game engine. But maybe in player code we could somehow hook up non-mutating versions, then allowing all the instance methods?

That's what I was thinking. I didn't realize until now that the instance methods mutate the Vector. That could be confusing, especially when the class methods don't mutate. The docs currently specifically state that a new Vector is returned as well.

Would it be reasonable to extend Vector with a class that only contains non-mutating methods? If so, any ideas for a good name for the class?

All the docs and sample code and global Aether imports and stuff refers to Vectors, so I wouldn't want to change anything's name. I would just want to find a quick hack to make player-code use non-mutating methods instead.

Couldn't we just change this line from:
Aether.addGlobal 'Vector', require './world/vector'
to:
Aether.addGlobal 'Vector', require './world/playerVector'
?

I haven't tested but I think you will end up with player vectors getting into game engine code if that's all you do, and game engine code expects things to be mutable. I suppose it would be slightly possible to refactor all game engine code for immutability in one heroic push, but I'm looking for a way that the current Vectors (no matter where they are created) can just know whether they currently are in player code and decide whether to mutate or not based on that, so we wouldn't have to do a lot of work.

I agree, refactoring the engine code not only be a pain, but a performance decrease as well. Maybe we could add the ability to use an object for apiProperties and friends?
Something like:
{'apiMethodName': 'internalMethodName',
'anotherMethodName': (x) -> foo(x)}

Wait, a Vector can already see if it is currently a normal Vector or an API-protected clone, right? Maybe the Vector code itself can just detect this, in each method, and skip mutation if it detects the API protection (like, if it has the __aetherAPIValue property).
If that works, you have the if @__aetherAPIValue check in each method, but that's not a big performance hit, and is probably good enough for now.
I don't have time to test this out soon, and it will require changes to Vector.coffee to try. I forget, did you have the dev setup working okay on your machine?

Yep, everything is set up and working. I can mess around with it today.


Translate content/ja/docs/concepts/cluster-administration/controller-metrics in Japanese

This is a Feature Request
What would you like to be added
Translate content/ja/docs/concepts/cluster-administration/controller-metrics in Japanese
Why is this needed
This document is not translated in Japanese.
Comments
Original:
https://kubernetes.io/docs/concepts/cluster-administration/controller-metrics/
/language ja
/assign

/kind feature
/priority backlog

/close


😠

😠
Originally posted by @Golffy1468 in https://github.com/MicrosoftDocs/azure-docs/issues/57681#issuecomment-648484410

@Golffy1468 Thank you for reaching out, our engineer will work through the other GitHub thread and feel free to add if you any specific queries on that thread.
Closing this thread for now.

@Golffy1468 Thank you for reaching out, our engineer will work through the other GitHub thread and feel free to add if you any specific queries on that thread.

🎶


Linker script (flash_build.py) not working if project folder is placed outside of SDK.

If an example app is placed outside of default SDK location then linker script fails. It looks like the absolute paths are being used  in script and it fails to locate the "eflash_loader_cfg.ini" file. (The SDK and CHIP environment variables are set)
Log error is mentioned below.
CC build_out/yloop/src/device.o
CC build_out/yloop/src/local_event.o
AR build_out/yloop/libyloop.a
LD build_out/sdk_app_cli.elf
Generating BIN File to /home/username/workspace/sdk_app_cli/build_out/sdk_app_cli.bin
Requirement already satisfied: fdt>=0.2.0 in /home/username/.local/lib/python3.8/site-packages (from -r /home/username/apps/bl_iot_sdk/image_conf/requirements.txt (line 2)) (0.3.0)
Requirement already satisfied: pycryptodomex>=3.9.8 in /home/username/.local/lib/python3.8/site-packages (from -r /home/username/apps/bl_iot_sdk/image_conf/requirements.txt (line 3)) (3.10.1)
Requirement already satisfied: toml>=0.10.2 in /home/username/.local/lib/python3.8/site-packages (from -r /home/username/apps/bl_iot_sdk/image_conf/requirements.txt (line 4)) (0.10.2)
Requirement already satisfied: configobj>=5.0.6 in /home/username/.local/lib/python3.8/site-packages (from -r /home/username/apps/bl_iot_sdk/image_conf/requirements.txt (line 5)) (5.0.6)
Requirement already satisfied: six in /usr/lib/python3/dist-packages (from configobj>=5.0.6->-r /home/username/apps/bl_iot_sdk/image_conf/requirements.txt (line 5)) (1.14.0)
Traceback (most recent call last):
File "flash_build.py", line 1397, in
shutil.copy(eflash_loader_cfg_org, eflash_loader_cfg)
File "/usr/lib/python3.8/shutil.py", line 415, in copy
copyfile(src, dst, follow_symlinks=follow_symlinks)
File "/usr/lib/python3.8/shutil.py", line 261, in copyfile
with open(src, 'rb') as fsrc, open(dst, 'wb') as fdst:
FileNotFoundError: [Errno 2] No such file or directory: '/home/username/apps/bl_iot_sdk/customer_app/sdk_app_cli/build_out/eflash_loader_cfg.ini'
make: *** [/home/username/apps/bl_iot_sdk//make_scripts_riscv/project.mk:195: all] Error 1
Snippet "Flash_build.py": line number 1389
if name == 'main':
abs_path = os.path.abspath('..')
app_path = os.path.join(abs_path, "customer_app", sys.argv[1])
demo_name = sys.argv[1]
chip_name = sys.argv[2].lower()

Hello, normally the bin should still be compiled and flashable.
Though I made PR to fix this: #87, I'm just waiting for gamelaster to reviews it and merges it, if everything is fine of course.
If you want to test it, I think you can pull my code or directly edit the sdk.

Hello, normally the bin should still be compiled and flashable.
Though I made PR to fix this: #87, I'm just waiting for gamelaster to reviews it and merges it, if everything is fine of course.
If you want to test it, I think you can pull my code or directly edit the sdk.

Thanks. I will test it over the weekend.

Hello, normally the bin should still be compiled and flashable.
Though I made PR to fix this: #87, I'm just waiting for gamelaster to reviews it and merges it, if everything is fine of course.
If you want to test it, I think you can pull my code or directly edit the sdk.

I tested the code changes and it is working. Thanks.


the toc is related to business removing education

education is in another toc

Thanks for your comment. Much of the content between Microsoft Store for Education and Microsoft Store for Business is the same - they are branded as different experiences, but the majority of the functionality is the same. I'll close this pull request -- please follow up in email if you have additional questions. Thanks.

Closing per writer request


imageset-view: add Distribution and OutputTypes.

Description
Add additional field to enable UI to accomplish parity with image-builder images list
because of freeze create PR to maydev branch
FIXES: THEEDGE-3279
Type of change
What is it?

[ ] Bug fix (non-breaking change which fixes an issue)
[X] New feature (non-breaking change which adds functionality)
[ ] Documentation update
[X] Tests update
[ ] Refactor

"Coverage report not available"

/mergifyio queue

/retest


DBZ-3170 Adding KC Promethes port to allowed network policy

https://issues.redhat.com/browse/DBZ-3170

Thx!


Running SVTyper on any SV tool

Hi,
I'm hoping to be able to run SVTyper in a generic mode on any SV tool.
I have tried running SVTyper on Manta and SvAbA vcfs, and am running into errors because SVTyper is looking for information that is not listed in these files. For example, some entries in Manta do not have CIPOS and SvAbA does not list CIPOS for any of its entries. SVTyper stops and throws an error because it cannot find CIPOS. There have also been other format-specific errors I've run into, such as SVTyper throwing an error when an additional '>' is found in the FORMAT header section.
Will there be a version of SVTyper that is more lenient with the vcf format, so that it can be run on other SV callers besides Lumpy?

Hi Molly,
Have you resolved that problem? I am facing the same problem.

I think there is likely to be a version of svtyper that does this at some point, but I'm not sure when that may happen. I've run into the same issue for Manta and have had to add CIPOS and CIEND manually using bcftools.

I know this is an old issue, but is there a standardised way to decide how to bound CIPOS and CIEND? Is it a proportion of the overall size of the SV?

#111 works around the missing CIPOS

Dear @ernfrid
I know this is a very old issue; but may I ask how you added CIPOS and CIEND using bcftools? Any specific commands? Can bcftools calculate these CIs for SVs?
Thank you in advance

@dr-ashu-geno - It's been too long for me to recall for certain, but I'm fairly sure I calculated outside of svtools and then simply added the new tags to the VCF using bcftools annotate. I'm not aware of a standard way to calculate these. I know in the past I used either fixed window sizes or 0 size, but that was tool dependent.


Command Error

az sql server tde-key Set --resource-group myresourcegroup --server myserver --server-key-type AzureKeyVault --kid "https://myresource.vault.azure.net/keys/mykeyname/key"
Deployment failed. Correlation ID: . The requested server key was not found.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: ea369391-5bd1-845a-83c8-f544d30728db
Version Independent ID: 251e46ee-9f7a-2e64-8ae0-30837b23897b
Content: az sql server tde-key
Content Source: src/azure-cli/azure/cli/command_modules/sql/_help.py
Service: sql-database
GitHub Login: @rloutlaw
Microsoft Alias: routlaw

@jose-lima2011, how did you resolve this error?

we are also facing this exact same issue. the below command returns key not found whereas the key exists in the keyvault. the keyvault and sql server are in the same subscription.
az sql server tde-key set --resource-group myresourcegroup --server myserver --server-key-type AzureKeyVault --kid "https://myresource.vault.azure.net/keys/mykeyname/key"
Deployment failed. Correlation ID: . The requested server key was not found.

@manishtulsiani, we resolved this error by running two az cli commands: az sql server key create <options> && az sql server tde-key set <options>. Setting the tde key via the portal apparently takes care of both, but if you're doing it purely from the az cli, you have to take both actions to first create the key and then set it.

We resolved this error by running two az cli commands: az sql server key create <options> && az sql server tde-key set <options>. Setting the tde key via the portal apparently takes care of both, but if you're doing it purely from the az cli, you have to take both actions to first create the key and then set it.

Thank you @paul-kr


No tensorflow lite 2.4.0 pre-built libraries

System information

OS Platform and Distribution: Android
TensorFlow installed from (source or binary): Binary
TensorFlow version: 2.4.0

Describe the problem
Can not find pre-built libraries for tensorflow lite 2.4.0 at the below location. Latest available version is older 2.3.0
https://bintray.com/google/tensorflow/tensorflow-lite

They should exist now:
https://bintray.com/google/tensorflow/tensorflow-lite/2.4.0

Note that, while the libraries have been uploaded, we're experiencing some issues syncing these libraries with JCenter. Hoping to resolve shortly.

Yes. Works now. Thanks!


Mountain Car Reward Fn

The current definition of mountain car uses pos' and vel' while the termination criteria uses pos and vel. Should the reward function should also be using pos and vel rather than pos' and vel' to keep things in sync?

Hi Pecey, we are sorry for the confusion.
If I recall correctly, how it works is like this:

Given current state, e.g. pos and vel as input, compute pos' and vel' from the CPFs.
Set pos <- pos' and vel <- vel'
Then evaluate the termination condition, action precondition and state invariants using (pos, vel) as current state

We had internal discussion where we debated what the right chronology of updating should be, and it seems this is how things have been traditionally done (i.e. the constraints are always calculated using the most recent state/observation available). In fact, using pos'/vel' in constraints should raise an exception.
I believe this will need to be better documented in the readthedocs, since it is a very subtle point right now.

Thank you @mike-gimelfarb for the response. That helps clear it up. I was assuming reward function to be R(s,a) rather than R(s,a,s') (and I think that all the gym environments that I have seen use R(s,a)) but this helps.
About the termination discussion: I agree. Its just that the meaning would change depending when you map x <- x' for a state variable x. In the current scenario, for example, if we don't perform Step 3 (Set pos <- pos' and vel <- vel'), then simply reading the RDDL file gave me an impression that the update was happening on the older value of state and not the updated value, which caused the confusion.
I have created a PR with the reward function. It would be great if you could kindly have a look at it and merge it.


Preview Templates are flickering on update

Describe the bug
So, it seems like my preview components in the CMS are flickering, i.e. reloading the images and custom fonts every time I update the component with new copy in the CMS. This ONLY seems to happen when my site is hosted online at https://amazing-almeida-cc9291.netlify.app/ it does NOT come up when I run it locally in the build environment or when I build and serve it locally. Thus, this is rather hard to debug. If it happened everywhere I would imagine it to be a React component issue (wherein the entire component is being updated every time)
I think this video captures the issue better than words: https://streamable.com/z7ncqq
To Reproduce
The repository can be viewed here: https://github.com/Yukon-Literacy-Coalition/ylc_website_v2
To reproduce you would need to have access to the CMS at https://amazing-almeida-cc9291.netlify.app/
Expected behavior
I imagine it should not be flickering. I'm not sure why this reloading behaviour is only happening when the site is hosted online.
Applicable Versions:
Netlify CMS version: "netlify-cms-app": "^2.12.20",
Git provider: github
OS: macOS 10.14
Browser version evergreen chrome
Node.JS version:
10.15 (locally)
CMS configuration
https://github.com/Yukon-Literacy-Coalition/ylc_website_v2/blob/master/src/CMS/config.js

Closing as stale and/or outdated.


[Instagram] Add TFA login support

Please follow the guide below

You will be asked some questions, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your pull request (like that [x])
Use Preview tab to see how your pull request will actually look like

Before submitting a pull request make sure you have:

[x] At least skimmed through contributing guidelines including yt-dlp coding conventions
[x] Searched the bugtracker for similar pull requests
[x] Checked the code with flake8

In order to be accepted and merged into yt-dlp each piece of code must be in public domain or released under Unlicense. Check one of the following options:

[x] I am the original author of this code and I am willing to release it under Unlicense
[ ] I am not the original author of this code but it is in public domain or released under Unlicense (provide reliable evidence)

What is the purpose of your pull request?

[ ] Bug fix
[x] Improvement
[ ] New extractor
[ ] New feature

Description of your pull request and other information
Explanation of your pull request in arbitrary form goes here. Please make sure the description explains the purpose and effect of your pull request and is worded well enough to be understood. Provide as much context and examples as possible.
Allows someone to enter their TFA code from the authenticator app, SMS, or with the backup codes.
Drafted as SMS TFA is broken (which isn't easy to test since it's heavily rate-limited, which is also why WhatsApp TFA isn't implemented yet)

@MinePlayersPE can you tell how to use tfa? yt-dlp is not asking for tfa.

Closing for now due to uncertainties around Meta banning accounts (I don't necessarily want to work on stuff encouraging that)


Provide detailed guide for getting started

Specify docker image tag explicitly (Which version we use for influxdb and grafana?)
Document how to change configuration manually
Create database if not exists rather than provide them as binary file in test folder

ping @LinkinPF

Thank you for your guidance, we are ready to start optimizing this content.


add Braintree as a data source / extractor

Migrated from GitLab: https://gitlab.com/meltano/meltano/-/issues/1805
Originally created by @dmor on 2020-02-26 16:40:20

We learned on a customer call that Braintree would be a useful extractor to support in Meltano. It contains financial transaction data, and is a common alternative to Stripe (existed before Stripe did)

View 1 previous comment from the original issue on GitLab


Statistics

[ ] Season Specific
[ ] Division Specific
[ ] Hero Specific
[ ] Map Specific
[ ] Team Specific
[ ] Player Specific
[ ] Overall
[x] Match Specific

@Mistv @Fabian-Sommer
We need denormalized database models in order to reflect these statistics.


ptrace ARM fix, hardlinks copy failover, dynamic workspace & report file improvements

GETREGS fix for old ARM kernels

PTRACE_GETREGS for some old ARM kernels is failing to extract register values if provided struct size is bigger than expected pt_regs. Bug is fixed by avoiding 32/64-bit structs multiplexing for ARM kernels. arch_getPC() will always execute the 32bit branch so no further pre-processor pollution is required.
Bug has been spotted when fuzzing with Nexus4 5.1.1 running 3.4 kernel

Bypass hardlink restrictions

Running environment might prevent hardlinks (e.g. SELinux restrictions in Android). As such fuzzer is failing to write identified crashes. A new copyFile helper function has been introduced to bypass such hardlink restrictions by failing over to a manual POSIX implementation.
Destination file O_EXCL attr. is ensuring that unique crashes feature will be functionally identical since existing files are successfully detected.

.gitignore update to exclude example binary

Two more small improvements:

report: Save actual crash name

Instead of tmp runtime filename save in the report file the actual crash filename. Increases usability / scriptability of report files.

Dynamic workspace

Fuzzing target environment might deploy security controls that require input files being loaded from whitelisted locations. Currently honggfuzz is using only current directory as workspace to create runtime files and save crashes. Certain setups might result into dead-end if whitelisted locations are marked as non-exec.

This commit allows the workspace directory to be dynamically defined with the "-W" argument. Workspace directory is used for mangled runtime files, tmp perf data & to save crashes. Report file is left untouched since it can controlled with existing "-R" flag.

Issue has been identified while fuzzing Android media daemons where SELinux allows input files to be loaded only from limited RO NX paths.

Resolved conflicts from your recent refactor changes. Also pushed a small fix for posix arch related to files_copyFile().
Unfortunately commit:https://github.com/google/honggfuzz/commit/ea39a8f5c96af12e32f79a1a95e43a92a17e3d20 has partially broken Android. Something is going wrong with thread safety locks and main exec loop is not unblocking sem_wait in case of CTRL+C SIGINT signal. Will review your refactor in fuzz.c at some point to fix this (someone need to manually kill pid to stop fuzzer in case of maxMutations not set).

I got rid of semaphores in honggfuzz, and started relying on signals/atomics exclusively. I think this will simplify things for android/maxosx

Yup getting rid of the semaphores solved the issues. Will resolve the conflicts and do some more testing just to be sure. Will update this pull request as soon it's done.

Resolved conflicts with refactored code and re-tested small fixes / improvements in this pull request. Display & refactor code appears to work fine with Android too.

As always, thank you!


[BUG] ServiceBusSenderClient.sendMessages(Iterable) silently drops messages

Describe the bug
When using the function com.azure.messaging.servicebus.ServiceBusSenderClient.sendMessages(Iterable) we detected that not all of our messages sent to the service bus topic.
Our supposition is that if the size off all message is too big all the other messages are silently dropped
Exception or Stack Trace
No Exception is available
To Reproduce
Call the function ServiceBusSenderClient.sendMessages(Iterable) with a size greater than the maximum size of a single batch
Code Snippet
ServiceBusSenderClient.sendMessages(Iterable)
Expected behavior
If the size of messages exceed the maximum size of a single batch, an exception will be triggered and the send will fail.
Screenshots
Not available
Setup:

OS: WINDOWS 10
IDE: eclipse / intellij
Library/Libraries: com.azure:azure-sdk-bom:1.2.9
Java version: 11
App Server/Environment: Tomcat
Frameworks: Spring Boot

Information Checklist

[ x ] Bug Description Added
[ x ] Repro Steps Added
[ x ] Setup information Added

A quick example to reproduce this observed behavior looks as follows:
Note for all examples: the connection url + topic have to be replaced with something actually correct for them to work
ServiceBusSenderClient senderClient = new ServiceBusClientBuilder()
    .connectionString(AzureConfiguration.CONNECTION_URL)
    .sender()
    .topicName(AzureConfiguration.TOPIC)
    .buildClient();
LOGGER.info("Going to send 1000 messages to the topic '{}'", AzureConfiguration.TOPIC);
List<ServiceBusMessage> messages = new ArrayList<>();
for (int j = 1; j <= 1000; j++)
{
    ServiceBusMessage message = new ServiceBusMessage(
        "body46634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz"
            + "544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zg"
            + "tfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghr"
            + "fgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg"
            + "547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz547466347"
            + "34ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z5475"
            + "4zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz547" + j);
    message.getApplicationProperties().put("longpropertynamethatcausesfurthersizeincrease", j);
    messages.add(message);
}
senderClient.sendMessages(messages);
LOGGER.info("finished sending message batch with size {}", messages.size());
senderClient.close();

so it should send 1000 messages in one batch, there is also no error when running it and the final logline is shown as e.g.
2023-02-03 09:40:57.759+0100 05 [main] I    at.poc.azure.azure.ProviderClient - finished sending message batch with size 1000

however there is another log
2023-02-03 09:40:57.592+0100 05 [reactor-executor-1] I  c.a.m.s.ServiceBusSenderAsyncClient - {"az.sdk.message":"Sending batch.","batchSize":355}

that looks weird and checking the subscription suddenly shows far less than 1000 messages in it:

So only 355 messages, like in the other log, actually arrived. Running it a few times shows it will always be the same number.
So after having a rough guess that it might be related to the size limit another test with only 300 messages sent in the batch to confirm if it's a "static" cutoff or some percentage that is lost as shown below
ServiceBusSenderClient senderClient = new ServiceBusClientBuilder()
    .connectionString(AzureConfiguration.CONNECTION_URL)
    .sender()
    .topicName(AzureConfiguration.TOPIC)
    .buildClient();
LOGGER.info("Going to send 1000 messages to the topic '{}'", AzureConfiguration.TOPIC);
List<ServiceBusMessage> messages = new ArrayList<>();
for (int j = 1; j <= 300; j++)
{
    ServiceBusMessage message = new ServiceBusMessage(
        "body46634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz"
            + "544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zg"
            + "tfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghr"
            + "fgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg"
            + "547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz547466347"
            + "34ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z5475"
            + "4zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz547" + j);
    message.getApplicationProperties().put("longpropertynamethatcausesfurthersizeincrease", j);
    messages.add(message);
}
senderClient.sendMessages(messages);
LOGGER.info("finished sending message batch with size {}", messages.size());
senderClient.close();

shows that this time all 300 messages arrived as expected:

To finally further confirm it's likely related to the message size we ran one more test with one additional property set per message to slightly increase the size of each message
ServiceBusSenderClient senderClient = new ServiceBusClientBuilder()
    .connectionString(AzureConfiguration.CONNECTION_URL)
    .sender()
    .topicName(AzureConfiguration.TOPIC)
    .buildClient();
LOGGER.info("Going to send 1000 messages to the topic '{}'", AzureConfiguration.TOPIC);
List<ServiceBusMessage> messages = new ArrayList<>();
for (int j = 1; j <= 1000; j++)
{
    ServiceBusMessage message = new ServiceBusMessage(
        "body46634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz"
            + "544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zg"
            + "tfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghr"
            + "fgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg"
            + "547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz547466347"
            + "34ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z5475"
            + "4zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz547" + j);
    message.getApplicationProperties().put("longpropertynamethatcausesfurthersizeincrease", j);
    messages.add(message);
}
senderClient.sendMessages(messages);
LOGGER.info("finished sending message batch with size {}", messages.size());
senderClient.close();

and it shows that this is indeed likely the cause because now an even lower number of messages - 322 - actually arrived

So all things considered it seems very likely the client contrary to his documentation of

does indeed not fail the send but just silently drop messages.
After some checking I've found the following code example https://github.com/Azure/azure-sdk-for-java/blob/main/sdk/servicebus/azure-messaging-servicebus/src/samples/java/com/azure/messaging/servicebus/SendMessageBatchSample.java that shows the usage of sender.createMessageBatch(new CreateMessageBatchOptions().setMaximumSizeInBytes(1024)) to address this limit and running a quick test (our max size is 256KB) as shown below
ServiceBusSenderClient senderClient = new ServiceBusClientBuilder()
    .connectionString(AzureConfiguration.CONNECTION_URL)
    .sender()
    .topicName(AzureConfiguration.TOPIC)
    .buildClient();
LOGGER.info("Going to send 1000 messages to the topic '{}'", AzureConfiguration.TOPIC);
ServiceBusMessageBatch currentBatch = senderClient.createMessageBatch(
    new CreateMessageBatchOptions().setMaximumSizeInBytes(256*1024));
int count = 0;
for (int j = 1; j <= 1000; j++)
{
    // this examples assumes the topic already exists
    ServiceBusMessage message = new ServiceBusMessage(
        "body46634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz"
            + "544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zg"
            + "tfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghr"
            + "fgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg"
            + "547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz547466347"
            + "34ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz54746634734ghrfgdrz544z5475"
            + "4zdhg547zgtfhz54746634734ghrfgdrz544z54754zdhg547zgtfhz547" + j);
    message.getApplicationProperties().put("longpropertynamethatcausesfurthersizeincrease", j);
    if (currentBatch.tryAddMessage(message))
    {
        count++;
        continue;
    }
    // The batch is full, so we create a new batch and send the batch.
    senderClient.sendMessages(currentBatch);
    LOGGER.info("finished sending message batch with size {}", count);
    count = 0;
    currentBatch = senderClient.createMessageBatch();
    // Add that message that we couldn't before.
    if (!currentBatch.tryAddMessage(message)) {
        LOGGER.error("Message is too large for an empty batch. Skipping. Max size: {}. Message: {}",
            currentBatch.getMaxSizeInBytes(), message.getBody());
    }
    else
    {
        count++;
    }

}
senderClient.sendMessages(currentBatch);
LOGGER.info("finished sending message batch with size {}", count);
senderClient.close();

which also produces way more favorable logs
2023-02-03 10:57:29.753+0100 05 [main] I  c.a.m.s.ServiceBusSenderAsyncClient - {"az.sdk.message":"Sending batch.","batchSize":332}
2023-02-03 10:57:30.033+0100 05 [main] I    at.poc.azure.azure.ProviderClient - finished sending message batch with size 332
2023-02-03 10:57:30.037+0100 05 [main] I  c.a.m.s.ServiceBusSenderAsyncClient - {"az.sdk.message":"Sending batch.","batchSize":331}
2023-02-03 10:57:30.157+0100 05 [main] I    at.poc.azure.azure.ProviderClient - finished sending message batch with size 331
2023-02-03 10:57:30.159+0100 05 [main] I  c.a.m.s.ServiceBusSenderAsyncClient - {"az.sdk.message":"Sending batch.","batchSize":331}
2023-02-03 10:57:30.253+0100 05 [main] I    at.poc.azure.azure.ProviderClient - finished sending message batch with size 331
2023-02-03 10:57:30.254+0100 05 [main] I  c.a.m.s.ServiceBusSenderAsyncClient - {"az.sdk.message":"Sending batch.","batchSize":6}
2023-02-03 10:57:30.323+0100 05 [main] I    at.poc.azure.azure.ProviderClient - finished sending message batch with size 6

and finally shows exactly 1000 messages in the subscription.

further confirmed our suspicion.
With all this said either the implementation is currently wrong to not raise an error, or the javadoc of the method is not correct because it does not raise one but rather silently drop the messages.
Personally I'd prefer getting the exception since it's easier to spot and then search and fix with the intended max size batching mechanism rather than just loosing messages without any bad log line ever, but ultimately either one is fine as long as the javadoc is at least correct. Maybe some pointer to senderClient.createMessageBatch() in it would also make it more transparent how to use the api in a save way.
Thanks!

Thanks @florianmack, for the great analysis; I'll see how we can improve the API experience to avoid the undesired dropping of messages.

Just spent a good while debugging an application in production because of the SDK silently dropping messages.
It should really be prioritized, this issue is coming up on its 1-year birthday, and it makes part of the service bus SDK unusable, and untrustworthy.
We consistently saw sendMessages dropping the same amount of messages when given the same list every time. No log statements were made about dropping the messages, and no exception was thrown.
Introducing our own batch-handling solved the issue.

Fixed by #40462


Swift 3

Hey, I'm trying this branch and, shouldn't the .podspec use the 2.0 version of ObjectMapper?
s.dependency 'ObjectMapper', '~> 1.0'
should be
s.dependency 'ObjectMapper', '~> 2.0'
right? I opened a PR https://github.com/tristanhimmelman/AlamofireObjectMapper/pull/153 which commit  may be added to this PR
Cheers!


Kill the isGoogleApi flag

We are not using this flag anywhere, and it's better not to
have special logic for Google APIs. In the implementation, a
variable of the same name remains because it is necessary to support
the GitHub zip archive use case.

Current coverage is 88.56% (diff: 100%)

Merging #74 into master will not change coverage

@@             master        #74   diff @@
==========================================
  Files             3          3
  Lines           717        717
  Methods         150        150
  Messages          0          0
  Branches        106        106
==========================================
  Hits            635        635
  Misses           82         82
  Partials          0          0

Powered by Codecov. Last update ca3577a...4e0006c

LGTM, with a nit: "isGoogleApi" is actually referred from the doc-comments for some methods in api_repo.js (setUp(), buildPackages(), buildGaxPackages()). It's nice to be removed there.


Conan

Nice! I remember this. And actually I think this might be useful for some. I don't know if there really is a standard implementation in C++ for BSplines.
What do you think about publishing this to CONAN? Then people could easily use it.

But I'd suggest dropping the Eigen dependency. In C++ it's easy to work on raw buffers and we could pass pointers to Eigen buffers to functions which only use standard library data structures, like here

Amazing!
Let's make it happen when we find the time.
I know of at least one large neutrino detector which uses a custom implementation in their analysis code.
We should at some point compare the speed to DeBoors fortran implementation.
Am 1. Dez. 2023, um 17:33, Jan Ullmann<EMAIL_ADDRESS>schrieb:
Yes, this is a great idea.
Before reading the second comment I already wanted to say that we should use your implementation without Eigen. Also in your implementation the output is not reversed.
However, we need to have a thorough documentation of the boundary conditions. The ones we used are not obvious from the recursive pattern. Probably the notes we have gathered can help with that.
—
Reply to this email directly, view it on GitHubhttps://github.com/ullmannJan/B-Splines/issues/2#issuecomment-1836426374, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AHRUCHGRPD74R6FE22ZNLKLYHIBELAVCNFSM6AAAAABADA77FGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQMZWGQZDMMZXGQ.
You are receiving this because you authored the thread.Message ID: @.***>


Support ItParametersNode

So that compilers know they need to add to add an anonymous variable to the local table. Also, add a bunch of errors for the various combinations of parameters now, including:

defining numbered, but ordinary already defined
defining it, but ordinary already defined
defining numbered, but it already defined
defining it, but numbered already defined

So that compilers know they need to add to add an anonymous variable to the local table.

Isn't it the same as _1? Maybe CRuby names the hidden variable differently for it than for _1`?

Yeah it's named for _1 and it's not named for it.

Regardless, this node is smaller anyway


Quit to Project List causes Godot to freeze

Operating system or device - Godot version:
Windows 7, Godot 2.1 beta
Issue description (what happened, and what was expected):
Option Quit to Project List causes editor to freeze. The editor just hangs up and needs to be terminated. It throws out exception c0000005. The Project Manager window opens fine.
Steps to reproduce:

Open/Create a project
Quit to project list

Sorry for double post #5664. We post it almost at the same time. At least we know it happens also on Win 7.

Closing as duplicate of  #5664.


keyof a function type is equivalent to never

Bug Report

🔎 Search Terms

keyof
function
never
getProperty

🕗 Version & Regression Information
The issue occurs in every version currently available in the playground (3.3.3 thru 4.2.0-beta).
⏯ Playground Link
Playground link with relevant code.
💻 Code
// from https://www.typescriptlang.org/docs/handbook/release-notes/typescript-2-1.html#example-1
function getProperty<T, K extends keyof T>(obj: T, key: K) {
  return obj[key]; // Inferred type is T[K]
}

let foo = [0, 1, 2];
foo.length; // works
getProperty(foo, 'length'); // works

let bar = function foo(){};
bar.name; // works
getProperty(bar, "name"); // ⚠ compile error!?

🙁 Actual behavior
keyof (() => void) is equivalent to never.
🙂 Expected behavior
I expected keyof (() => void) to be equivalent to a union of string literal types including 'name'.

Duplicate #16578

@RyanCavanaugh can you clarify the what the intended behavior here is? What's the distinction between these cases?
let foo = [0, 1, 2];
getProperty(foo, 'length');   // works
getProperty(foo, 'map');      // works

let bar = 42;
getProperty(bar, "toFixed");  // works

let baz = function foo(){};
getProperty(baz, "name");     // ⚠ compile error!
getProperty(baz, "bind");     // ⚠ compile error!

I don't quite follow @ahejlsberg's explanation that:

The keyof operator only considers the declared or inherited properties of a type, not those that come from its apparent type.

Doesn't toFixed come from the apparent type of 42?

It appears that rule only applies to non-primitives.

Array isn't a primitive, yet this rule doesn't apply to it.


Fix coordinate in example

This fix URL in example.js comment. It's not google-maps, should be long,lat not lat,long :)

Hrm I thought we fixed those a couple of month ago. Seems like we forgot this.
Thanks for catching this!
Travis failing is unrelated due to some tbb lib copying issue cc @TheMarex @springmeyer

Travis failing is unrelated due to some tbb lib copying issue cc @TheMarex @springmeyer

@daniel-j-h this is ticketed at https://github.com/Project-OSRM/node-osrm/issues/274

Thank you for merge. I like pace of this project.


DP-723 Added generic http operations, refactored createRequest

The main idea of the PR is to add dead-simple get(), post(), etc operations that will allow sending requests to any Paxful API endpoints.
Some endpoints require json payload, that was not possible using invoke() function.
As invoke() function became too complex, decided to refactor it and introduce RequestBuilder, that hides all the complexity of request and response configuration.

I will apply all the changes discussed above, and recreate this PR.
The problem with this PR is that it can not be built properly, as there are no environment variables provided for external repos.


Prediction result

Hi,
   First of all, let me appreciate your work. Thanks for this great code and the efforts you have put in and your contributions to the AI community. The code works perfectly. Can you just guide me with training? I trained with two classes and my prediction was incorrect.

@sanjanasri could you elaborate a bit on the sample data size? Epochs and other meta data around the dataset?


Auth Slice done

To test, sign in with cody 123. Admin page should render a notification that user is not admin.
Sign in with sey abc. Is an admin.
TO NOTE
requireToken
requireAdminToken
If you want to protect routes, use the above mentioned middleware.

theres a bug when you log in w/ an admin account, and then log in with a none admin account you can still see the admin stuff. however, when you refresh the page, the proper permissions are shown. is there a way that we can refresh the page when user logs in/logs out?

Quick fix was to trigger logout action dispatcher to clear the admin reducer as well. We'll need to refactor the store so that action consts and action creators are all in one central file to export them out to reducers as needed.


Handle tuple function arguments

When we've got a function like this for example:
let f (x:int) (y:int * z:string) -> ... it gets translated into a function of arity 3. This works fine for fez to fez function calls but breaks in interop scenarios where one of the arguments is a genuine tuple. Eg ets:insert/2.
To fix we should make functions with tuple args use the correct arity. This means that methods now will take a tuple with the method args rather than straight method arguments. This is a micro-inefficiency I am prepared to take for the sake of simplicity.

fixed


use barge instead of ganache

For consistency, let's use barge for unit tests as well
You can say that it's over engineered, but if we need to change the mnemonic, or activate/deactivate EIPS, we are going to do that in one repo (barge)

please no. Please keep them separated so we do not wait for ages for every test. There is a reason I split them up and NOT using barge for the unit tests. If you need more than ganache for a test, it's an integration test,

instead of running ganache:latest with some extra param, we run barge with ganache and without aqua/provider/es, etc..

alright, so Ganache with Barge starts up faster than Ganache directly from DockerHub so let's go with that


Join node not reset when operating in automatic mode

In automatic join mode, with two input messages supplied with .parts parameters specified in order to make a combined message in the correct sequence order, the join node does not appear to stop the joining process when issued with a reset command between each set of input messages.
The join node should only be returning output when all parts of the incoming messages have been received. The automatic functionality is desired as this is the only one that appears to use the .parts function in order to maintain correct sequence order (to account for potential time delay differences in the preceding branches which could, for example, be querying data from Modbus devices)
What are the steps to reproduce?
Using the following simple flow, adapted from issue #2188 and injecting in the following order:
[{"id":"ac5a770f.97b148","type":"tab","label":"Flow 2","disabled":false,"info":""},{"id":"b17c6fd0.cc286","type":"inject","z":"ac5a770f.97b148","name":"prop1","props":[{"p":"payload"},{"p":"topic","vt":"str"},{"p":"parts","v":"{\"id\":\"group\",\"count\":2,\"len\":1,\"index\":0}","vt":"json"}],"repeat":"","crontab":"","once":false,"onceDelay":0.1,"topic":"","payload":"{\"prop1\":\"value1\"}","payloadType":"json","x":482,"y":312,"wires":[["721aa4a4.2e7bec"]]},{"id":"721aa4a4.2e7bec","type":"join","z":"ac5a770f.97b148","name":"","mode":"custom","build":"array","property":"","propertyType":"full","key":"topic","joiner":"\\n","joinerType":"str","accumulate":false,"timeout":"","count":"2","reduceRight":false,"reduceExp":"","reduceInit":"","reduceInitType":"num","reduceFixup":"","x":936,"y":468,"wires":[["e2d98dc7.a1575"]]},{"id":"e2d98dc7.a1575","type":"debug","z":"ac5a770f.97b148","name":"","active":true,"tosidebar":true,"console":false,"tostatus":false,"complete":"true","targetType":"full","x":1076,"y":468,"wires":[]},{"id":"21543c43.15cf14","type":"inject","z":"ac5a770f.97b148","name":"prop2","props":[{"p":"payload"},{"p":"topic","vt":"str"},{"p":"parts","v":"{\"id\":\"group\",\"count\":2,\"len\":1,\"index\":1}","vt":"json"}],"repeat":"","crontab":"","once":false,"onceDelay":0.1,"topic":"","payload":"{\"prop2\":\"value2\"}","payloadType":"json","x":506,"y":528,"wires":[["721aa4a4.2e7bec"]]},{"id":"e2a2d142.5bd34","type":"change","z":"ac5a770f.97b148","name":"msg.reset -> true","rules":[{"t":"set","p":"reset","pt":"msg","to":"true","tot":"bool"},{"t":"delete","p":"payload","pt":"msg"}],"action":"","property":"","from":"","to":"","reg":false,"x":594,"y":408,"wires":[["721aa4a4.2e7bec"]]},{"id":"54880bbb.db1eb4","type":"inject","z":"ac5a770f.97b148","name":"reset","props":[{"p":"payload"},{"p":"topic","vt":"str"}],"repeat":"","crontab":"","once":false,"onceDelay":0.1,"topic":"","payload":"","payloadType":"date","x":410,"y":408,"wires":[["e2a2d142.5bd34"]]}]
Test Case 1

prop1
prop2

Test Case 2

prop2
prop1

Test Case 3

prop1
reset
prop2

Test Case 4

prop2
reset
prop1

Test Case 5

prop1
prop1

What happens?
Test Case 1: Output is a combined message with payload order [0] value1, [1] value2
Test Case 2: Output is a combined message with payload order [0] value1, [1] value2
Test Case 3: Output is an error message followed by a combined message with payload order [0] value1, [1] value2
Test Case 4: Output is an error message followed by a combined message with payload order [0] value1, [1] value2
Test Case 5: Output is a combined message with payload order [0] value1
What do you expect to happen?
Test Case 1: As expected
Test Case 2: As expected with desired sequence order as specified in message parts.
Test Case 3: As a reset message was sent before the second message I expect the counter and intermediate/incomplete object to be discarded. Therefore no output is sent at that moment in time.
Test Case 4: As a reset message was sent before the second message I expect the counter and intermediate/incomplete object to be discarded. Therefore no output is sent at that moment in time.
Test Case 5: Two parts have been supplied (given two injections of prop1 node) but only a payload of size 1 is returned as values have been overwritten. No test appears to be made to ensure all parts of the message are present before returning output. Ie although the count is two input messages only a single index value is present.
Please tell us about your environment:

[ ]  Node-RED version: v1.2.7
[ ] Node.js version: 12.19.0
[ ] npm version: 6.14.8
[ ] Platform/OS: Windows 10
[ ] Browser: Chrome

So the only actual error condition is 5 - where indeed if the parts are supplied with an index and you are building an array then  it should replace any existing index and not count towards the total array. Bit of an odd case as you would not expect to have parts with a duplicate index - but yes it shouldn't output.


Hardware requirements for Certificate Manager

I can't see any information hardware requirements of

CanIJector
Cert-Manager-Controller
Cert-Manager-Webhook

Can the documentation be improved on that?

Thanks for raising the issue!
I agree we could do a better job of documenting this kind of thing. I'm not sure we have much in the way of explicit numbers we could use to make hardware recommendations, but I'm sure it wouldn't be too hard to get some baseline numbers. If you'd be interested in contributing - either here or on the website - I'd love to see a PR!
Entirely anecdotally, I've run a small cert-manager installation successfully on a 1GB Raspberry Pi 3 using k3s, which is a pretty low-power environment to be running on. I suspect that in practice, any k8s clusters that are realistically run in production could run cert-manger without too many issues.


Preparations for Chromium 100

Please respond if you would like to update ungoogled-chromium to the new stable Chromium version.
Notes for the developer
Once you claim it, it is advisable that you create a Draft Pull Request for increased visibility:

Finally, make sure to reference this issue in your PR.
Feel free to ask questions and discuss issues here along the way. Thanks!
Notes for others
Feel free to raise issues or questions throughout the process. However, please refrain from asking ETAs unless no visible progress has been made here or on the developer's PR for a while (e.g. 2 weeks).
Chrome 100 will be released on march 29th
so we  should ... prepare for it
https://www.androidpolice.com/chrome-100/

Why exactly do we need an issue for this if a pull request is already open?


Deep clustering

Hi,
First of all, thank you for your wonderful work,
I think: dino is a method of clustering discrimination rather than instance discrimination. Just like swav, dino does not directly compare the features between samples, but compares the probability distribution in k dimensions. Different from swav, dino does not use the sinkhorn-knopp algorithm in the teacher branch, but uses softmax. The principle is the same, and they all use the idea of clustering. Is my understanding correct? Looking forward to your reply.

@mathildecaron31

Not Mathilde, and also curious about how this works, so let me try to comment?  I'm not sure what you mean by "features" - all(?) NNs project the data into new representations layered on top of each other.  So you can view the softmax output as probabilities for a set of discrete classes, or for a set of abstract features, but it is also a form of vector representation of the input.
Since we can calculate distances in the representation space, clustering is a natural thing to think of.  But I think it is incidental rather than fundamental, and given a distance measure, there are many ways to cluster data.  But perhaps I am missing something?  (I'm not familiar with SVAW, but BYOL also has a different - and more complex - head architecture.  While we can compare performance and complexity, it would be interesting to see a theoretical rationale for the different choices)

Hi @Yanxin0726
Yeah your understanding is correct :)


print the bundle folder instead of the output dir

Signed-off-by: Muvaffak Onus<EMAIL_ADDRESS>

@turkenh I added a commit to print the annotations map in a sorted manner for consistent outputs after your approval


namespace::autoclean dependency undeclared

As per subject. Grep:
http://search.cpan.org/grep?release=Role-MimeInfo-0.01;string=namespace::autoclean;n=1;C=0
Sample fail report:
http://www.cpantesters.org/cpan/report/87068546
HTH&&Thanks,

ah yes thanks; always forgetting that


How to apply a custom component into the body of a modal window?

Hi.
Is it possible to use other component in DIALOG body?
If i try:
.body('<my-comp></my-comp>')
won't throw an error but also won't render components html.

.body() support HTML but does not support HTML compilation.
This is virtually not possible in Angular 2 since templates have to be static, i.e known upfront.
To provide a custom component you need to specify the component when opening it.
This is only available via the open() method, alert, propmt and confirm are not supported out of the box tough it might be possible.
See the bootstrap demo for an example how to use a custom modal, the custom modal is here

I need to put components in the body is it possible now @shlomiassaf

@shlomiassaf In my opinion this is quite convoluted.... why custom component templates are only supported in some of the modal presentation methods but not others? Will they be supported in the future? A consumer of this angular API should be able to put whatever tags they wish inside .body().

@splutz You might be able to do something like Gbacc's answer, in this report:
https://github.com/shlomiassaf/ngx-modialog/issues/224


SYS-1318: Update colors and fonts for search results

Implements SYS-1318... roughly.
This is a first pass at styling the colors and fonts for the search results page.  It's not complete, as there are several questions & problems, but I think it's worth merging at this stage just to make the changes more visible during development.
Known problems / limitations:

Proxima Nova font is not available, so this falls back to generic sans-serif
SVG icons are unchanged, and alignment with text may be wrong now, especially with facets
The design calls for a blue box at top of facets, including "Refine your results"; I can't find an existing box to target.

White color for text in above blue box was not implemented, since the blue box isn't there and white text would not show

Snippet text for abstracts was not truncated, since that often made the SVG icon for the ending quote disappear
Horizontal dividers between facet headings could not be added (by me...)
Text styling in the search results header (number of results, number selected, personalize) was not attempted due to (a) wording changes / movement and (b) impending insanity...
No attempt to style pagination buttons / text at bottom of results page

At this point, I think I'll need help to make further changes to this page (or to determine if some things are even possible).
Testing:
Do a search which finds a variety of resources, in the default "Articles, Books and more" scope, to test various availability notes.  I used "leprosy practical" to find a reasonable number with mixed formats.

This looks good to me! Confirmed that Karbon works again with the font file moved, and other CSS changes look correct. Merging now, thanks.


Enable JIT tests for supported devices, skip METAL and WEBGPU

Enable test to not skip any supported device by default.
While doing so, I realized METAL test fails, presumably due to fast-math optimization. But disabling fast-math did not fix it on CI, it fixed on my local M1 though.
I think we want to test these devices, so I recommend adding the test for all and explicitly skipping METAL and WEBGPU for now. Link to show that these two failed in CI.

Changes made in tinygrad/:
------------------------------------------------------------
files                             insertions       deletions
------------------------------------------------------------
tinygrad/jit.py                            3               1
------------------------------------------------------------
lines added in the tinygrad folder: 2


Update matchesAncestors to search light-dom ancestors

This PR addresses https://github.com/virtualstate/navigation/issues/29 by extending matchesAncestor helper to search through light-dom ancestors once it has reached the bounds of a shadow-dom.

Checklist

[x] run yarn build
[ ] tests and/or benchmarks are included
[ ] documentation is changed or added
[x] commit message and code follows the Developer's Certification of Origin
and the Code of conduct

Merging as is, will follow up with adding a test case prior to versioning and release.

Added in https://github.com/virtualstate/navigation/commit/9000b43fc60513fed2dd8bc092d9a73884e2d4d1


Update hardware_info_cn.md

update several links to hardware installation

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


[fix] DigestExtensions to compile on Xcode 14 beta

This PR updates DigestExtensions#hexString to disambiguate the use of makeIterator, which fixes a compile-time error when building the project in Xcode 14.
Refer to the issue for more information: https://github.com/SwifterSwift/SwifterSwift/issues/1042
Checklist

[x] I checked the Contributing Guidelines before creating this request.
[x] New extensions are written in Swift 5.0.
[x] New extensions support iOS 10.0+ / tvOS 9.0+ / macOS 10.10+ / watchOS 2.0+, or use @available if not.
[x] I have added tests for new extensions, and they passed.
[x] All extensions have a clear comments explaining their functionality, all parameters and return type in English.
[x] All extensions are declared as public.
[x] I have added a changelog entry describing my changes.

I see the changlog has conflicts now, I will update next chance I get, possibly tonight or in a couple days.


siddhi window oom

Description:
I integrated siddhi into the storm, but using siddhi's window.timeBatch method, I found that the corresponding bolt of storm is often restarted, monitoring the location of the program to spend time, at org.wso2.siddhi.core.util.snapshot.SnapshotService. addSnapshotable(SnapshotService.java:78) takes up more resources and will oom,I used multiple time aggregation.
but why?

"Siddhi-fb2e0aa9-8d28-41d0-acba-11ab0515df40-scheduler-thread-3" #411 prio=5 os_prio=0 tid=0x00007f9a58002800 nid=0x2aba runnable [0x00007f98f3af8000]
java.lang.Thread.State: RUNNABLE
at java.util.ArrayList.indexOf(ArrayList.java:321)
at java.util.ArrayList.contains(ArrayList.java:304)
at org.wso2.siddhi.core.util.snapshot.SnapshotService.addSnapshotable(SnapshotService.java:78)
- locked <0x00000005c42656a0> (a org.wso2.siddhi.core.util.snapshot.SnapshotService)
at org.wso2.siddhi.core.executor.function.FunctionExecutor.initExecutor(FunctionExecutor.java:56)
at org.wso2.siddhi.core.executor.function.FunctionExecutor.cloneExecutor(FunctionExecutor.java:73)
at org.wso2.siddhi.core.query.selector.attribute.aggregator.AttributeAggregator.cloneAggregator(AttributeAggregator.java:64)
at org.wso2.siddhi.core.query.selector.attribute.processor.executor.GroupByAggregationAttributeExecutor.execute(GroupByAggregationAttributeExecutor.java:89)
at org.wso2.siddhi.core.query.selector.attribute.processor.AttributeProcessor.process(AttributeProcessor.java:41)
at org.wso2.siddhi.core.query.selector.QuerySelector.processInBatchGroupBy(QuerySelector.java:293)
- locked <0x00000005c4bad4d8> (a org.wso2.siddhi.core.query.selector.QuerySelector)
at org.wso2.siddhi.core.query.selector.QuerySelector.process(QuerySelector.java:84)
at org.wso2.siddhi.core.query.processor.stream.window.TimeBatchWindowProcessor.process(TimeBatchWindowProcessor.java:254)
at org.wso2.siddhi.core.query.processor.stream.window.WindowProcessor.processEventChunk(WindowProcessor.java:66)
at org.wso2.siddhi.core.query.processor.stream.AbstractStreamProcessor.process(AbstractStreamProcessor.java:125)
at org.wso2.siddhi.core.query.input.stream.single.EntryValveProcessor.process(EntryValveProcessor.java:50)
at org.wso2.siddhi.core.util.Scheduler.sendTimerEvents(Scheduler.java:197)
at org.wso2.siddhi.core.util.Scheduler$EventCaller.run(Scheduler.java:249)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

@478682649, we have identified this issue as related to not clearing of snapshots, https://github.com/wso2/product-sp/issues/918. The PR https://github.com/siddhi-io/siddhi/pull/1018 with the fix is merged and will be available with next 4.4.x release.

@Niveathika92 , Yesterday I tried the siddhi 4.4.8 version and found the previous OOM problem has been solved. Now it has been running steadily for 24h.

@478682649 Glad to hear that the issue was resolved. Seems your issue was stemming from https://github.com/siddhi-io/siddhi/issues/1010, which was fixed in 4.4.8.

@Niveathika92 Possible, this problem has affected the stability before, and it still needs to be monitored for a long time.

@478682649, For now I have closed the issue please reopen if you face any further issues in the future.


Multi pubsub support

In what area(s)?
runtime
Describe the feature
In an actual project, we may use different MQ clusters or products at the same time. For example, RabbitMQ is used to process online transactional data, and Kafka is used to process large amounts of log data.
However, only one pubsub is allowed in the current implementation, it cannot cover the above scenarios. Do we have plans to support multi pubusb?

Thanks @kirk91, this request makes sense.

The real world use-case that drives the need home is the service that subscribes to one topic from one provider and publishes on another topic at another provider. For example, reading from topic A on Service Bus, processing it, and publishing it onto topic B in Kafka

Discussed in pub/sub scoping review - this is needed before 1.0

Proposal
Publish API - HTTP
Today
POST http://localhost:<daprPort>/v1.0/publish/<topic>

With Multi Pub/Sub
POST http://localhost:<daprPort>/v1.0/publish/<pubsub name>/<topic>

[Contents of message do not change].
Publish API - gRPC
Today
rpc PublishEvent(PublishEventRequest) returns (google.protobuf.Empty) {}

message PublishEventRequest {
  // The pubsub topic
  string topic = 1;

 // The data which will be published to topic.
  bytes data = 2;
}

With Multi Pub/Sub
[PublishEvent() method signature does not change]
message PublishEventRequest {
  string pubsubName = 1;

  // The pubsub topic
  string topic = 2;

 // The data which will be published to topic.
  bytes data = 3;
}

Topic Subscription Discovery - HTTP
Today (example):
GET http://localhost:<appPort>/dapr/subscribe

[
  {
    "topic": "newOrder",
    "route": "/orders"
  }
]

With Multi Pub/Sub
[Url does not change]
Response changes.  Note different pubsub + topic pairs may share the same callback route (first and third example):
[
  {
    “pubsubName”: “myservicebus”,
    "topic": "newOrder",
    "route": "/orders"
  }

  {
    “pubsubName”: “myservicebus”,
    "topic": "sometopic",
    "route": "/sometopicroute"
  }

  {
    “pubsubName”: “rabbitpubsub”,
    "topic": "newOrder",
    "route": "/orders"
  }
]

Topic Subscription Discovery - gRPC
Today
rpc ListTopicSubscriptions(google.protobuf.Empty) returns (ListTopicSubscriptionsResponse) {}

// ListTopicSubscriptionsResponse is the message including the list of the subscribing topics.
message ListTopicSubscriptionsResponse {
  // The list of topics.
  repeated TopicSubscription subscriptions = 1;
}

// TopicSubscription represents topic and metadata.
message TopicSubscription {
  // Required. The name of topic which will be subscribed
  string topic = 1;

  // The optional properties used for this topic's subscribtion e.g. session id
  map<string,string> metadata = 2;
}

With Multi Pub/Sub
[Method signature does not change]
rpc ListTopicSubscriptions(google.protobuf.Empty) returns (ListTopicSubscriptionsResponse) {}

[This message does not change]
// ListTopicSubscriptionsResponse is the message including the list of the subscribing topics.
message ListTopicSubscriptionsResponse {
  // The list of topics.
  repeated TopicSubscription subscriptions = 1;
}

This does change:
// TopicSubscription represents topic and metadata.
message TopicSubscription {
  string pubsubName = 1;

  // Required. The name of topic which will be subscribed
  string topic = 2;

  // The optional properties used for this topic's subscripttion e.g. session id
  map<string,string> metadata = 3;
}

Pub/Sub Message Callback - HTTP
Today
This is user determined – example:
POST http://localhost:<appPort>/orders

type CloudEventsEnvelope struct {
       ID              string      `json:"id"`
       Source          string      `json:"source"`
       Type            string      `json:"type"`
       SpecVersion     string      `json:"specversion"`
       DataContentType string      `json:"datacontenttype"`
       Data            interface{} `json:"data"`
       Subject         string      `json:"subject"`
       Topic           string      `json:"topic"`
}

With Multi Pub/Sub
The URL does not change – it is still user-specified.  We may consider adding a field to the body to indicate which pub/sub this message came from, similar to what was done for the sending topic last week.  However, unlike “topic”, pub/sub names cannot have wildcards, so this is not as necessary.  But on the gRPC side, since there’s a single callback, having this information may help disambiguate where it came from.  Therefore, propose adding a “pusubname” field.
type CloudEventsEnvelope struct {
       ID              string      `json:"id"`
       Source          string      `json:"source"`
       Type            string      `json:"type"`
       SpecVersion     string      `json:"specversion"`
       DataContentType string      `json:"datacontenttype"`
       Data            interface{} `json:"data"`
       Subject         string      `json:"subject"`
       Topic           string      `json:"topic"`
       PubsubName      string      `json:”pubsubname”`
}

Pub/Sub Message Callback – gRPC
Today:
rpc OnTopicEvent(TopicEventRequest) returns (google.protobuf.Empty) {}

message TopicEventRequest {
  // id identifies the event. Producers MUST ensure that source + id
  // is unique for each distinct event. If a duplicate event is re-sent
  // (e.g. due to a network error) it MAY have the same id.
  string id = 1;

  // source identifies the context in which an event happened.
  // Often this will include information such as the type of the
  // event source, the organization publishing the event or the process
  // that produced the event. The exact syntax and semantics behind
  // the data encoded in the URI is defined by the event producer.
  string source = 2;

  // The type of event related to the originating occurrence.
  string type = 3;

  // The version of the CloudEvents specification.
  string spec_version = 4;

  // The content type of data value.
  string data_content_type = 5;

  // The content of the event.
  bytes data = 7;

  // The pubsub topic which publisher sent to.
  string topic = 6;
}

With Multi Pub/Sub
Same comment as for HTTP above –
The URL does not change – it is still user-specified.  We may consider adding a field to the body to indicate which pub/sub this message came from, similar to what was done for the sending topic last week.  However, unlike “topic”, pub/sub names cannot have wildcards, so this is not as necessary.  But on the gRPC side, since there’s a single callback, having this information may help disambiguate where it came from.  Therefore, propose adding a “pusubname” field.
message TopicEventRequest {
  // id identifies the event. Producers MUST ensure that source + id
  // is unique for each distinct event. If a duplicate event is re-sent
  // (e.g. due to a network error) it MAY have the same id.
  string id = 1;

  // source identifies the context in which an event happened.
  // Often this will include information such as the type of the
  // event source, the organization publishing the event or the process
  // that produced the event. The exact syntax and semantics behind
  // the data encoded in the URI is defined by the event producer.
  string source = 2;

  // The type of event related to the originating occurrence.
  string type = 3;

  // The version of the CloudEvents specification.
  string spec_version = 4;

  // The content type of data value.
  string data_content_type = 5;

  // The content of the event.
  bytes data = 7;

  // The pubsub topic which publisher sent to.
  string topic = 6;

  // The name of the pub/sub this message came from
  string pubsub_name = 8;
}

YAML
Same as state store – the proposal is to use the metadata.name field as the pub/sub name.
apiVersion: dapr.io/v1alpha1
kind: Component
metadata:
  name: mypubsubname


Adding a component to the exclude list causes parsing to break

my tsconfig.json:
{
  "glint": {
    "environment": [
       "ember-loose",
       "ember-template-imports",
    ],
    "transform": {
      "include": ["app/**"],
      // The TODO list
      "exclude": [
        // We need to add types to ember-headlessui
        "app/components/limber/menu.*"
      ]
    }
  },

I wanted to exclude a specific component from type checking, because I have upstream work to do.
I expect that if I want to exclude anything, I need to not use ** for the include glob -- but with the above config I get:

app/components/limber/menu.gts:49:4 - error TS1110: Type expected.

49   <@item as |item|>
      ~

app/components/limber/menu.gts:49:9 - error TS1146: Declaration expected.

49   <@item as |item|>

app/components/limber/menu.gts:49:19 - error TS1109: Expression expected.

49   <@item as |item|>
                     ~

app/components/limber/menu.gts:51:7 - error TS1005: '>' expected.

51       @tagName="button"
         ~

(and a ton more errors)
idk if there is anything to be done about this, but figured others might run in to it.

Tho, I also just now observed that this config:
  "glint": {
    "environment": [
       "ember-loose",
       "ember-template-imports",
    ],
    "transform": {
      "include": [
        // Can't switch to app/** until all app todos are dealt with
        // "app/**"
        "app/templates/**",

      ],
      // The TODO list
      "exclude": [
        // We need to add types to ember-headlessui
        "app/components/limber/menu.*"
      ]
    }
  },

results in parsing errors on all components

So it appears that this transform option is true to its name

Indeed—making that distinction clearer is part of why we tweaked the configuration around it!
If your goal is just to disable typechecking, I'd recommend putting {{! @glint-nocheck }} at the top of the template instead.

Awesome! Thank you!


Update Lightning dependency to 0.38.0rcX

Context: TestPyPI RC Wheels for Lightning have been published. This PR updates Catalyst dependencies according to those new Wheels.

Seems like there are still some issues getting lightning wheels? 🤔


Add CONTRIBUTORS (or AUTHORS) document

A markdown file at top level which can also be integrated into the sphinx based documentation.
@sanjayankur31 any idea what the preferred convention/naming for this is?

Will be worked on in https://github.com/ModECI/MDF/tree/add_contributors.
Idea for the page: https://docs.neuroml.org/NeuroMLOrg/Contributors.html
Generated by: https://github.com/NeuroML/Documentation/blob/master/scripts/contributors/get_contributors.py

Noted

Hello, i have worked on the code scraping contributors, i noticed that in the idea for the page, their are some external resources linked to the page e.g the neuroML Organizational board, i want to ask if you want any external resources to also be linked to the page or if i should continue with uploading the page

@Monsurat-Onabajo happy for it to be kept simple initially, we can gradually improve it over time. First step is to get a helper script in place which will pull the contributors list from the GitHub API (as in the neuroml script above) and put it in a markdown file.

Hello,
I am done with the codes for the contributors stage but i am having issues pushing it to the branch you specified, i kept on getting
Remote: "permission to to ModECI/MDF.git denied to Monsurat-Onabajo
Fatal: unable to access 'https://github.com/ModECI/MDF.git/': The requested URL returned error:403
I have tried different ways to work around it but i am still stuck.

@Monsurat-Onabajo I've given you permission to write to the branch, so do a git pull and try again.


How i can get selected emails?

Cant find method for selected emails, pls help.
Thx

Check readme. It’s there in the DOM section iirc.

gmail.get.selected_emails_data() old version, readme say that i should use gmail.new.get.* now, but i can't find any. I check DOM method and cant find any too.
sry for my bad englsh.

Oh well. I’m sure there is a DOM way to do it, possibly discussed in now closed issues.
Search around?
Also: PRs welcome 🙂

still cant find, tell analog of "api.get.selected_emails_data_async" pls.

Use Dom to find selected emails
Use api.new.get.email_data() for those emails.

I get email dom element with checking
const [email] = $(table .x7), i get array with length  = 1
then i use const emailData = api.new.get.email_data(email);
but emailData is undefined.
i find place where i get undefined, screen below, function tried extract data from object by id as key, but it doesnt exist.
;
what im doing wrong.
im sry if i stupid

Looking at it in my browser, I notice these are not emails, they are threads. This is semantically different, and means you need to use different APIs.
Anyhow: You first need to first ensure you are selecting the right elements. From what I can see, you were on track, but not entirely. We can select even more useful elements to obtain information about the currently selected email-rows:
var threadElems = document.querySelectorAll("table .x7 span[data-thread-id]");

We the need to extract the actual thread-id property from these elements. Note: We may get the same thread-id more than once.
var threadIds=[];
for (let elem of threadElems) {
    var threadId = elem.dataset.threadId;
    if (threadId[0] === "#") threadId = threadId.substring(1); // filter #-prefix. Should really be done in gmail.js...
    threadIds.push(threadId);
}

Then using threadIds we can obtain information about these emails:
for (let threadId of threadIds) {
    var threadData = gmail.new.get.thread_data(threadId);
    console.log(threadData);
}

And that should get you something like this to work with:

Thx very much, its work, but sometimes i get undefined from get.thread_data(threadId), can i update thread_cache?)

You can't. It is passively updated whenever Gmail fetched information about those threads. If you really need that info, you need to initiate a navigation to that thread first, to ensure gmail actually fetches the data.
If you still can't get it, it might be part of the early-load preamble, and you need to make sure Gmail.js is loaded really early in the page-load cycle. See how to do that in the boilerplate project for information about how that should be done.