tf.matmul fails with CUBLAS_STATUS_NOT_SUPPORTED for large matrices when using CUDA 9.1

I am hitting this issue on multiple development machines with different GPUs, and all versions of Tensorflow >= 1.9.0. I have a CUDA 9.1 requirement on the host machine, so downgrading to CUDA 9.0 is not an option for me.
See https://stackoverflow.com/questions/50911052/tensorflow-matmul-blas-xgemmbatched-launch-failed/50918250 for a possibly related issue, though that involved Tensorflow 1.8.0.
System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): Yes, a minimum repro is below
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Linux Ubuntu 16.04
Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device: n/a
TensorFlow installed from (source or binary): source
TensorFlow version (use command below): 1.9.0 to 1.11.0 (does not reproduce in 1.8.0)
Python version: 2.7
Bazel version (if compiling from source): Bazel 0.10.0 for  Tensorflow 1.9.0, Bazel 0.18.0 for Tensorflow 1.10.0 and newer
GCC/Compiler version (if compiling from source): GCC 5.4.0
CUDA/cuDNN version: CUDA 9.1.85 / cuDNN 7.0.5
GPU model and memory: GTX 1080 w/ 7400 MB, GTX 1060 w/ 5600 MB

Describe the current behavior
tf.matmul is failing to multiply matrices above a certain size, with error:
failed to run cuBLAS routine cublasGemmBatchedEx: CUBLAS_STATUS_NOT_SUPPORTED
I have confirmed using nvidia-smi that the GPU is nowhere close to running out of memory.
Describe the expected behavior
The matrix multiplication should complete successfully.
Code to reproduce the issue
This is borrowed from the stackoverflow link above:
import tensorflow as tf
import numpy as np

config = tf.ConfigProto()
config.gpu_options.allow_growth=True
tf.Session(config=config).close()

def calc():
    N = 15 # works for N <= 14
    a = 16
    b = 8
    X = np.random.rand(N, 11520, b, 1).astype(np.float32)
    print(X.nbytes*1e-6, "MB")
    W = np.random.rand(N, 11520, a, b).astype(np.float32)
    print(W.nbytes*1e-6, "MB")
    X_ = tf.constant(X, name="X-constant", dtype=tf.float32)
    W_ = tf.constant(W, name="W-constant", dtype=tf.float32)

    return tf.matmul(W_, X_, name="mymatmul")

tf.reset_default_graph()
a = calc()
sess = tf.Session()
sess.run(tf.global_variables_initializer())
b = sess.run(a)
sess.close()
print(b.shape)

Other info / logs
I found a workaround for this issue is to patch CUDABlas::DoBlasGemmBatchedInternal in tensorflow/stream_extractor/cuda/cuda_blas.cc to disable the #if CUDA_VERSION >= 9010 block which calls wrap::cublasGemmBatchedEx. Downgrading to Tensorflow <= 1.8.0 also resolves the issue for me (that codeblock was added in Tensorflow 1.9.0).
Running the above code (N=15) with Tensorflow 1.11.0:
2018-11-02 23:13:48.059128: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:964] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2018-11-02 23:13:48.059860: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1411] Found device 0 with properties:
name: GeForce GTX 1080 major: 6 minor: 1 memoryClockRate(GHz): 1.7335
pciBusID: 0000:01:00.0
totalMemory: 7.92GiB freeMemory: 7.40GiB
2018-11-02 23:13:48.059884: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1490] Adding visible gpu devices: 0
2018-11-02 23:13:48.282603: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-02 23:13:48.282631: I tensorflow/core/common_runtime/gpu/gpu_device.cc:977]      0
2018-11-02 23:13:48.282636: I tensorflow/core/common_runtime/gpu/gpu_device.cc:990] 0:   N
2018-11-02 23:13:48.282790: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1103] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 7137 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1080, pci bus id: 0000:01:00.0, compute capability: 6.1)
(5.529599999999999, 'MB')
(88.47359999999999, 'MB')
2018-11-02 23:13:48.963544: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1490] Adding visible gpu devices: 0
2018-11-02 23:13:48.963579: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-02 23:13:48.963585: I tensorflow/core/common_runtime/gpu/gpu_device.cc:977]      0
2018-11-02 23:13:48.963588: I tensorflow/core/common_runtime/gpu/gpu_device.cc:990] 0:   N
2018-11-02 23:13:48.963722: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1103] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 7137 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1080, pci bus id: 0000:01:00.0, compute capability: 6.1)
2018-11-02 23:13:51.146858: E tensorflow/stream_executor/cuda/cuda_blas.cc:652] failed to run cuBLAS routine cublasGemmBatchedEx: CUBLAS_STATUS_NOT_SUPPORTED
2018-11-02 23:13:51.146900: E tensorflow/stream_executor/cuda/cuda_blas.cc:2574] Internal: failed BLAS call, see log for details
Traceback (most recent call last):
  File "./tf_matmul.py", line 25, in <module>
    b = sess.run(a)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 887, in run
    run_metadata_ptr)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1110, in _run
    feed_dict_tensor, options, run_metadata)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1286, in _do_run
    run_metadata)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1308, in _do_call
    raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InternalError: Blas xGEMMBatched launch failed : a.shape=[172800,16,8], b.shape=[172800,8,1], m=16, n=1, k=8, batch_size=172800
	 [[{{node mymatmul}} = BatchMatMul[T=DT_FLOAT, adj_x=false, adj_y=false, _device="/job:localhost/replica:0/task:0/device:GPU:0"](W-constant, X-constant)]]

Caused by op u'mymatmul', defined at:
  File "./tf_matmul.py", line 22, in <module>
    a = calc()
  File "./tf_matmul.py", line 19, in calc
    return tf.matmul(W_, X_, name="mymatmul")
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/ops/math_ops.py", line 2015, in matmul
    a, b, adj_x=adjoint_a, adj_y=adjoint_b, name=name)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/ops/gen_math_ops.py", line 1245, in batch_mat_mul
    "BatchMatMul", x=x, y=y, adj_x=adj_x, adj_y=adj_y, name=name)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/op_def_library.py", line 787, in _apply_op_helper
    op_def=op_def)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/util/deprecation.py", line 488, in new_func
    return func(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/ops.py", line 3272, in create_op
    op_def=op_def)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/ops.py", line 1768, in __init__
    self._traceback = tf_stack.extract_stack()

InternalError (see above for traceback): Blas xGEMMBatched launch failed : a.shape=[172800,16,8], b.shape=[172800,8,1], m=16, n=1, k=8, batch_size=172800
	 [[{{node mymatmul}} = BatchMatMul[T=DT_FLOAT, adj_x=false, adj_y=false, _device="/job:localhost/replica:0/task:0/device:GPU:0"](W-constant, X-constant)]]

Reducing the matrix size (N=14):
2018-11-02 23:18:29.127555: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:964] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2018-11-02 23:18:29.128409: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1411] Found device 0 with properties:
name: GeForce GTX 1080 major: 6 minor: 1 memoryClockRate(GHz): 1.7335
pciBusID: 0000:01:00.0
totalMemory: 7.92GiB freeMemory: 7.39GiB
2018-11-02 23:18:29.128441: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1490] Adding visible gpu devices: 0
2018-11-02 23:18:29.482292: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-02 23:18:29.482346: I tensorflow/core/common_runtime/gpu/gpu_device.cc:977]      0
2018-11-02 23:18:29.482361: I tensorflow/core/common_runtime/gpu/gpu_device.cc:990] 0:   N
2018-11-02 23:18:29.482670: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1103] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 7131 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1080, pci bus id: 0000:01:00.0, compute capability: 6.1)
(5.160959999999999, 'MB')
(82.57535999999999, 'MB')
2018-11-02 23:18:30.200524: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1490] Adding visible gpu devices: 0
2018-11-02 23:18:30.200586: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-02 23:18:30.200598: I tensorflow/core/common_runtime/gpu/gpu_device.cc:977]      0
2018-11-02 23:18:30.200605: I tensorflow/core/common_runtime/gpu/gpu_device.cc:990] 0:   N
2018-11-02 23:18:30.200837: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1103] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 7131 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1080, pci bus id: 0000:01:00.0, compute capability: 6.1)
(14, 11520, 16, 1)

After patching CUDABlas::DoBlasGemmBatchedInternal (N=15):
2018-11-02 23:28:05.667458: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:964] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2018-11-02 23:28:05.668033: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1411] Found device 0 with properties:
name: GeForce GTX 1080 major: 6 minor: 1 memoryClockRate(GHz): 1.7335
pciBusID: 0000:01:00.0
totalMemory: 7.92GiB freeMemory: 7.39GiB
2018-11-02 23:28:05.668046: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1490] Adding visible gpu devices: 0
2018-11-02 23:28:05.866043: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-02 23:28:05.866069: I tensorflow/core/common_runtime/gpu/gpu_device.cc:977]      0
2018-11-02 23:28:05.866074: I tensorflow/core/common_runtime/gpu/gpu_device.cc:990] 0:   N
2018-11-02 23:28:05.866218: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1103] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 7129 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1080, pci bus id: 0000:01:00.0, compute capability: 6.1)
(5.529599999999999, 'MB')
(88.47359999999999, 'MB')
2018-11-02 23:28:06.452688: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1490] Adding visible gpu devices: 0
2018-11-02 23:28:06.452722: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-02 23:28:06.452727: I tensorflow/core/common_runtime/gpu/gpu_device.cc:977]      0
2018-11-02 23:28:06.452730: I tensorflow/core/common_runtime/gpu/gpu_device.cc:990] 0:   N
2018-11-02 23:28:06.452858: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1103] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 7129 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1080, pci bus id: 0000:01:00.0, compute capability: 6.1)
(15, 11520, 16, 1)

Patch for workaround:
diff --git a/tensorflow/stream_executor/cuda/cuda_blas.cc b/tensorflow/stream_executor/cuda/cuda_blas.cc
index ab7091b..50579b6 100644
--- a/tensorflow/stream_executor/cuda/cuda_blas.cc
+++ b/tensorflow/stream_executor/cuda/cuda_blas.cc
@@ -18,6 +18,8 @@ limitations under the License.

 #define SE_CUDA_DATA_HALF CUDA_R_16F

+#define USE_CUBLAS_GEMM_BATCHED_EX false
+
 #include "tensorflow/stream_executor/cuda/cuda_blas.h"

 // Both Eigen Half.h and CUDA cuda_fp16.h provide similar typedef for __half. As
@@ -2482,7 +2484,7 @@ port::Status CUDABlas::DoBlasGemmBatchedInternal(

   cudaDataType_t data_type = CUDADataType<T>::type;

-#if CUDA_VERSION >= 9010
+#if CUDA_VERSION >= 9010 && USE_CUBLAS_GEMM_BATCHED_EX
   int cc_major, cc_minor;
   if (stream->parent()->GetDeviceDescription().cuda_compute_capability(
           &cc_major, &cc_minor) &&

@mrry  PTAL

Forwarding this to @azaks2 who has access to more CUDA expertise than I do.

Nagging Assignee @azaks2: It has been 14 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Closing as stale because we use CUDA 10.1 now.  Please reopen if necessary.

I am hitting this issue on multiple development machines with different GPUs, and all versions of Tensorflow >= 1.9.0. I have a CUDA 9.1 requirement on the host machine, so downgrading to CUDA 9.0 is not an option for me.
See https://stackoverflow.com/questions/50911052/tensorflow-matmul-blas-xgemmbatched-launch-failed/50918250 for a possibly related issue, though that involved Tensorflow 1.8.0.
System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): Yes, a minimum repro is below
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Linux Ubuntu 16.04
Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device: n/a
TensorFlow installed from (source or binary): source
TensorFlow version (use command below): 1.9.0 to 1.11.0 (does not reproduce in 1.8.0)
Python version: 2.7
Bazel version (if compiling from source): Bazel 0.10.0 for  Tensorflow 1.9.0, Bazel 0.18.0 for Tensorflow 1.10.0 and newer
GCC/Compiler version (if compiling from source): GCC 5.4.0
CUDA/cuDNN version: CUDA 9.1.85 / cuDNN 7.0.5
GPU model and memory: GTX 1080 w/ 7400 MB, GTX 1060 w/ 5600 MB

Describe the current behavior
tf.matmul is failing to multiply matrices above a certain size, with error:
failed to run cuBLAS routine cublasGemmBatchedEx: CUBLAS_STATUS_NOT_SUPPORTED
I have confirmed using nvidia-smi that the GPU is nowhere close to running out of memory.
Describe the expected behavior
The matrix multiplication should complete successfully.
Code to reproduce the issue
This is borrowed from the stackoverflow link above:
import tensorflow as tf
import numpy as np

config = tf.ConfigProto()
config.gpu_options.allow_growth=True
tf.Session(config=config).close()

def calc():
    N = 15 # works for N <= 14
    a = 16
    b = 8
    X = np.random.rand(N, 11520, b, 1).astype(np.float32)
    print(X.nbytes*1e-6, "MB")
    W = np.random.rand(N, 11520, a, b).astype(np.float32)
    print(W.nbytes*1e-6, "MB")
    X_ = tf.constant(X, name="X-constant", dtype=tf.float32)
    W_ = tf.constant(W, name="W-constant", dtype=tf.float32)

    return tf.matmul(W_, X_, name="mymatmul")

tf.reset_default_graph()
a = calc()
sess = tf.Session()
sess.run(tf.global_variables_initializer())
b = sess.run(a)
sess.close()
print(b.shape)

Other info / logs
I found a workaround for this issue is to patch CUDABlas::DoBlasGemmBatchedInternal in tensorflow/stream_extractor/cuda/cuda_blas.cc to disable the #if CUDA_VERSION >= 9010 block which calls wrap::cublasGemmBatchedEx. Downgrading to Tensorflow <= 1.8.0 also resolves the issue for me (that codeblock was added in Tensorflow 1.9.0).
Running the above code (N=15) with Tensorflow 1.11.0:
2018-11-02 23:13:48.059128: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:964] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2018-11-02 23:13:48.059860: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1411] Found device 0 with properties:
name: GeForce GTX 1080 major: 6 minor: 1 memoryClockRate(GHz): 1.7335
pciBusID: 0000:01:00.0
totalMemory: 7.92GiB freeMemory: 7.40GiB
2018-11-02 23:13:48.059884: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1490] Adding visible gpu devices: 0
2018-11-02 23:13:48.282603: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-02 23:13:48.282631: I tensorflow/core/common_runtime/gpu/gpu_device.cc:977]      0
2018-11-02 23:13:48.282636: I tensorflow/core/common_runtime/gpu/gpu_device.cc:990] 0:   N
2018-11-02 23:13:48.282790: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1103] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 7137 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1080, pci bus id: 0000:01:00.0, compute capability: 6.1)
(5.529599999999999, 'MB')
(88.47359999999999, 'MB')
2018-11-02 23:13:48.963544: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1490] Adding visible gpu devices: 0
2018-11-02 23:13:48.963579: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-02 23:13:48.963585: I tensorflow/core/common_runtime/gpu/gpu_device.cc:977]      0
2018-11-02 23:13:48.963588: I tensorflow/core/common_runtime/gpu/gpu_device.cc:990] 0:   N
2018-11-02 23:13:48.963722: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1103] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 7137 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1080, pci bus id: 0000:01:00.0, compute capability: 6.1)
2018-11-02 23:13:51.146858: E tensorflow/stream_executor/cuda/cuda_blas.cc:652] failed to run cuBLAS routine cublasGemmBatchedEx: CUBLAS_STATUS_NOT_SUPPORTED
2018-11-02 23:13:51.146900: E tensorflow/stream_executor/cuda/cuda_blas.cc:2574] Internal: failed BLAS call, see log for details
Traceback (most recent call last):
  File "./tf_matmul.py", line 25, in <module>
    b = sess.run(a)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 887, in run
    run_metadata_ptr)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1110, in _run
    feed_dict_tensor, options, run_metadata)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1286, in _do_run
    run_metadata)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1308, in _do_call
    raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InternalError: Blas xGEMMBatched launch failed : a.shape=[172800,16,8], b.shape=[172800,8,1], m=16, n=1, k=8, batch_size=172800
	 [[{{node mymatmul}} = BatchMatMul[T=DT_FLOAT, adj_x=false, adj_y=false, _device="/job:localhost/replica:0/task:0/device:GPU:0"](W-constant, X-constant)]]

Caused by op u'mymatmul', defined at:
  File "./tf_matmul.py", line 22, in <module>
    a = calc()
  File "./tf_matmul.py", line 19, in calc
    return tf.matmul(W_, X_, name="mymatmul")
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/ops/math_ops.py", line 2015, in matmul
    a, b, adj_x=adjoint_a, adj_y=adjoint_b, name=name)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/ops/gen_math_ops.py", line 1245, in batch_mat_mul
    "BatchMatMul", x=x, y=y, adj_x=adj_x, adj_y=adj_y, name=name)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/op_def_library.py", line 787, in _apply_op_helper
    op_def=op_def)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/util/deprecation.py", line 488, in new_func
    return func(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/ops.py", line 3272, in create_op
    op_def=op_def)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/ops.py", line 1768, in __init__
    self._traceback = tf_stack.extract_stack()

InternalError (see above for traceback): Blas xGEMMBatched launch failed : a.shape=[172800,16,8], b.shape=[172800,8,1], m=16, n=1, k=8, batch_size=172800
	 [[{{node mymatmul}} = BatchMatMul[T=DT_FLOAT, adj_x=false, adj_y=false, _device="/job:localhost/replica:0/task:0/device:GPU:0"](W-constant, X-constant)]]

Reducing the matrix size (N=14):
2018-11-02 23:18:29.127555: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:964] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2018-11-02 23:18:29.128409: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1411] Found device 0 with properties:
name: GeForce GTX 1080 major: 6 minor: 1 memoryClockRate(GHz): 1.7335
pciBusID: 0000:01:00.0
totalMemory: 7.92GiB freeMemory: 7.39GiB
2018-11-02 23:18:29.128441: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1490] Adding visible gpu devices: 0
2018-11-02 23:18:29.482292: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-02 23:18:29.482346: I tensorflow/core/common_runtime/gpu/gpu_device.cc:977]      0
2018-11-02 23:18:29.482361: I tensorflow/core/common_runtime/gpu/gpu_device.cc:990] 0:   N
2018-11-02 23:18:29.482670: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1103] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 7131 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1080, pci bus id: 0000:01:00.0, compute capability: 6.1)
(5.160959999999999, 'MB')
(82.57535999999999, 'MB')
2018-11-02 23:18:30.200524: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1490] Adding visible gpu devices: 0
2018-11-02 23:18:30.200586: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-02 23:18:30.200598: I tensorflow/core/common_runtime/gpu/gpu_device.cc:977]      0
2018-11-02 23:18:30.200605: I tensorflow/core/common_runtime/gpu/gpu_device.cc:990] 0:   N
2018-11-02 23:18:30.200837: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1103] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 7131 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1080, pci bus id: 0000:01:00.0, compute capability: 6.1)
(14, 11520, 16, 1)

After patching CUDABlas::DoBlasGemmBatchedInternal (N=15):
2018-11-02 23:28:05.667458: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:964] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2018-11-02 23:28:05.668033: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1411] Found device 0 with properties:
name: GeForce GTX 1080 major: 6 minor: 1 memoryClockRate(GHz): 1.7335
pciBusID: 0000:01:00.0
totalMemory: 7.92GiB freeMemory: 7.39GiB
2018-11-02 23:28:05.668046: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1490] Adding visible gpu devices: 0
2018-11-02 23:28:05.866043: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-02 23:28:05.866069: I tensorflow/core/common_runtime/gpu/gpu_device.cc:977]      0
2018-11-02 23:28:05.866074: I tensorflow/core/common_runtime/gpu/gpu_device.cc:990] 0:   N
2018-11-02 23:28:05.866218: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1103] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 7129 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1080, pci bus id: 0000:01:00.0, compute capability: 6.1)
(5.529599999999999, 'MB')
(88.47359999999999, 'MB')
2018-11-02 23:28:06.452688: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1490] Adding visible gpu devices: 0
2018-11-02 23:28:06.452722: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-02 23:28:06.452727: I tensorflow/core/common_runtime/gpu/gpu_device.cc:977]      0
2018-11-02 23:28:06.452730: I tensorflow/core/common_runtime/gpu/gpu_device.cc:990] 0:   N
2018-11-02 23:28:06.452858: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1103] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 7129 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1080, pci bus id: 0000:01:00.0, compute capability: 6.1)
(15, 11520, 16, 1)

Patch for workaround:
diff --git a/tensorflow/stream_executor/cuda/cuda_blas.cc b/tensorflow/stream_executor/cuda/cuda_blas.cc
index ab7091b..50579b6 100644
--- a/tensorflow/stream_executor/cuda/cuda_blas.cc
+++ b/tensorflow/stream_executor/cuda/cuda_blas.cc
@@ -18,6 +18,8 @@ limitations under the License.

 #define SE_CUDA_DATA_HALF CUDA_R_16F

+#define USE_CUBLAS_GEMM_BATCHED_EX false
+
 #include "tensorflow/stream_executor/cuda/cuda_blas.h"

 // Both Eigen Half.h and CUDA cuda_fp16.h provide similar typedef for __half. As
@@ -2482,7 +2484,7 @@ port::Status CUDABlas::DoBlasGemmBatchedInternal(

   cudaDataType_t data_type = CUDADataType<T>::type;

-#if CUDA_VERSION >= 9010
+#if CUDA_VERSION >= 9010 && USE_CUBLAS_GEMM_BATCHED_EX
   int cc_major, cc_minor;
   if (stream->parent()->GetDeviceDescription().cuda_compute_capability(
           &cc_major, &cc_minor) &&

Hi, I have the same problem.
2020-04-01 20:21:43.695815: E tensorflow/stream_executor/cuda/cuda_blas.cc:652] failed to run cuBLAS routine cublasGemmBatchedEx: CUBLAS_STATUS_NOT_SUPPORTED
2020-04-01 20:21:43.695883: E tensorflow/stream_executor/cuda/cuda_blas.cc:2574] Internal: failed BLAS call, see log for details
InternalError (see above for traceback): Blas xGEMMBatched launch failed : a.shape=[245760,8,16], b.shape=[245760,16,16], m=8, n=16, k=16, batch_size=245760
[[node layers/einsum/MatMul (defined at /home/pai/3dfaceRe/RandLA-Net/RandLANet.py:327)  = BatchMatMul[T=DT_FLOAT, adj_x=false, adj_y=false, _device="/job:localhost/replica:0/task:0/device:GPU:0"](layers/einsum/Reshape, layers/einsum/Reshape_1)]]
[[{{node optimizer/gradients/layers/Encoder_layer_3LFAmlp2/BiasAdd_grad/BiasAddGrad/_663}} = _Recvclient_terminated=false, recv_device="/job:localhost/replica:0/task:0/device:CPU:0", send_device="/job:localhost/replica:0/task:0/device:GPU:0", send_device_incarnation=1, tensor_name="edge_6262_...iasAddGrad", tensor_type=DT_FLOAT, _device="/job:localhost/replica:0/task:0/device:CPU:0"]]
I have Tensorflow = 1.12 and CUDA=9.2 in Conda environment. I couldn't find the file of  "tensorflow/stream_executor/cuda/cuda_blas.cc" and only have "tensorflow/stream_executor/cuda/cuda_blas.h"
Does anyone know how to solve this problem?

I have Tensorflow=1.12, Cudatoolkit=9.2, and Cudnn=7.6.5 in Conda environment.

If at all possible I'd suggest using a more recent version of TF.  1.12 is quite old, and we're not in a position to debug issues with it.

My case due to a version conflict in CUDA9.0 and TensorFlow 1.12.0
Easiest solution:  use a NumPy function wrap in TensorFlow.
use result = tf.py_func(np_matmul, [x, y], tf.float32) instead.


rspamd: 2.3 -> 2.4

Semi-automatic update generated by https://github.com/ryantm/nixpkgs-update tools. This update was made based on information from https://repology.org/metapackage/rspamd/versions.
meta.description for rspamd is: "Advanced spam filtering system"
meta.homepage for rspamd is: "https://rspamd.com"
Compare changes on GitHub

Checks done (click to expand)

built on NixOS

The tests defined in passthru.tests, if any, passed

0 of 0 passed binary check by having a zero exit code.

0 of 0 passed binary check by having the new version present in output.

found 2.4 with grep in /nix/store/qppjz69wlmkaacxj11yigxnmkpzzagd4-rspamd-2.4

directory tree listing: https://gist.github.com/4c0cd6574196e1c1a83cf938bf8dc39b

du listing: https://gist.github.com/8795625ee874921d965113d48412099e

Rebuild report (if merged into master) (click to expand)

3 total rebuild path(s)
1 package rebuild(s)
1 x86_64-linux rebuild(s)
1 i686-linux rebuild(s)
0 x86_64-darwin rebuild(s)
1 aarch64-linux rebuild(s)
First fifty rebuilds by attrpath
rspamd

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/qppjz69wlmkaacxj11yigxnmkpzzagd4-rspamd-2.4 \
  --option binary-caches 'https://cache.nixos.org/ https://r-ryantm.cachix.org/' \
  --option trusted-public-keys '
  r-ryantm.cachix.org-1:gkUbLkouDAyvBdpBX0JOdIiD2/DP1ldF3Z3Y6Gqcc4c=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(r-ryantm's Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A rspamd https://github.com/r-ryantm/nixpkgs/archive/ab4d825f3bac0e41506c88685ffe83604eab8483.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/qppjz69wlmkaacxj11yigxnmkpzzagd4-rspamd-2.4
ls -la /nix/store/qppjz69wlmkaacxj11yigxnmkpzzagd4-rspamd-2.4/bin

cc @avnik @fpletz @globin for testing.

@GrahamcOfBorg test rspamd


Count multiple var statements as One in the count of statements for W071

Some people prefer to use multiple var statements which is the default configuration for JSCS.
See http://benalman.com/news/2012/05/multiple-var-statements-javascript/
It is difficult to find a consistent value for maxstatements in .jshintrc if multiple var statements are not counted as one.

The option's name (and it's description: "This option lets you set the max
number of statements allowed per function") both describe number of JavaScript
statements. Special-casing var statements like this would be surprising to
users who don't subscribe to the subjective argument in favor of that practice.
A separate option might be preferable, but I'm not so sure. One general
litmus test for new features is, "can I name this?" So far all I can think of
is maxnonvarstatements which is kind of a mouthful. More important than
aesthetics though, is the cognitive overhead of maintaining configurations with
two distinct options whose responsibility overlap.
We could mitigate that with a new option that modifies maxstatements;
something like collapsebindings: true, but I think options should be
independent whenever possible for discoverability/maintenance purposes.
A third idea would be to make maxstatements accept modifiers within the value
itself, e.g. maxstatements: 20:collapsebindings. This is probably the best
way to go although there isn't much precedence for the pattern.
Now that I've written all that, though, I'm starting to wonder if "number of
statements" is really a code safety/correctness concern. maxstatements may be
a good candidate for removal.
@mikesherov: you have a good sense for the appropriate separation; what do you
think?

maxstatements is of the same variety as maxdepth and maxcomplexity: a code quality metric. I do think it belongs in JSHint, as setting maxstatements helps keep functions small and readable.
My personal opinion is to close this as wontfix because a statement is a statement even if it's just a var declaration. It still introduces cognitive overhead to have to track variables, and the fix is still the same: make smaller functions.
If anything I'd add another new rule called maxbindings (or a better name) that tracks local bindings, so developers have another metric they can enforce but I personally wouldn't have it do anything fancy like subtract those declarations from max statements or anything.

HI, I am not sure I have been clear.
var a, b;

seems to count as 1 statement where as:
var a;
var b;

count as 2 statements.
My JS files are always built with a closure (AMD or else) and a list of generally at least 20-25 var statements to help uglification. As an example, see https://github.com/telerik/kendo-ui-core/blob/master/src/kendo.calendar.js.
Some developers prefer var a,b; but others prefer var a; var b; for reasons explained here above. The code is the same, but the way jshint is currently designed it is difficult to control maxstatements over a project in the second case.

@jlchereau, you've been clear.
My point was that, yes var a, b; and var a; var b; are semantically equivalent, but they are still 1 and 2 statements, respectively.
And even though you'd pass some chosen value for maxstatements with the 1 statement version but not the 2 statement version, the fact that there is a large enough statement count discrepancy means you're likely including too many local variables per function.
Keep in mind I can also change the code c(); d(); to c(), d() and reduce the statement count by one without changing semantics. The comma operator in general is a sneaky way to reduce statement count.

With all that said, keep in mind that for the "large count of local variables inside of a closure pattern", you can use inline JSHint comments to locally allow exceptions to the rule.

@mikesherov thank you for your time.
I second your point about an unambiguous definition of statement but commas do not play well with debugging and multiplying JSHINT comments proves cumbersome to maintain especially when they are no more relevant.
So please consider a ignoreMultipleVars or handleMultipleVarsAsOne option on the wish list for further improvements considering your other priorities. I have no doubt some developers might consider it a useful addition to an already wonderful tool.

We haven't seen any additional interest in functionality like this, so I am going to close this issue. The proposed API would warrant some additional discussion, and I'm still not convinced that the feature is entirely appropriate besides. If anyone is interested in contributing a patch with this feature, please let us know so that we can collaborate on the design and implementation.


RHBPMS-5127, RHBPMS-5128: Tasks: Empty task list loads indefinitely. …

…Tasks: Pagination broken

@dgutierr here we go again.
I added some test to try the code that ensure the totalRowCountNonTrimmed has the expected value. One of the doubts here is if after the the https://github.com/dashbuilder/dashbuilder/commit/8d3fdeb03c9b9bdffb1762563fba16ef21087533 and https://github.com/dashbuilder/dashbuilder/commit/df2060a40e8cf462490181bda3fb15112f733b42 The way that we use to add group operation have to be changed. The datasetlookup added at the test reflects our usecase. Could you take a look there? Thanks a lot!

@kkufova I applied the code formatting on the test class, but if I  do that on SQLDataSetProvider.java.. if results in 108 changes, In this moment, I think it would do the review more complicated, even we don't know this commit is the best solution. After the @dgutierr confirmation for that, I can apply the formatting to that class. Do you think it makes sense?

@nmirasch, I agree, thank you! :+1:

@kkufova Thanks!

@kkufova Can you please confirm the dashbuilder build works fine. including the tests?
It would be good to also execute the DBs integration tests => https://github.com/dashbuilder/dashbuilder/tree/0.5.x/dashbuilder-backend/dashbuilder-dataset-sql-tests

@dgutierr @kkufova why is not triggering the CI PR builder for this instead of manually launching integration tests?

Jenkins test this, please

Jenkins please retest this

@dgutierr, sure, I'll check it locally.

@kkufova please fyi 4 tests failed in resurrected Pr builder CI job

@mareknovotny I am now with the dashbuilder 0.5.x PR - but it is not yet stable . it downloads somehow 0.9.x artifacts - and this shouldn't be

Jenkins please retest this

The build does not fail locally. I'll check the DBs integration tests tomorrow.

@kkufova when you are ok with this, please @dgutierr merge it, thanks in advance!

I'm merging this despite the fact jenkins is complaining with a "java.lang.ClassNotFoundException: javax.servlet.ServletContextListener" in the dataset CDI module.  Local build though is working fine both for me and @kkufova. There seems to be an issue with jenkins setup.

ok, thanks @kkufova and @dgutierr


Cannot find "NewLogin" in the "Cloud Script Function" dropdown.

I looked at the steps that are shown in Unity, everything is going fine except the fact that "NewLogin" is not shown in the "Cloud Script Function" dropdown selection... I need to add EasyPlayfab to help me stop Playfab spammers in order to succeed in not reaching the API Rate Limit. Please get back to me ASAP, thanks.

In the first picture shown, you see the instructions given through Unity, and in the second picture, you can see my issue where "NewLogin" is not shown.

paste the cloudscript thats in the "cloudscript" file in automation -> revisions


Update to match UP 8 spec

Now matches UP 8.  I also took the opportunity to do some general housecleaning while updating everything -- gutted lodash, got rid of redundant helper functions, fixed up docs/formatting, improved helper function names, etc.

@Fang- If you can eyeball the wallets in test/assets and confirm they match the keygen-hoon stuff, I'll consider this good to merge, and will push a release to npm.

(Going to merge this just to ensure that an updated version is available on npm.)

For the record, I settled with @jtobin that his tests were correct and my tests were wrong. Keygen-js confirmed for Being Good, keygen-hoon confirmed for Good Soon.


Ability to export all app ID's and signature hashes

I suggest to implement a feature allowing to easily export all app ID's and corresponding signature hashes in some reasonable format. Would be very useful when compiling a list of app ID's + hashes.
Especially useful if https://github.com/soupslurpr/AppVerifier/issues/5 is implemented: makes the contributions to the database extremely easy. I would recommend making an option to export in the same format as the database format.

additional functionality to export only selected app ID's + hashes.

I don't see a point in this, #7 seems better


feat(texarea): add ux-textarea component

Add UX-Textarea component with the following features:

Material Design
Display disabled, readonly, and error states
Extends disabled, readonly, placeholder, minlength, maxlength, rows, cols, and autofocus attributes
Integration with Aurelia Validation
Character Counter
Autoresize attribute

Autoresize Attribute
The ux-textarea has an auto-resize attribute to allow the textarea to grow in height as needed to accommodate the input.
Usage
<ux-textarea auto-resize></ux-textarea>

Images from showcase app.

Awesome! Will review soon.
On Mar 17, 2017 7:35 AM, "Zacharey Hollingshead"<EMAIL_ADDRESS>wrote:

Add UX-Textarea component with the following features:

Material Design
Display disabled, readonly, and error states
Extends disabled, readonly, placeholder, minlength, maxlength, rows,
cols, and autofocus attributes
Integration with Aurelia Validation
Character Counter
Autoresize attribute

Autoresize Attribute
The ux-textarea has an auto-resize attribute to allow the textarea to grow
in height as needed to accomodate the input.
Usage

You can view, comment on, or merge this pull request online at:
https://github.com/aurelia/ux/pull/39
Commit Summary

refactor(input): Move input-info
feat(textarea): Add textarea component
feat(textarea): Add auto-resize attribute
refactor(textarea): code cleanup

File Changes

M src/index.ts https://github.com/aurelia/ux/pull/39/files#diff-0
(6)
R src/input-info/ux-input-info-theme.css
https://github.com/aurelia/ux/pull/39/files#diff-1 (2)
R src/input-info/ux-input-info-theme.ts
https://github.com/aurelia/ux/pull/39/files#diff-2 (0)
R src/input-info/ux-input-info.html
https://github.com/aurelia/ux/pull/39/files#diff-3 (0)
R src/input-info/ux-input-info.ts
https://github.com/aurelia/ux/pull/39/files#diff-4 (3)
A src/textarea/ux-textarea-theme.css
https://github.com/aurelia/ux/pull/39/files#diff-5 (72)
A src/textarea/ux-textarea-theme.ts
https://github.com/aurelia/ux/pull/39/files#diff-6 (12)
A src/textarea/ux-textarea.html
https://github.com/aurelia/ux/pull/39/files#diff-7 (8)
A src/textarea/ux-textarea.ts
https://github.com/aurelia/ux/pull/39/files#diff-8 (144)

Patch Links:

https://github.com/aurelia/ux/pull/39.patch
https://github.com/aurelia/ux/pull/39.diff

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/aurelia/ux/pull/39, or mute the thread
https://github.com/notifications/unsubscribe-auth/AAIBneV5WOpJ9MCYdclFeehkXltwt2Qlks5rmppCgaJpZM4Mgqqs
.

Feel free to merge when you are ready @ZHollingshead


Refactoring logging template

Problem:
Current logging template include configure in in template
Solution:
Refactoring current logging template to small dedicated templated
Types pr:
https://github.com/rancher/types/pull/788

lgtm, waiting for merge to be unblocked

types merged. please update this PR

closing in favor of https://github.com/rancher/rancher/pull/20243, which has updated vendor.conf for types commit


Error when launching Storage Analytics manually

Hello,
Launching the Storage Analytics function manually results in an error that prevents it from running.
from analytics.tasks import create_storage_analytics_snapshot
eager_results = create_storage_analytics_snapshot.apply_async()

Inside docker-compose exec django ./manage.py shell_plus
Traceback (most recent call last):
  File "<input>", line 1, in <module>
    eager_results = create_storage_analytics_snapshot.apply_async()
  File "/usr/local/lib/python3.8/site-packages/celery/local.py", line 146, in __getattr__
    return getattr(self._get_current_object(), name)
  File "/usr/local/lib/python3.8/site-packages/celery/local.py", line 319, in _get_current_object
    return self.__evaluate__()
  File "/usr/local/lib/python3.8/site-packages/celery/local.py", line 349, in __evaluate__
    thing = Proxy._get_current_object(self)
  File "/usr/local/lib/python3.8/site-packages/celery/local.py", line 109, in _get_current_object
    return loc(*self.__args, **self.__kwargs)
  File "/usr/local/lib/python3.8/site-packages/celery/app/base.py", line 434, in _task_from_fun
    base = base or self.Task
  File "/usr/local/lib/python3.8/site-packages/kombu/utils/objects.py", line 44, in __get__
    value = obj.__dict__[self.__name__] = self.__get(obj)
  File "/usr/local/lib/python3.8/site-packages/celery/app/base.py", line 1123, in Task
    return self.create_task_cls()
  File "/usr/local/lib/python3.8/site-packages/celery/app/base.py", line 1002, in create_task_cls
    return self.subclass_with_self(
  File "/usr/local/lib/python3.8/site-packages/celery/app/base.py", line 1026, in subclass_with_self
    Class = symbol_by_name(Class)
  File "/usr/local/lib/python3.8/site-packages/kombu/utils/imports.py", line 57, in symbol_by_name
    module = imp(module_name, package=package, **kwargs)
  File "/usr/local/lib/python3.8/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
  File "<frozen importlib._bootstrap>", line 991, in _find_and_load
  File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 655, in _load_unlocked
  File "<frozen importlib._bootstrap>", line 618, in _load_backward_compatible
  File "/usr/local/lib/python3.8/site-packages/bpython/curtsiesfrontend/repl.py", line 251, in load_module
    module = self.loader.load_module(name)
  File "<frozen importlib._bootstrap_external>", line 522, in _check_name_wrapper
  File "<frozen importlib._bootstrap_external>", line 1022, in load_module
  File "<frozen importlib._bootstrap_external>", line 847, in load_module
  File "<frozen importlib._bootstrap>", line 265, in _load_module_shim
  File "<frozen importlib._bootstrap>", line 702, in _load
  File "<frozen importlib._bootstrap>", line 671, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 843, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/usr/local/lib/python3.8/site-packages/celery/app/task.py", line 11, in <module>
    from celery import current_app, group, states
  File "<frozen importlib._bootstrap>", line 991, in _find_and_load
  File "<frozen importlib._bootstrap>", line 971, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 910, in _find_spec
  File "<frozen importlib._bootstrap>", line 884, in _find_spec_legacy
  File "/usr/local/lib/python3.8/site-packages/bpython/curtsiesfrontend/repl.py", line 280, in find_module
    loader = finder.find_module(fullname, path)
AttributeError: 'VendorImporter' object has no attribute 'find_module'

However, the weird part is that when the function is launched automatically, it seems to run successfully.
[2024-06-02 02:00:00,073: INFO/ForkPoolWorker-2] Task create_storage_analytics_snapshot started
[2024-06-02 02:02:35,970: INFO/Beat] Scheduler: Sending due task do_phase_migrations (competitions.tasks.do_phase_migrations)
[2024-06-02 02:02:35,981: INFO/MainProcess] Received task: competitions.tasks.do_phase_migrations[...]
[2024-06-02 02:02:36,004: INFO/ForkPoolWorker-3] Checking 0 phases for phase migrations.
[2024-06-02 02:02:36,004: INFO/ForkPoolWorker-3] Task competitions.tasks.do_phase_migrations[...] succeeded in 0.022029880434274673s: None
[2024-06-02 02:07:36,093: INFO/Beat] Scheduler: Sending due task do_phase_migrations (competitions.tasks.do_phase_migrations)
[2024-06-02 02:07:36,104: INFO/MainProcess] Received task: competitions.tasks.do_phase_migrations[...]
[2024-06-02 02:07:36,127: INFO/ForkPoolWorker-3] Checking 0 phases for phase migrations.
[2024-06-02 02:07:36,127: INFO/ForkPoolWorker-3] Task competitions.tasks.do_phase_migrations[...] succeeded in 0.021870918571949005s: None
[2024-06-02 02:10:08,097: INFO/ForkPoolWorker-2] Task create_storage_analytics_snapshot stoped. Duration = 53.388 seconds
[2024-06-02 02:10:08,100: INFO/ForkPoolWorker-2] Task analytics.tasks.create_storage_analytics_snapshot[...] succeeded in<PHONE_NUMBER>500645s: None

I am pretty sure that this error started appearing after #1459

So it looks like this error exists for all celery tasks that you want to starts manually. It might be related to the setuptools package version.

A good thing would be to upgrade the python packages. Lots of them are outdated

A good thing would be to upgrade the python packages. Lots of them are outdated

We're on it!

This issue has been fixed by https://github.com/codalab/codabench/pull/1543


Support running on MacOS

Fixes https://github.com/ocurrent/opam-repo-ci/issues/260.
A particular function in the linting step causes problems on MacOS, detailed in the issue above.
This PR creates a separate function that moves the opam process from a preemptive thread to the main thread. We prefer to use the original non-blocking function on Linux as it prevents an unresponsive service.
The user must specify that they are running MacOS with an optional command-line argument, --macos.
(Ideally we should fix the bug at the source but it looks like it'd be complete hell, so this is good enough™.)

Included in https://github.com/ocurrent/opam-repo-ci/pull/258.


Eliminate Polling

Using polling for a worker queue isn't an elegant model, and results in a [configurable but] suboptimal 5-second delay before jobs are processed on an empty queue.
Perhaps utilizing tailable cursors would be a reasonable approach, or even hooking into the oplog (see TorchlightSoftware/mongo-watch).

Closing (but still open to a PR).


base64 decode error with unicode password hash

I get the follow traceback consistently when attempting to log in with a "password account":
base64.urlsafe_b64decode works if you str() it's arg but fails with a unicode arg on line 81.
ERROR    2016-03-19 20:27:29,864 base.py:223] gitkit_instance.GetUserById("07250307095831458805DA000527416E2C4F6C611400"):
Traceback (most recent call last):
File "/Users/rmasse/google-app-engine/laruta-1031/default/bp_content/themes/macpa/handlers/base.py", line 221, in _authorize
gitkit_user_data = main.gitkit_instance.GetUserById(gitkit_user.user_id)
File "/Users/rmasse/google-app-engine/laruta-1031/default/lib/identitytoolkit/gitkitclient.py", line 296, in GetUserById
return GitkitUser.FromApiResponse(user)
File "/Users/rmasse/google-app-engine/laruta-1031/default/lib/identitytoolkit/gitkitclient.py", line 104, in FromApiResponse
return cls(**response)
File "/Users/rmasse/google-app-engine/laruta-1031/default/lib/identitytoolkit/gitkitclient.py", line 81, in init
self.password_hash = base64.urlsafe_b64decode(kwargs['passwordHash'])
File "/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/base64.py", line 116, in urlsafe_b64decode
return b64decode(s.translate(_urlsafe_decode_translation))
TypeError: character mapping must return integer, None or unicode

Is there anybody working to fix this?


Remove Systems library from nvtabular

Remove systems library components from the nvtabular library.

rerun tests

👍🏻
(This should also remove the tests though)

/blossom-ci

/blossom-ci

/blossom-ci


Issues with Nuget pack on VSTS

I'm having issues packing the Nuget package and change build number using Nuget Packager. My project is MSBuild 15 project and build running on VS2017 hosted agent.
I try following scenarios:

Nuget packager - Verionning scheme Off and passing -Suffix as Nuget parameter
This produce The default XML namespace of the project must be the MSBuild XML namespace. If the project is authored in the MSBuild 2003 format, please add xmlns="http://schemas.microsoft.com/developer/msbuild/2003" to the <Project> element. If the project has been authored in the old 1.0 or 1.2 format, please convert it to MSBuild 2003 format.
Nuget command and manually pass -Version in the Nuget arguments
I get Unable to cast object of type 'System.String' to type 'NuGet.Frameworks.NuGetFramework'.

This looks like an issue with the old version of NuGet (3.3) used by the build tasks. In about 2 weeks, we'll have a new "NuGet" task you can grab from the catalog that supersedes this task and uses NuGet 4.0. The relevant PR is #4397


remove unstable feature

 Umstieg auf Stable vorbereiten

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

33 of 41 (80.49%)  changed or added relevant lines in 9 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.006%) to 85.334%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

operators/src/processing/temporal_raster_aggregation/mean_aggregation_subquery.rs
3
4
75.0%

operators/src/adapters/raster_subquery_adapter.rs
10
13
76.92%

operators/src/processing/temporal_raster_aggregation/min_max_first_last_subquery.rs
12
16
75.0%

Totals

Change from base Build<PHONE_NUMBER>:
0.006%

Covered Lines:
27458

Relevant Lines:
32177

💛  - Coveralls

bors merge

bors merge


Range performance fixes

I'm using Annotator on pages with really large tables, highlighting potentially thousands of rows of text. Selecting any amount of text which spans more than one row was extremely expensive. NormalizedRange#limit and #getTextNodes were the main culprits according to Chrome's profiler. These patches make them an order of magnitude faster for me.
Happy to write more tests if you're not convinced that this new logic is right! Also, the existing code is inconsistent in whether it uses $.contains or util.contains; shout if there's some hidden reason to use one or the other that I've not seen.
Agh, while writing this pull request I've noticed that I introduced a use of childNodes in #limit -- based on the comment in #getTextNodes I guess I need to remove that for IE9's sake.

To no-one's great surprise, using TreeWalker is a bit faster (or no slower) and more concise. I didn't know about it, thanks! I also found a bug in my open-coded implementation of #limit – the tests now cover that.

(Let me know if you would like the intermediate patches squashed away.))

That's excellent. Squash away and I'll be glad to merge it!

If you could also remove the flatten function, which is no longer used now, that would be excellent.

How's that?

Looks great :)

@tilgovi @wjt How challenging do you think it'd be to backport this to 1.2.x? I'm seeing the same performance issue there and can't upgrade to 2.0 yet. Thanks.

@mwidner there's a v1.2.x branch on annotator so we have a place to backport fixes and make maintenance releases. Do you think you could extract this into a PR there?

It shouldn't be too hard because when this change happened the files were still coffee and still had the same names and paths, so it might be as simple as taking a copy of the annotator repo, branching off v1.2.x, adding this repo as a remote and cherry-picking these changes.

Done! Thanks for the pointers.


[main] Move extensions into new actions package

Issue:  https://github.com/rancher/qa-tasks/issues/1300

Problem
 There were a lot extensions that were being maintained in a shepherd when it made more sense to maintain them directly in rancher/rancher
Solution
 Move identified actions into the new package.
Testing

Engineering Testing
Manual Testing

Automated Testing

Test types added/modified:

Unit
Integration (Go Framework)
Integration (v2prov Framework)
Validation (Go Framework)
Other - Explain: EXPLAIN
None
REMOVE NOT APPLICABLE BULLET POINTS ABOVE

If "None" - Reason: EXPLAIN THE REASON

If "None" - GH Issue/PR: LINK TO GH ISSUE/PR TO ADD TESTS

Summary: TODO
QA Testing Considerations

Regressions Considerations

TODO
Existing / newly added automated tests that provide evidence there are no regressions:

TODO

Met with Israel and here are the rules to further help distinguish between actions v. Extensions. Please use this for reference when reviewing:
The following qualify a function to be an extension:

Must be either an api call not natively captured by the client OR specific CRUD / wait on resource

i.e. download ssh keys
tokens package
should not only directly convert -> this would make it an action

Disqualifiers for extensions (If any one or more are true, function is an action):

if there's a custom config needed, in any part
if it is a validation of any sort (Waits are okay)
if function is a direct conversion of a resource

more on this, if the function is purely just calling a native call + catching the error, this should not be an extension. A conversion would be more complex; see an example like token package

how re-usable is the code? Shepherd code should be highly re-usable

thanks for the nice work. have a few questions/clarifications on some of the files. Note: The commits look a bit messed up probably due to a rebase.
Will fix commit history.

The templates and GVR's that @anupama2501 pointed, will stay for the simple reason of ease of maintainability. Separating them out in two packages is not worth the maintainability for the value they bring. If down the line, we determine that they have wider use cases outside of rancher/rancher, we can have PRs in shepherd to do so.


Added support for building Linux binaries

Thanks for contribution! Please go through following checklist before sending PR.
PR Branch Destination
This feature is targeted for Azurite V3
Test Cases
Added test cases for Linux binary executables.
Also added a job to test Linux binary in pipeline.
Change Log
VFS and other projects are expected to have developer loops on systems other than windows. This feature adds support to azurite to release Linux binaries.

azp /run

@vigneashs The pipeline has an issue on duplicated test job naming. Can you update?

Fixed duplicate name @XiaoningLiu

/azp run

@vigneashs
The ci failed since  a missing reference, could you please update against latest main, and see if the issue can be resolved?
the error is:

tests/linuxbinary.test.ts(21,8): error TS2307: Cannot find module './table/apis/table.entity.test.utils' or its corresponding type declarations.


Enhance kind list

How to categorize this PR?

/area quality
/kind enhancement
What this PR does / why we need it:
This PR enhances the kind list, which is used to sort the resources before applying. Source - https://github.com/helm/helm/blob/main/pkg/releaseutil/kind_sorter.go
Which issue(s) this PR fixes:
Fixes #
Special notes for your reviewer:
Release note:

NONE

/lgtm
/approve


Remove Thread Local code from AndroidSQLite

Removed thread local code from AndroidSQLite, it is no longer
needed to match the behaviour of the JavaSE implementation.
BugzID: 47161
reviewer @tomblench
reviewer @brynh

+1

+1


Please update bundled hsql driver to 2.6.1

Which version and edition of Flyway are you using?
Flyway Community Edition 8.5.13 by Redgate
If this is not the latest version, can you reproduce the issue with the latest one as well? (Many bugs are fixed in newer releases and upgrading will often resolve the issue)
Which client are you using? (Command-line, Java API, Maven plugin, Gradle plugin)
CLI
Which database are you using? (Type & version)
HSQLDB 2.6.1
Which operating system are you using?
GNU/Linux
What did you do? (Please include the content causing the issue, any relevant configuration settings, the SQL statement(s) that failed (if any), and the command you ran)
$ ls -1 drivers/hsqldb*

What did you expect to see?
drivers/hsqldb-2.6.1.jar

What did you see instead?
drivers/hsqldb-2.6.0.jar

Thank you!


Expiration-related fixes

What

Make signatures unusable if nonce might expire
Make nonce entries to live for at least the min allowed ledger number
Make expiration computations consistent with the lifetime expectations

Why
Security/consistency enhancements
Known limitations
N/A

It's unfortunate that seq - 1 logic is going to creep into contracts as well. I think we're going to see quite a few off by one errors (with or without your change).

That's why I'm suggesting to provide a helper method that bumps the entry to a given ledger. I don't think there are any other useful scenarios where the error is possible.

It's unfortunate that seq - 1 logic is going to creep into contracts as well. I think we're going to see quite a few off by one errors (with or without your change).

That's why I'm suggesting to provide a helper method that bumps the entry to a given ledger. I don't think there are any other useful scenarios where the error is possible.

Oh yeah for the sdk right?

Oh yeah for the sdk right?

Yes, we can do that at the SDK level. Doing that in host fn is slightly safer for other SDKs, but probably that's not a big deal (these probably should borrow the implementation details from the Rust SDK)


oxygen units

They should be micromol per kg get them from gsw

Hi @callumrollo just saw this issue here on oxygen units.
Our discussion here might interest you too:
https://github.com/OceanGlidersCommunity/Oxygen_SOP/issues/131


Replace createVehicleCrew with fn_createCrew

Q
A

Bug fix?
no

New feature?
no

Needs wipe?
no

Description:

Ditch createVehicleCrew command and replace it with a function that uses preset configuration only. Now you can put a different faction assets in the same preset without spawning crew that not fit into your scenario.
The function checks what kind of vehicle is to get the correct type of crew.
The function tries to find empty seats for driver, gunner and commander. For the turret seat (generally from helicopters), only gets the co-pilot.

Content:

[ x] Add new function called fn_createCrew
[ x] Replace all createVehicleCrew command in the files
[ ] Put the new variables (used in the function) in other presets

Successfully tested on:

[ x] Local MP
[ x] Dedicated MP

Most presets don't have pilots and crew defined yet - maybe add some logic inside the function to default to something if they're not defined? I was thinking rifleman for crew at the very least.

Yes, I can do that for now, but I could also add those variables on the other presets aswell, it's boring but I can do it with time. Tell me if this is worth it so I can manage my time to add them.

Done. I've put the placeholder types of crew that already exist on presets for each side.


Change logging for production mode

1. Why is this change necessary?
Currently when using production mode for Shopware it is logging all debug and info logs. It is also logging to one file which if left unmanaged can use a lot of resources and disk space.
2. What does this change do, exactly?
This does two things. The first is that it only logs errors and the second is that it create a new log file each day. This makes it easier for developers to find logs based on the day and also the log file never becomes too large.
Additionally a server administrator can then delete older log files via a CRON.
3. Describe each step to reproduce the issue or behaviour.
4. Please link to the relevant issues (if any).
5. Checklist

[ ] I have written tests and verified that they fail without my change
[ ] I have squashed any insignificant commits
[ ] I have written or adjusted the documentation according to my changes
[ ] This change has comments for package types, values, functions, and non-obvious lines of code
[ ] I have read the contribution requirements and fulfil them.

Hello,
thank you for creating this pull request.
I have opened an issue on our Issue Tracker for you. See the issue link: https://issues.shopware.com/issues/NEXT-7068
Please use this issue to track the state of your pull request.

thanks for your contribution @colinmurphy :+1: :tada: :blue_heart:


endless loop of building ControlFlowSensitiveDFGPass when parsing a java file

Hi,
Recently, I met with a file whose CPG can't be built successfully, because endless loop occured in ControlFlowSensitiveDFGPass when parsing it.
The file is Runtime.java in https://github.com/RaiMan/SikuliX1/archive/refs/tags/1.1.3.zip
dump infomation(similar content in several times)
"ForkJoinPool.commonPool-worker-19" #25 daemon prio=5 os_prio=0 cpu=269812.50ms elapsed=272.34s tid=0x0000019868093000 nid=0x616c runnable  [0x0000008290cfd000]
   java.lang.Thread.State: RUNNABLE
        at de.fraunhofer.aisec.cpg.passes.ControlFlowSensitiveDFGPass.worklistHasSimilarPair(ControlFlowSensitiveDFGPass.kt:237)
        at de.fraunhofer.aisec.cpg.passes.ControlFlowSensitiveDFGPass.handleFunction(ControlFlowSensitiveDFGPass.kt:216)
        at de.fraunhofer.aisec.cpg.passes.ControlFlowSensitiveDFGPass.handle(ControlFlowSensitiveDFGPass.kt:72)
        at de.fraunhofer.aisec.cpg.passes.ControlFlowSensitiveDFGPass$$Lambda$784/0x00000008004f4c40.accept(Unknown Source)
        at de.fraunhofer.aisec.cpg.helpers.SubgraphWalker$IterativeGraphWalker.lambda$iterate$1(SubgraphWalker.java:366)
        at de.fraunhofer.aisec.cpg.helpers.SubgraphWalker$IterativeGraphWalker$$Lambda$741/0x0000000800428c40.accept(Unknown Source)
        at java.util.ArrayList.forEach(java.base@11.0.7/ArrayList.java:1540)
        at de.fraunhofer.aisec.cpg.helpers.SubgraphWalker$IterativeGraphWalker.iterate(SubgraphWalker.java:366)
        at de.fraunhofer.aisec.cpg.passes.ControlFlowSensitiveDFGPass.accept(ControlFlowSensitiveDFGPass.kt:59)
        at de.fraunhofer.aisec.cpg.passes.ControlFlowSensitiveDFGPass.accept(ControlFlowSensitiveDFGPass.kt:47)
        at de.fraunhofer.aisec.cpg.TranslationManager.analyze$lambda$2(TranslationManager.kt:102)
        at de.fraunhofer.aisec.cpg.TranslationManager$$Lambda$150/0x000000080024f440.get(Unknown Source)
        at java.util.concurrent.CompletableFuture$AsyncSupply.run(java.base@11.0.7/CompletableFuture.java:1700)
        at java.util.concurrent.CompletableFuture$AsyncSupply.exec(java.base@11.0.7/CompletableFuture.java:1692)
        at java.util.concurrent.ForkJoinTask.doExec(java.base@11.0.7/ForkJoinTask.java:290)
        at java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(java.base@11.0.7/ForkJoinPool.java:1020)
        at java.util.concurrent.ForkJoinPool.scan(java.base@11.0.7/ForkJoinPool.java:1656)
        at java.util.concurrent.ForkJoinPool.runWorker(java.base@11.0.7/ForkJoinPool.java:1594)
        at java.util.concurrent.ForkJoinWorkerThread.run(java.base@11.0.7/ForkJoinWorkerThread.java:177)

configuration: v5.1.0
new TranslationConfiguration.Builder()
                .sourceLocations(new File(filename))
                .defaultPasses()
                .defaultLanguages()
                .build();

For ControlFlowSensitiveDFGPass.kt, worklist.size in func handleFunction keeps increasing when parsing Runtime.java, which causes endless loop. I guess the func worklistHasSimilarPair need to relax restrictions, which can avoid to add some similar pairs to worklist frequently.

Hi, please check #1024 and let us know if it resolves the issue. I think it works in this specific case but as I say in the PR, it may not fix related problems.

Hi, please check #1024 and let us know if it resolves the issue. I think it works in this specific case but as I say in the PR, it may not fix related problems.

I test some files with solution #1024, it fixed most of endless loop problems I now encounter, but still leave one as above.
the file is ApplicationMaster.java in https://github.com/Qihoo360/XLearning/blob/master/src/main/java/net/qihoo/xlearning/AM/ApplicationMaster.java
the worklist.size keeps fluctuating, it seems to never decrease to zero.

That was exactly what I expected... I changed the PR a bit and the sample you sent should work with the new changes. Let me know if you encounter any other issues

That was exactly what I expected... I changed the PR a bit and the sample you sent should work with the new changes. Let me know if you encounter any other issues

All endless loop problems I now encounter are solved with new changes in #1024. There is no other new issue at present.

Hi @KuechA ,
There is a file(KDC.java) which has the same problem. It may need to relax the worklistHasSimilarPair condition further.


uncommented host line

Uncommenting host to allow that tag in changesets.

Thanks for the quick fix! I'll merge it once the travis checks finish.


Document creating an app with yarn

As discussed in #3890
This documents how to create an app using yarn, I opted not to provide equivalent yarn commands for global installs, because it wouldn't really affect CRA, but I could add that if we should.
I also did not provide an equivalent for all npm run except at places where they take arguments or where it doesn't disrupt the reading flow. I could've missed some though.

I believe the general consensus we had before was that anyone who installed Yarn would probably be mindful enough to use Yarn commands.
I do like pointing out yarn create react-app though, can we start with just that addition?

@Timer I've reverted the changes to the template readme.

fyi we added similar doc in https://github.com/facebook/create-react-app/pull/4638

I believe this PR is no longer necessary. Closing.


[Bug]: bach-ui Production Time Summary Report generation for one day is timing out in OPS after 30 mins

Checked for duplicates
Yes - I've already checked
Describe the bug
https://opera-ops-mozart-fwd.jpl.nasa.gov/bach-api/reports/ProductionTimeSummaryReport?startDateTime=2023-07-17T00:00&endDateTime=2023-07-18T00:00&reportType=sdp&mime=application/zip
If you run that report in OPS right now it runs for 30+ minutes and the proxy server times out. Based on previous optimization efforts we were projecting that we should be able to process ~60-day worth of data under 30 mins. However, we are now seeing that, at least for this particular date, just this one day worth is taking 30min+. So something is wrong.
ES process has no CPU activity after the initial query and it's all gunicorn process from there. I saw it using 100% CPU the entire time (single-threaded) but most importantly the memory usage continue to grow as time went on and I saw up to 37GB memory being used by one single gunicorn process. This is extraordinary for just one day worth of data.
I suspect that dates like this is tripping up some edge case in the bach-api algorithm.
What did you expect?
n/t
Reproducible steps
1.
2.
3.
...

Environment
- Version of this software [e.g. vX.Y.Z]
- Operating System: [e.g. MacOSX with Docker Desktop vX.Y]
...

Fixed in https://github.com/nasa/opera-sds-bach-api/pull/45


error: subprocess-exited-with-error when installing requirements.txt

Preparing metadata (setup.py) ... error
error: subprocess-exited-with-error
× python setup.py egg_info did not run successfully.
│ exit code: 1
╰─> [7 lines of output]
fatal: not a git repository (or any of the parent directories): .git
Traceback (most recent call last):
File "", line 2, in
File "", line 34, in
File "C:\Users\B\AppData\Local\Temp\pip-install-scjff5dr\onnx_1fd13208ee2841d5aef421cabb54e471\setup.py", line 318, in
raise FileNotFoundError("Unable to find " + requirements_file)
FileNotFoundError: Unable to find requirements.txt
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed
× Encountered error while generating package metadata.
╰─> See above for output.
note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

Do I need to provide more information to help troubleshoot this?

Was getting the same error using python 3.11, switched to 3.8 and it resolved the issue.


[Style] UI of the navbar is not appealing

What's the style idea?

Making nav bar accessible even to bottom of page and improving navbar ui
Using hover effects on navbar
About and services in navbar are not working

Checklist

[X] I have checked the existing issues.
[X] I follow Contributing Guidelines of this project.
[X] I am a GSSoC'24 contributor.

Code of Conduct

[X] I agree to follow this project's "Code of Conduct".

Hi, If anyone is not working on this issue can you please assign it to me?


fix CLIENT_ID_VAR reference in DefaultCredentials

Fix for https://github.com/google/google-auth-library-ruby/issues/153

Coverage remained the same at 98.624% when pulling d1142d6ab730f06dbc6eec345bbdc0dd4d1f96ba on scope-bugfix into 42b1b6eb53443fe14d88ceda1a4e45efafc3de06 on master.


We cannot assign the same license more than once to one account.

[Enter feedback here]

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 0a465cba-da38-a42a-495f-299b90f2d5cf
Version Independent ID: 4e1952ae-622a-ba1d-5258-dc334c0c35db
Content: Multiple LCS projects and production environments on one Azure AD tenant - Finance & Operations | Dynamics 365
Content Source: articles/fin-ops-core/fin-ops/get-started/implement-multiple-projects-aad-tenant.md
Service: dynamics-ax-applications
Product: ****
Technology: ****
GitHub Login: @ClaudiaBetz-Haubold
Microsoft Alias: chaubold

In this document said:

Users who access multiple environments in parallel must be licensed separately for each environment. For more licensing information, download the Licensing guide.

And, in another document said:

System admins can assign licenses to users in the Microsoft 365 admin center.

But, We cannot assign the same license more than once to one account.
These documents are inconsistent.
I propose two solutions.

Erase the wording of the original document.
Please include this information in the Disadvantages of the original document.

@kanagayo, thanks for the feedback.
@ClaudiaBetz-Haubold, please review and make updates as needed.

Bug #456961 logged to track this issue.

This topic has been updated and now states "A user can only be assigned one license for each product for each Azure AD tenant. This allocation of licensing requirements for LCS projects for specific users must be documented outside the system."


Plugins v2 are out in Northstar v1.13, let's discuss installation standard

With Northstar v1.13.0 plugins v2 released.
Plugins are more powerful than Squirrel mods as they are native code that interacts with Northstar via an interface.
From a file perspective, plugins are essentially just DLLs that go into the R2Northstar/plugins/ (R2Northstar could be replaced with any other profile ofc).
For easier installation of plugin there's discussion about installing plugins via Thunderstore using mod-managers.
(For security concerns in that regard, check #TODO)
Now like with mods, we need a way to uniquely map a plugin to a Thunderstore mod post installation.
We want compatibility between mod-managers again, so hence this issue to discuss how to handle the mapping.
Example plugin on Thunderstore right now: https://northstar.thunderstore.io/package/cat_or_not/kyurid/

Poking

@0neGal for Viper
@BigSpice for VTOL
@catornot for #267
@AnActualEmerald for papa

One idea was simply renaming the plugin to the Thunderstore mod string. So for example kyurid.dll would become cat_or_not-kyurid-0.1.0.dll which would instantly solve the entire thing for us cause we can just check the filename, except that a Thunderstore could contain multiple plugins and duplicate file names are not allowed x_x

Subfolders was another idea, i.e. moving R2Northstar/plugins/kyurid.dll into R2Northstar/plugins/cat_or_not-kyurid-0.1.0.dll/kyurid.dll but currently Northstar does not support loading plugins from subdir so we'd need to fix that upstream first.

One thing that would work would be prepending the Thunderstore mod string to the DLL, so like e.g. kyurid.dll -> cat_or_not-kyurid-0.1.0_kyurid.dll
Alternatively we stick an entire .json file into the plugins/ folder and treat that as a sorta database that maps dll names to Thunderstore mod string.

I think pretending the modstring would be the most compact way to do it as long as there's no risk of illegal characters. We'd have to agree on the delimiter too, and it would have to be something that wouldn't/couldn't appear in the modstring

Personally, I think at the very least having the option of subdirs would be nice. But then now you've 2 ways of doing it, largely complicating parsing the installed plugins.
And so, in my opinion it'd be best for folders to be in the Thunderstore mod string format, and everything else being treated as something the user manually installed.
I feel like the JSON database file is over complicating tbh...

And so, in my opinion it'd be best for folders to be in the Thunderstore mod string format, and everything else being treated as something the user manually installed.

Agreed. Subdirs named after Thunderstore mod string sounds like the cleanest solution ^^

ok then subdirs should be restored somehow

ok then subdirs should be restored somehow

cat said and then made an upstream PR for it https://github.com/R2Northstar/NorthstarLauncher/pull/460 :eyes:

Thinking about it, if we stick plugin into separate folder already anyway, we could also add manifest.json to it ^^

already did that

Not gonna lie this seems like adding more spaghetti to the thunderstore package loading, we honestly need to rework a large chunk of this stuff

Not gonna lie this seems like adding more spaghetti to the thunderstore package loading, we honestly need to rework a large chunk of this stuff

This issue is about plugins specifically btw and we need some way to map a plugin back to a Thunderstore mod to allow for install detection and updating... ^^

Unless you can rewrite our whole mod loading system within a week, we will need to implement some way to allow for plugin installation on mod-managers in the meantime :P

This issue is about plugins specifically btw

At a surface level, yeah. But the root problem is the gap between thunderstore package format and how launcher reads stuff. Personally I'm a big fan of the idea of just having a separate packages folder instead of doing all this stuff with finding mods/plugins in a package and doing all this extra stuff

Unless you can rewrite our whole mod loading system within a week

I could, but at this point I'm not gonna touch it because any PR that gets made will get stuck in PR hell. All the conflicting standards, installation methods, etc. will make any meaningful refactor impossible because of things like existing mod installs.
Imo at this point, rip it all out and start again, with the thunderstore package format being the only format that is accepted. The problem is only going to get worse, so better to do it sooner rather than later

Unless you can rewrite our whole mod loading system within a week

All the conflicting standards, installation methods, etc. will make any meaningful refactor impossible because of things like existing mod installs.
Imo at this point, rip it all out and start again, with the thunderstore package format being the only format that is accepted. The problem is only going to get worse, so better to do it sooner rather than later

Agreed, I made an issue now to discuss this: https://github.com/R2Northstar/Northstar/issues/472
However as you kinda realise it will take some time to implement a complete rewrite and we still need some way to install plugins via mod-managers in the meantime. Especially as anything done with mod-managers can be upgraded pretty simply in the future as the mod-managers can just add logic that converts an install from one format to another ^^

As a sidenote to PR hell, try to prioritise PRs on what I deem important atm (+ what is faster to review) in my limited time. I'm ofc not the only reviewer/maintainer and others might have other approaches. Overall a mod system refactor would be pretty high up on priority list :eyes:

Agreed, I made an issue now to discuss this: R2Northstar/Northstar#472

Great, thanks

anything done with mod-managers can be upgraded pretty simply in the future as the mod-managers can just add logic that converts an install from one format to another

Yeah this is like our saving grace here tbh, shame that some people love to recommend manual installation over a mod manager
To be clear, I don't disagree with defining a standard for plugin installation. I just see people talking about copying manifests over and stuff and it reminds me how much of a mess this whole system is

So this is basically covered by R2Northstar/NorthstarLauncher#505 now right?

So this is basically covered by R2Northstar/NorthstarLauncher#505 now right?

Yes. It's technically not implemented in https://github.com/R2Northstar/Northstar/issues/472 but will in time and should be treated accordingly as discussed in https://github.com/R2Northstar/NorthstarLauncher/issues/505#issuecomment-1632620304

So this is basically covered by R2Northstar/NorthstarLauncher#505 now right?

Yes.

Of course the security warning should still be implemented, but for a library like libthermite it's a non-issue, since it'd likely be best to have that implemented by whatever is using the library...

Closing this as superseded by #415


Crash game when i try to use forge(minecraft 1.19.2 fabric)

When i click rmb on everything forge with mod alloy forgery, game is crash. Pls help me with this problem(((  (Sorry for my eng)

crash-2022-12-23_21.12.16-client.txt

Duplicate of #80
Charm Fixer mitigates this issue, so you should probably install it

Thx!!!!!!!


Save only project JSON file

Isn't it better to save just the JSON files? this way less space is taken up and I'm pretty sure assets will remain publicly accessible.
PR #8269 in scratch-gui adds the token to the project URL, but not the asset URL, and it's already been merged. Line #62 is the URL for the asset, and as you can see it doesn't contain an extra query parameter, unlike line #44, whose URL also contains the token as a query param. Since it has already been merged, and PR #6773 doesn't modify the assets url, it's pretty safe to assume that assets will remain public.
The file modified in both the PRs that actually bring about this change is src/lib/storage.js

Thanks for your concert @Chiroyce1!

Oh yeah! @micahlt isn't it better to save just the JSON files? this way less space is taken up and I'm pretty sure assets will remain publicly accessible.

I'm open to that - what makes you think that assets will remain public?

I'm open to that - what makes you think that assets will remain public?

PR #8269 in scratch-gui adds the token to the project URL, but not the asset URL, and it's already been merged. Line #62 is the URL for the asset, and as you can see it doesn't contain an extra query parameter, unlike line #44, whose URL also contains the token as a query param. Since it has already been merged, and PR #6773 doesn't modify the assets url, it's pretty safe to assume that assets will remain public.
The file modified in both the PRs that actually bring about this change is src/lib/storage.js

@micahlt looks like the code as of now saves all projects as JSON only (is this a mistake?) and now if someone clones and runs it (like I did) blank files are getting mixed/overwritten with JSON files in projects/ - so the file extension in line #28 should be changed to .json instead of .sb3.

Once we get to .sb2 & .sb3 projects we would only be downloading the JSON anyway as the assets are accessed at a different endpoint. See #8

Right, that makes sense. But currently almost all the files have .sb3 instead of just .sb - we need to make sure to keep the file extensions straight so that we can modify this data later on properly.

I indexed the latest 10,000 projects over here - (from id 692629836 to 692639836)
https://scratch-archive.chiroyce.repl.co/index
To access a project's JSON file, the URL is https://scratch-archive.chiroyce.repl.co/project/{id}
The response will be JSON of
{
    "project": "JSON object of Project's JSON file",
    "info": "JSON object of what the API returned for this project"
}

I unfortunately don't have git locally right now so I am unable to PR here, so if you can, please do so.

I never thought of using replit. A good idea!

Yep, but unfortunately space is a big issue (if you don't have hacker plan) and 10,000 projects itself consumes around ~50% of all the repl's storage -  I am currently working on one that is indexing 20,000 projects and I guess that's the limit.

@Chiroyce1 something's wrong with your repl. I keep getting 500 errors.

Can I get the URL you are sending a request to? Make sure not to add .json to the end, and also make sure the ID you are requesting is there in the array you get from /index
Also @micahlt @MagentaSuperNova - see this!!

So Lefty (the hoister and creator of ScratchDB) possibly has all the files!!

Also, all of the projects that we have archived so far are just the project files, no metadata.

API data? I have that.. but most projects are unshared :/


Adding Windows Support - Refactored code to fix a few compilation issues...

Incorporated the comments given for the previous PULL Request.
The changes are compiling & build is working fine in windows.

@sriniprash I'm going to take a look a this, I just have to bring my windows VM back up so I can try it out.

Does this build completely? I had to modify the the ansi/tty files as well on my machine.


fix: more defensive markdown links mailto #trivial

This PR resolves []
Description
Solves the sentry issue where if (node.target.startsWith("mailto:")) { wasn't defensive

PR Checklist

[x] I have tested my changes on iOS and Android.
[x] I hid my changes behind a [feature flag], or they don't need one.
[x] I have included screenshots or videos, or I have not changed the UI.
[x] I have added tests, or my changes don't require any.
[x] I added an [app state migration], or my changes do not require one.
[x] I have documented any follow-up work that this PR will require, or it does not require any.
[x] I have added a changelog entry below, or my changes do not require one.

To the reviewers 👀

[ ] I would like at least one of the reviewers to run this PR on the simulator or device.

Changelog updates
#nochangelog

Warnings

:warning:

✅ No changelog changes

  Generated by :no_entry_sign: dangerJS against f31d7d0633d1c71ec1dcb55ad9eed37738f75f64


[core / SFTTrainer] Fix breaking change

What does this PR do?
fixes a breaking change on a recent PR: https://github.com/huggingface/trl/pull/1188
Fixes: https://github.com/huggingface/trl/issues/1216
In fact, if one uses the default data collator + remove_unused_columns=False, the training script fails for some datasets such as imdb as the collator will try to encode all the columns, including "text". The fix should be to force-set remove_unused_columns=True, only in the case users do not pass a data_collator for non-packing datasets and explain to the users who they should proceed in case they decided to pass remove_unused_columns=False
cc @lvwerra

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Thanks for the action.
Not sure about details yet, just a general comment:

only in the case users do not pass a data_collator for non-packing datasets

Long special condition may not be a good design and may not be accurate either.

I agree, the thing is that :
1- in previous releases it was possible to pass remove_unused_columns=False to trainingarguments + non-packed dataset without any problem - however we were silently ignoring the unusued columns - and #1188 breaks it
2- passing remove_unused_columns=False + default data collator will most likely fail before the default datacollator will try to tokenize text columns by default, so it'll always fail in that scenario. IMO it should be bad intent and we should leave the support of that feature only for users that they know what they're doing, by subclassing the default collator and passing it to SFTTrainer
What do you think?

Wait, maybe I didn't got it correctly in the first place? My intention is to tokenize the text column so that it can be trained with, is that supposed to be the case?

tokenizing the text column should be already handled properly by the SFTTrainer, when you pass dataset_text_field="text" it will tokenize the text field and remove the text column after tokenizing it

(I could be using it in the totally wrong way because it was just used as a mitigation of the other issue I mentioned.)


Use ssd for postgres databases

looks good

looks good

lol :)

looks good, nobody is perfect :D haha thanks Mike for finding this!


Level 3 Shop

Hi all! Would like to clarify on "If you have designed the simulator correctly, this level would only require you to construct the rest of the ARRIVE, SERVE, DONE, WAIT and LEAVE events in order to perform a proper simulation. For each event, you will need to define an appropriate execute method that takes in the current state of the shop, and return the appropriate next event, as well as the updated shop as a pair of values."
What does it mean by the "current state of the shop"? - my current implementation is keeping an ImList of customers in Server. Once ImList.size() == 2, the server is full, the ArriveEvent will try to find a new server to serve a customer. --> This will also lead to the WAIT/SERVE/LEAVE events.
Am I doing something wrong here?

Hi, you should return the current state of the shop, meaning:
For arrive event: don't do anything to shop and just pass it into Pair.
For serve: update the shop with servers tagged as busy
For done: update the shop with server tagged as available.

@Seibell thank you for the clarification! :D

Yeppppp, since the shop contains a list of your servers, you should be updating the servers (e.g. Server 1 not available as it is serving a customer) inside the shop after each event :)

@LohYangXian thank you for the clarification! :D


Packet Flow Validation Workflow

Checks Packet Forwarding between Checkpoint-1 and Checkpoint-2:
Capture - To Capture Specific Type of Traffic using BPF-Filter

run skydive-functional-tests-backend-elasticsearch

run skydive-functional-tests-backend-orientdb

run skydive-functional-tests-backend-elasticsearch

run skydive-functional-tests-backend-elasticsearch

@dvandra I fixed the test TestFlowValidation1/2 and the workflow, be sure to remove etcd remaing test files  before retesting rm -rf /tmp/skydive-etcd
https://paste.fedoraproject.org/paste/49v55Q0ICYTvAruRgfEezw

@dvandra I fixed the test TestFlowValidation1/2 and the workflow, be sure to remove etcd remaing test files before retesting rm -rf /tmp/skydive-etcd
https://paste.fedoraproject.org/paste/49v55Q0ICYTvAruRgfEezw

Thank You so much @safchain!!

run skydive-functional-tests-backend-orientdb

run skydive-functional-tests-backend-elasticsearch

run skydive-functional-tests-backend-elasticsearch

run skydive-functional-tests-backend-elasticsearch

run skydive-functional-tests-backend-elasticsearch

rerun skydive-functional-tests-backend-elasticsearch

run skydive-functional-tests-backend-elasticsearch

run skydive-functional-tests-backend-elasticsearch

@dvandra There is maybe a real issue, please have a look, I will have a look too

@dvandra There is maybe a real issue, please have a look, I will have a look too
Yes, i am looking for that only!

run skydive-functional-tests-backend-elasticsearch

run skydive-functional-tests-backend-elasticsearch
run skydive-functional-tests-backend-orientdb

run skydive-functional-tests-backend-elasticsearch
run skydive-functional-tests-backend-orientdb

run skydive-functional-tests-backend-orientdb
run skydive-k8s-tests
run skydive-functional-tests-backend-elasticsearch

run skydive-functional-tests-backend-orientdb

run skydive-k8s-tests


BiDirectional Dijkstra

Given a source and a target, perform Dijkstra from both sides until met.
This could provide an alternative to A*

Should implement ShortestPathST

e0590f11d3fb826472b2684ecb5eda549f540df9


Excessive logging for plugins_run() specifically dpinger_status

My system logs are full of this:

I've disabled it on my system by commenting out the relevant syslog() calls in plugins_run() in the plugins.inc file. This might be a developer thing but we could do with some sort of verbose or info setting option for logging. Just a thought....

I'll take a look, for 95% of the calls, you really want to know it's actually doing something, but gateway status is excessive indeed (maybe some others too).

I think the issue only exists in plugins_run, which at the moment is only used for gateway status. I moved the log level to debug in https://github.com/opnsense/core/commit/b94a5ce129fb9e8572e9ac9bd15648b34fe4ef9e, which should be enough. other plugins are called less excessive and the data is more relevant when tracking issues.

Maybe.. but I cannot see any others..
That function already has a $verbose argument, although it's not used. Perhaps a config option 'Verbose Logging' and pick  that up in the call or in the function. Could be used elsewhere too. I can add that if you like,.

the verbose is for console output, logging should just obey levels. in most cases you really want to know which parts are executed when an event is triggered (for example when someone pulls the plug of an interface, multiple parts are executed). if there are other calls which flood the log, just let me know, we might want to move some more levels up, although we likely also want some option to flush debug to some log as well in that case.


Remove implied '+'

Didn't personally like the look of the + in front of the current temperature and tick marks, not sure if that is standard elsewhere or not. If so, perhaps it could be an option?

Hello. Thanks for contributing. I did this to avoid shifting the graph in relation to the icons under the graph. If you align the icons on a graph with a positive temperature, when the temperature becomes negative, an additional symbol appears in the ticks and the graph goes to the right. Maybe there is a better solution?
For examlpe:

Here the icons were aligned when the temperature was positive.


[QUESTION] Apple pay instant purchase experience

Hello! We're currently using this integration for our current project, and I have CT Associate Functional Architect certification myself.
We currently need an instant purchase with Pay with ApplePay functionality where the billingAddress and shippingAddress from ApplePay will be the one to be used for the commercetools' Cart/Order.
basically the flow would be on our Cart Page, we want to allow users to purchase products from the store instantly with a Pay with ApplePay button and we won't ask them to input their billingAddress and shippingAddress, instead we'll use the details from ApplePay.
is it possible to achieve and implement the experience above with this integration?

Hey @levincalado  I'm currently also looking into this and was wondering if you had found a solution or got a response from else where? I'm currently struggling to get the Apple Pay option to come back from the getPaymentOptions request despite seemingly having set up everything correctly on Adyen's console 😕


Infinity Loop on Startup

Hi,
i don't know if it is my fault but let me try to explain.
I have three main activities and every activity should use these BottomBar. Therefore i have a "BaseActivity".
At the first start the method onMenuTabSelectedis called. At this place an infinity loop is created.
Is this my faut (I think so.. :))?
https://gist.github.com/T0bbes/563b681fe2155476af4574b08fd29ea9
Thanks!

It's probably better to use Fragments instead of Activities, and instead just use one MainActivity which has a single FrameLayout which you use to put the fragments in. Something like this:
activity_main.xml:
<LinearLayout
		xmlns:android="http://schemas.android.com/apk/res/android"
		android:layout_width="match_parent"
		android:layout_height="match_parent"
		>
	<!-- This nesting is necessary because you'll be attaching the BottomBar to the LinearLayout and putting the Fragments in the FrameLayout -->
	<FrameLayout
			android:id="@+id/container"
			android:layout_width="match_parent"
			android:layout_height="match_parent"
			/>
</LinearLayout>

Part of MainActivity.java:
@Override
protected void onCreate(Bundle savedInstanceState) {
	super.onCreate(savedInstanceState);

	navBar = BottomBar.attach(this, savedInstanceState); // navBar is a field of MainActivity
	navBar.setItems(R.menu.bottom_bar);
	navBar.setOnMenuTabClickListener(this);
}

@Override
public void onMenuTabSelected(@IdRes int menuItemId) {
	switch (menuItemId) {
		case R.id.x:
			replaceFragment(XFragment.newInstance());
			break;
		case R.id.y:
			replaceFragment(YFragment.newInstance());
			break;
		case R.id.z:
			replaceFragment(ZFragment.newInstance());
			break;
	}
}

private void replaceFragment(Fragment fragment) {
	getFragmentManager()
		.replace(R.id.container, fragment, yourTagForThisFragment)
		.commit();
}

HTH

Fixed in the newest version, thanks to @xizzhu !

@alexwalterbos
Thanks but the discussion whether I use fragments or activities is a differente theme.Rather a religious theme... ;)
@roughike
Is the fix in version 1.3.8? I still have the problem :/

This issue isn't fixed yet


feat: switch from user workload monitoring to in-cluster monitoring stack

Switching from user workload monitoring to in-cluster monitoring and securing metrics endpoint with TLS

adding kube-rbac-proxy sidecar to handle authn and authz
adding 2 config maps and 1 secret required by kube-rbac-proxy
adding Role and RoleBinding for prometheus-k8s user to be able to retrieve metrics
switching to openshift-cluster-health-analyzer namespace

Note: I updated Install section in readme with a command to download a config map (containing client CA) from openshift-monitoring namespace (required for TLS on metrics endpoint), this will be obsoleted in another PR adding a Makefile to handle common tasks such as test, lint, deploy, proxy Prometheus from a cluster etc.

/lgtm
Just a typo. Thanks for your effort @xiormeesh!

/lgtm


BLE Static passkey doesn't work properly with passkey of less than 6 digits

Environment

Development Kit:
Kit version (for WroverKit/PicoKit/DevKitC):
Module or chip used:  ESP32-WROOM-32
IDF version (run git describe --tags to find it): v3.1.2
Build System:  Make
Compiler version (run xtensa-esp32-elf-gcc --version to find it): 1.22.0-80-g6c4433a
Operating System: Linux
Power Supply: USB

Problem Description
Trying to use ESP_BLE_SM_SET_STATIC_PASSKEY with 4 digits doesn't work for authentication unless I add two zeroes before the pin when entering it on my phone.
Expected Behavior
If it set the passkey as follow :
uint32_t passkey = 1427;
esp_ble_gap_set_security_param(ESP_BLE_SM_SET_STATIC_PASSKEY, &passkey, sizeof(uint32_t));

I should be able to just type "1427" on my smartphone when prompted for the pin.
Actual Behavior
When entering "1427" on my phone, I get the following (I'm using nkolban's BLE library)

I (30947) BLEDevice: ESP_GAP_BLE_PASSKEY_NOTIF_EVT
I (30947) BLEDevice: passKey = 1427
I (30947) BLESecurity: On passkey Notify number:1427
W (44307) BT_SMP: Commitment check fails
I (44317) BLEDevice: ESP_GAP_BLE_AUTH_CMPL_EVT
W (44317) MoonaBLESecurity: Authentication of the client is a failure
W (47307) BT_BTM: btm_sec_clr_temp_auth_service() - no dev CB
[I] BLE device disconnected.
E (47327) BT_BTM: Device not found

But then if I enter "001427", I get the following :

I (144817) BLEDevice: ESP_GAP_BLE_PASSKEY_NOTIF_EVT
I (144817) BLEDevice: passKey = 1427
I (144817) MoonaBLESecurity: On passkey Notify number:1427
W (152137) BT_SMP: FOR LE SC LTK IS USED INSTEAD OF STK
I (152167) BLEDevice: ESP_GAP_BLE_KEY_EVT
I (152167) BLEDevice: key type = ESP_LE_KEY_LENC
I (152167) BLEDevice: ESP_GAP_BLE_KEY_EVT
I (152167) BLEDevice: key type = ESP_LE_KEY_PENC
I (152177) BLEDevice: ESP_GAP_BLE_KEY_EVT
I (152177) BLEDevice: key type = ESP_LE_KEY_LID
I (152187) BLEDevice: ESP_GAP_BLE_KEY_EVT
I (152197) BLEDevice: key type = ESP_LE_KEY_LCSRK
I (152347) BLEDevice: ESP_GAP_BLE_KEY_EVT
I (152357) BLEDevice: key type = ESP_LE_KEY_PID
I (152357) BLEDevice: ESP_GAP_BLE_AUTH_CMPL_EVT
I (152357) BLESecurity: Authentication of the client is a success

Steps to repropduce

Set a pin with only 4 digits
Enter those 4 digits when prompted to do so on your phone -> failure
Enter those 4 digits prefixed with "00" when prompted to do so on your phone -> success

Code to reproduce this issue
That's the part where the security details are set up :
// the code should be wrapped in the ```cpp tag so that it will be displayed better.
BLESecurity* pSecurity = new BLESecurity();
pSecurity->setAuthenticationMode(ESP_LE_AUTH_REQ_SC_BOND);
pSecurity->setCapability(ESP_IO_CAP_OUT);
pSecurity->setInitEncryptionKey(ESP_BLE_ENC_KEY_MASK | ESP_BLE_ID_KEY_MASK);
uint32_t passkey = 1427;
esp_ble_gap_set_security_param(ESP_BLE_SM_SET_STATIC_PASSKEY, &passkey, sizeof(uint32_t));

Its already been answered in other issue. Even if your passkey is 4 digit, like 1427, in most peer devices you probably have to prefix pin with 00, because pin has to be 6 digit long.

If you could point out this issue, I haven't found any referencing the same problem going back at the date of the release of v3.1.2

https://github.com/espressif/esp-idf/issues/2322#issuecomment-421214524

@chegewara,
thanks for your help.
@LaurentLouf ,
Do you have any other questions?

@LaurentLouf Feel free to reopen if you still have the issue, thanks.