riven 500 | Internal error

Describe the bug
hi, I'm trying to setup DMB with riven enabled. The front end has started sucessfully, I've gone through the initial setup but immediately after that it shows "500 | Internal error".
By checking the log, I see that the backend is trying to restart constantly but unsuccessful, the last error in the log is
24-08-22 11:37:52 | :x: ERROR     | program.validate_database - Database connection failed. Is the database running?
24-08-22 11:46:59 |  CRITICAL  | main.<module> - Server has been stopped

Could anyone help? Thank you
here's my compose, could you pls. take a look to see what's wrong with it?
version: "3.8"
services:
  DMB:
    container_name: DMB
    image: iampuid0/dmb:latest
    stdin_open: true # docker run -i
    tty: true        # docker run -t
    volumes:
      - /volume2/docker/dmb/config:/config
      ## Location for logs
      - /volume2/docker/dmb/log:/log
      - /volume2/docker/dmb/cache:/cache
      ## Location for Zurg RealDebrid active configuration
      - /volume2/docker/dmb/zurg/rd:/zurg/RD
      ## Location for rclone mount to host
      - /volume2/media/dmb/zurg/mnt:/data:shared
      ## Location for Riven backend data
      - /volume2/docker/dmb/riven/data:/riven/backend/data
      ## Location for Riven symlinks
      - /volume2/media/dmb/riven/mnt:/mnt
    environment:
      - TZ=Asia/Saigon
      ## Zurg Required Settings
      - ZURG_ENABLED=true
      - RD_API_KEY=Z7VDOS2OIEKH5DI3XXX
      ## Zurg Optional Settings
      - ZURG_UPDATE=true
        ## Rclone Required Settings
      - RCLONE_MOUNT_NAME=DMB
      ## Rclone Optional Settings - See rclone docs for full list
      - ORIGIN=http://<IP_ADDRESS>:3000 # See Riven documentation for more details
      ## Riven Optional Settings
      - RIVEN_ENABLED=true
      - RIVEN_BACKEND_UPDATE=true
      - RIVEN_FRONTEND_UPDATE=true
      ## Special Features
      - DMB_LOG_LEVEL=DEBUG  # Master log level for all program logs in DMB
      - COLOR_LOG_ENABLED=true
    network_mode: bridge
    ports:
      - "3000:3000"
    devices:
      - /dev/fuse:/dev/fuse:rwm
    cap_add:
      - SYS_ADMIN
    security_opt:
      - apparmor:unconfined
      - no-new-privileges

To Reproduce
Access http://<IP_ADDRESS>:3000 and see the 500 | Internal error
Expected behavior
To be able to go to settings and setup riven via the Web UI.
Please complete the following information:

OS: DSM Synology SA6400
Version: 7.1
Supporting Applications: Docker (via Portainer)

hi, I've tried with the version 4.0.0 and the problem persists, please help to reopen the issue

I'm on the latest image today, and I'm getting the same issue. I can see in the logs that postgres is and is still running. I have the postgres mount point config you listed there in my compose. Here's the log (not debug), what should I run for the debug log?
failed-riven-backend.log


WIP: Make rugged dependency optional

Per https://github.com/benbalter/licensee/issues/66 this makes the dependency on Rugged optional (falling back to the file system project method).
I'm sympathetic to the fact that needing to compile Rugged adds complexity to local use/development, but am concerned that this approach, although it works, adds significant complexity to the testing process.
On the one hand, we probably should run the test suite as a whole twice, once as a Git repo and once as a file system repo, but the way the tests are currently structured, and the fixtures, that's not the case.
@vmg, @bkeepers any strong opinions one way or the other? I'm fine punting on this for the time being.
/cc @sschuberth, fixes https://github.com/benbalter/licensee/issues/66

Sorry if I'm missing something obvious and even getting slightly off topic, but what's the purpose of a GitProject anyway as we have a FSProject now? I mean, a Git working tree also is an FSProject as it's located on the file system. I would see the benefit of a separate GitProject if it was able to also scan remote Git repos without cloning them / checking them out, but that does not seem to be the case, or?

I would see the benefit of a separate GitProject if it was able to also scan remote Git repos without cloning them / checking them out, but that does not seem to be the case, or?

@sschuberth that's exactly how Licensee is used within GitHub.com. Given the number of repositories (10M and counting), it's preferable to work in Git, rather than shuttle repository data back and forth.

I see.
Another thought, more on-topic: Instead of making the distinction between GitProject and FSProject within the test methods, how about maintain completely separate tests instead, an expect the GitProject ones to fail if rugged is not installed?

[...] it's preferable to work in Git, rather than shuttle repository data back and forth.

@benbalter I was trying to (again) make sense out of what you said. I believe the advantage of GitProject over FSProject is not about not having to shuttle data back and forth. Even a GitProject requires you to have the Git repository on your local machine. It cannot magically scan a remote Git repository without cloning it. However, the clone may be a --bare one. Or if you are running licensee on the Git server itself, it can directly scan the bare repositories from there. So the advantage is that a GitProject does not require a working tree. I tried to make that clear as part of PR #91.
Would you agree to that I'm saying here?

@sschuberth See e.g., the context around GitRPC in http://githubengineering.com/move-fast/#preparing-for-an-experiment. We have the ability to run Git commands on remote machines, with only the result crossing the network. In our case, the files do not exist on disk, as we're hitting the Git DB directly for performane reasons.

Ah, I didn't know about GitRPC, thanks for the link!

Closing as stale and too much a technical lift for me right now. If anyone else wants to take this on, glad to review a PR.


Limit on the number of agents per sweep?

Describe the bug
After initializing a sweep, running more than 3 agents causes an error
To Reproduce
Set up a sweep and run more than 3 agents
Expected behavior
No limit on the number of agents
Screenshots
If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):

OS: tried on both own server running Ubuntu 18.04 and Google Colab
Browser: Chrome

Additional context
wandb: Starting wandb agent ??
2021-02-01 15:18:35,955 - wandb.wandb_agent - INFO - Running runs: []
400 response executing GraphQL.
{"errors":[{"message":"ValueError: '-4' is not in list","path":["agentHeartbeat"]}],"data":{"agentHeartbeat":null}}
wandb: ERROR Error while calling W&B API: ValueError: '-4' is not in list (<Response [400]>)
wandb: Terminating and syncing runs. Press ctrl-c to kill.
Traceback (most recent call last):
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/site-packages/wandb/sdk/internal/internal_api.py", line 1316, in agent_heartbeat
    response = self.gql(
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/site-packages/wandb/old/retry.py", line 96, in __call__
    result = self._call_fn(*args, **kwargs)
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/site-packages/wandb/sdk/internal/internal_api.py", line 137, in execute
    six.reraise(*sys.exc_info())
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/site-packages/six.py", line 703, in reraise
    raise value
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/site-packages/wandb/sdk/internal/internal_api.py", line 131, in execute
    return self.client.execute(*args, **kwargs)
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/site-packages/wandb/vendor/gql-0.2.0/gql/client.py", line 52, in execute
    result = self._get_result(document, *args, **kwargs)
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/site-packages/wandb/vendor/gql-0.2.0/gql/client.py", line 60, in _get_result
    return self.transport.execute(document, *args, **kwargs)
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/site-packages/wandb/vendor/gql-0.2.0/gql/transport/requests.py", line 39, in execute
    request.raise_for_status()
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 400 Client Error: Bad Request for url: https://api.wandb.ai/graphql

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/lesci/miniconda3/envs/deep_al/bin/wandb", line 8, in <module>
    sys.exit(cli())
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/site-packages/click/decorators.py", line 21, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/site-packages/wandb/cli/cli.py", line 94, in wrapper
    return func(*args, **kwargs)
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/site-packages/wandb/cli/cli.py", line 815, in agent
    wandb_agent.agent(sweep_id, entity=entity, project=project, count=count)
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/site-packages/wandb/wandb_agent.py", line 562, in agent
    return run_agent(
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/site-packages/wandb/wandb_agent.py", line 519, in run_agent
    agent.run()
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/site-packages/wandb/wandb_agent.py", line 252, in run
    commands = self._api.agent_heartbeat(agent_id, {}, run_status)
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/site-packages/wandb/apis/internal.py", line 92, in agent_heartbeat
    return self.api.agent_heartbeat(*args, **kwargs)
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/site-packages/wandb/sdk/internal/internal_api.py", line 1327, in agent_heartbeat
    message = ast.literal_eval(e.args[0])["message"]
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/ast.py", line 59, in literal_eval
    node_or_string = parse(node_or_string, mode='eval')
  File "/home/lesci/miniconda3/envs/deep_al/lib/python3.8/ast.py", line 47, in parse
    return compile(source, filename, mode, flags,
  File "<unknown>", line 1
    400 Client Error: Bad Request for url: https://api.wandb.ai/graphql
        ^
SyntaxError: invalid syntax

@pietrolesci this looks like an issue with your sweep configuration: ValueError: '-4' is not in list.  Can you share either a link to your sweep or the sweep config?

Hi @vanpelt, thanks a lot for your swift reply. Happy to share the link to the sweep, but it's a private project. How can I best handle this? In the meantime, here is the config file
program: sweep.py
method: bayes
metric:
  name: valid/loss_step
  goal: minimize
parameters:
  seed:
    values: [42, 1994, 8975, 5713, 2917, 2620, 2020, 128, 1157]
  model_name:
    values: ["bert-base-uncased"]
  batch_size:
    values: [8, 16, 32]
  lr:
    values: [0.00025, 0.0005, 0.000025, 0.00005]
  num_epochs:
    values: [5, 10, 20]
  use_scheduler:
    values: [True, False]
  freeze_layers:
    values: [None, feature_extractor, -1, -2, -4]

early_terminate:
  type: hyperband
  s: 2
  eta: 3
  max_iter: 27

Sweep URL has been added to the internal ticket:
https://wandb.atlassian.net/browse/CLI-682
On Mon, Feb 1, 2021 at 10:03 AM Pietro Lesci<EMAIL_ADDRESS>wrote:

Hi @vanpelt https://github.com/vanpelt, thanks a lot for your swift
reply. Happy to share the link to the sweep, but it's a private project.
How can I best handle this? In the meantime, here is the config file
program: sweep.py
method: bayes
metric:
name: valid/loss_step
goal: minimize
parameters:
seed:
values: [42, 1994, 8975, 5713, 2917, 2620, 2020, 128, 1157]
model_name:
values: ["bert-base-uncased"]
batch_size:
values: [8, 16, 32]
lr:
values: [0.00025, 0.0005, 0.000025, 0.00005]
num_epochs:
values: [5, 10, 20]
use_scheduler:
values: [True, False]
freeze_layers:
values: [None, feature_extractor, -1, -2, -4]
early_terminate:
type: hyperband
s: 2
eta: 3
max_iter: 27
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/wandb/client/issues/1785#issuecomment-771044741, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAN7MP5E4GNLZDKULG4IX5DS43UHBANCNFSM4W44DTFA
.

Hi @vanpelt, I'd like to provide further feedback. I DO think it is related to the config because I managed to instantiate >4 agents running the same sweep by simply dropping that config (i.e. "freeze_layers"). However, I previously managed to successfully run experiments using the "-4" option (present in the sweep runs). I saw the same error with all the option "-1" too that, again, I managed to run. Once again, thank you very much for your help on this.

Hey @pietrolesci
It looks like you have both string and number for the config values. You should make them all strings and can convert on your end if necessary.
Hope this helps! :smile:


Numerical Issues with DGESV

Hello OpenBLAS community,
I'm facing numerical issues using Lapack given by OpenBLAS. In particular, I get incorrect results using DGESV for solving a linear system. I'm attaching the test matrices A and B for solving A*x=B:
A.txt
B.txt
I was thinking that I might have done a mistake but:

Using the same code but just the netlib lapack the results are correct.
Dealing with matrices of size lower than 18x18 the results are correct (maybe cache issue?).
BLAS routines work correct.

Details about my machine:
CPU: Intel i5-7500 @3.40 GHz
RAM: 16 GB
OS: Windows (using flang)
L1 cache: 256 KB
L2 cache: 1.0 MB
L3 cache: 6.0 MB
Thank you

Which version of OpenBLAS, and could you post your entire test code please ? (With current develop, I get the exact same results with and without OpenBLAS' own implementation of dgesv - and also with plain netlib 3.8.0, when I plug your test matrices into the dgesv example from the MKL documentation)

Please patch BIOS and/or intel-microcode past this numeric problem:
https://lists.debian.org/debian-devel/2017/06/msg00308.html

I'm using my own class storage system for the matrices but in a plain C++ format the code will look like this:
#include "f77blas.h"
#include <random>

extern "C" int BLASFUNC(dgesv)(blasint *, blasint *, double *, blasint *, blasint *, double*, blasint *, blasint *);
extern "C" void BLASFUNC(dgemv)(char *, blasint *, blasint *, double *, double *, blasint *, double *, blasint *, double *, double *, blasint *);
extern "C" double BLASFUNC(dnrm2) (blasint *, double *, blasint *);

int main()
{
	int n = 18;
	int nrhs = 1;

	uint32_t seed;
	std::mt19937 eng;

	std::srand(time(nullptr));
	seed = std::rand();
	eng.seed(seed);

	double *A, *Acpy, *B, *error;
	A = new double[n*n];
	Acpy = new double[n*n];
	B = new double[n];
	error = new double[n];

	for (int i = 0; i < n; i++)
	{
		B[i] = std::uniform_real_distribution<double>{ 0.0, 1.0 }(eng);
		error[i] = B[i];
		for (int j = 0; j < n; j++)
		{
			A[j + i * n] = std::uniform_real_distribution<double>{ 0.0, 1.0 }(eng);
			Acpy[j + i * n] = A[j + i * n];
		}

	}

	int* ipiv = new int[n];
	int info;

	//solve A*x=B and store it on B
	BLASFUNC(dgesv)(&n, &nrhs, A, &n, ipiv, B, &n, &info);

	//form A*x-B
	char trans = 'N';
	double alpha = 1.0;
	double beta = -1.0;
	int incr = 1.0;
	BLASFUNC(dgemv)(&trans, &n, &n, &alpha, Acpy, &n, B, &incr, &beta, error, &incr);

	double errornorm = BLASFUNC(dnrm2) (&n, error, &incr);

	std::cout << "Error norm = " << errornorm << std::endl;

	delete[] ipiv, A, Acpy, B, error;
}

I'm using openblas 0.3.6 static lib in visual studio. Could you please test this code by increasing the size of the matrix n? I get correct results up until n=17.
brada4 i will check the link you posted, thank you for all your concern.

With gcc9, OpenBLAS 0.3.6 on i7-7500U under Linux I get

n
errornorm

5
2.20e-16

15
1.45e-15

25
5.54e-15

35
1.00e-14

45
3.64e-14

55
2.53e-14

85
3.01e-14

155
2.92e-13

255
2.45e-13

555
5.29e-12

1555
1.02e-10

5555
1.72e-10

15555
3.33e-9

which looks (to me at least) more like slow creep due to algorithmic differences (FMA?), not a sudden breakdown.

I will move to Ubuntu and see if this problem still occurs. I'll send a feedback.
Thank you

Just tested on Ubuntu, it works fine. Thus I guess something goes wrong with the Windows installation. I followed the instructions given in https://github.com/xianyi/OpenBLAS/wiki/How-to-use-OpenBLAS-in-Microsoft-Visual-Studio. What bugs me is that the BLAS functions work fine. Any suggestions?

Actually FMA increases accuracy and gives more accurate result than reference implementation, something like 1+log2(FLOP) bits are lost in each value. DMA is equivalent of multiple MUL and ADD instruction, but giving just one loss in place of few.
Probably something like TARGET=SANDYBRIDGE , the most advanced without FMA, will be closer to reference implementation, and Reference implementation with -march=native will deviate from plain gfortran too.
Not very practial in real life, but FMA version will be closer to full symbolic result.

Very simple FMA example :
Lets calculate
AxB+CxD when B=D
While full iteration will do 3 operations we can do the obvious algebraic simplification and get away with two deviating by not losing in one half-bit in the result.

@TsarpDev - the prototype you're using for the dgemv() function is incomplete.  It doesn't include the so-called "hidden" length argument which must be present for each char * argument.

More info:

https://gcc.gnu.org/onlinedocs/gfortran/Argument-passing-conventions.html
https://developer.r-project.org/Blog/public/2019/05/15/gfortran-issues-with-lapack/
https://gcc.gnu.org/bugzilla/show_bug.cgi?id=90329
https://gitlab.com/conradsnicta/armadillo-code/issues/123

Not convinced this interface issue is actually the cause here - if it was, I would expect the pure netlib build to fail at least as spectacularly. (And we seem to have flang here, not gfortran which triggered the recent discussions/revelations regarding extra argument requirements for single-character strings)

You're right - the interface is probably not the issue.  At the same time, I suspect flang uses the same argument passing mechanism as gfortran (for compatibility), so it's probably a good idea to point out problems with blas/lapack prototypes. The entire snafu with "hidden arguments" came about because folks weren't aware of the argument passing mechanism, and this propagated everywhere via cargo-cult programming.

@conradsnicta I guess this is better discussed in #2154, but the actual API problem as I see it was that the gcc team introduced an optimization that made the hidden argument a requirement even for single-character strings, a detail of the standard which no major compiler appears to have enforced in decades. By the way DGESV happens to be one of the few LAPACK functions that OpenBLAS replaces with its own reimplementation written in C.

@TsarpDev a Windows build of 0.3.6 is now in https://github.com/xianyi/OpenBLAS/issues/805#issuecomment-515676966 (cross-compiled on Linux with mingw from the MXE framework), hopefully it can be linked with your C++ code


Instant crash if you put a transmiter and then use the radio to also trasmit your voice.

I am playing on 1.20.1, 1.1.0
If i place a transmiter block, a receiver and then i enable the radio to start transmiting with the radio and the transmiter block it crashes the game.
On singleplayer: Crash without crashlog.
On server: Only the server crashes. No crashlog generated/log
Also, very cool mod, i love it.

Now it only happens if you open the receiver/transmiter UI

I can't reproduce this, perhaps an incompatibility with another mod?


Find unique selector in the scope of a root element

Normally, this script will find a unique selector for an element in the scope of the whole document but I will probably also need the option to apply this algorithm within a root element.
If you are willing to merge such a feature, I would create a PR.

Sounds interesting, yep. Definetely a nice suggestion. It can be a param in options config.

@AvraamMavridis @vwochnik @ericclemmons
Proposing Changes
let owner;
 function isUnique(el, selector, owner) {
  if (!Boolean(selector)) return false;
  const elems = (owner !== undefined && owner !== null)
                ? owner.querySelectorAll(selector)
                : el.ownerDocument.querySelectorAll(selector);

  return elems.length === 1 && elems[0] === el;
}

function unique(el, options = {}, owner) {
  const {
    selectorTypes = ['ID', 'Class', 'Tag', 'NthChild'],
    attributesToIgnore = ['id', 'class', 'length'],
    excludeRegex = null,
  } = options;

  const allSelectors = [];
  const parents = getParents(el);

  for (let elem of parents) {
    const selector = getUniqueSelector(elem, selectorTypes, attributesToIgnore, excludeRegex);
    if (Boolean(selector)) {
      allSelectors.push(selector);
    }
  }

  const selectors = [];
  for (let it of allSelectors) {
    selectors.unshift(it); // Build the selector path
    const selector = selectors.join(' > '); // Create full selector path
    // Check uniqueness with respect to the owner context
    if (isUnique(el, selector, owner)) {
      return selector; // Return the first unique path found
    }
  }

  return null; // If no unique selector found
}

Test Results:
Passing body > nth-child(33) as owner
and one of its child as DomElement
options = {
selectorTypes : [ 'ID', 'Class', 'Tag', 'NthChild' , 'Attributes' ]

}
unique( $0, options );  --> Context of document
':nth-child(33) > :nth-child(1) > div'
unique( $0, options , document.querySelector('body > nth-child(33)'));  --> Context of defined parent root
##':nth-child(1) > div'

Proof
document.querySelectorAll(unique(DomElemmt, options , document.querySelector('body > :nth-child(33)')))
Return: div_acb4
document.querySelector('body > :nth-child(33)').querySelectorAll(unique( DomElement, options , document.querySelector('body > :nth-child(33)')))
Return: div_acb4

Scoping to particlar root parent
then user would have ti use
Nth child or attributes as selectorTypes
as class id tags are independient of parent


health monitoring

if the docker swarm dies, there's no notifications; there's no health checks or other status checks, and it'd be good to automate that at least as far as $ allows.

also, nothing is checking on the redis database: hows disk space, and so on... since accounts expire, this shouldn't be a problem, unless bots get through recaptcha.
but, anyway good to track.


Detroit - General Copy Updates Partners - Home Types

As a leasing agent,
I want to make sure the terms are generic enough for even a single family home
So that I know I'm filling in the right information
Acceptance Criteria

When I am on the listing tab, the Housing Developer label should say "Developer/Property Owner"
When I am on the application tab, the title of the section Leasing Agent should say "Leasing Contact Information" and the description should say "Provide details about who will be managing the application process."

Screenshots

LGTM


matmul causing segmentation fault in rev1.4.0

Please go to Stack Overflow for help and support:
https://stackoverflow.com/questions/tagged/tensorflow
If you open a GitHub issue, here is our policy:

It must be a bug or a feature request.
The form below must be filled out.
It shouldn't be a TensorBoard issue. Those go here.

Here's why we have that policy: TensorFlow developers respond to issues. We want to focus on work that benefits the whole community, e.g., fixing bugs and adding features. Support only helps individuals. GitHub also notifies thousands of people when issues are filed. We want them to see you communicating an interesting problem, rather than being redirected to Stack Overflow.

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow):
Yes
OS Platform and Distribution (e.g., Linux Ubuntu 16.04):
Linux Ubuntu 16.04
TensorFlow installed from (source or binary):
source
TensorFlow version (use command below):
1.4.0
Python version:
3.6
Bazel version (if compiling from source):
0.8.1
GCC/Compiler version (if compiling from source):
5.4.0
CUDA/cuDNN version:
N/A
GPU model and memory:
N/A
Exact command to reproduce:
Here is the output from tf_env_collect.sh

== cat /etc/issue ===============================================
Linux Ubuntu 4.4.0-101-generic #124-Ubuntu SMP Fri Nov 10 18:29:59 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
VERSION="16.04.3 LTS (Xenial Xerus)"
VERSION_ID="16.04"
VERSION_CODENAME=xenial
== are we in docker =============================================
No
== compiler =====================================================
c++ (Ubuntu 5.4.0-6ubuntu1~16.04.5) 5.4.0 20160609
Copyright (C) 2015 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
== uname -a =====================================================
Linux Ubuntu 4.4.0-101-generic #124-Ubuntu SMP Fri Nov 10 18:29:59 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
== check pips ===================================================
numpy (1.13.3)
protobuf (3.5.0.post1)
tensorflow (1.4.0)
tensorflow-tensorboard (0.1.8)
== check for virtualenv =========================================
True
== tensorflow import ============================================
tf.VERSION = 1.4.0
tf.GIT_VERSION = b'v1.3.0-rc1-5916-g18c864c'
tf.COMPILER_VERSION = b'v1.3.0-rc1-5916-g18c864c'
Sanity check: array([1], dtype=int32)
== env ==========================================================
LD_LIBRARY_PATH /usr/lib/nx/X11/Xinerama:/usr/lib/nx/X11
DYLD_LIBRARY_PATH is unset
== nvidia-smi ===================================================
tensorflow-src/tensorflow/tools/tf_env_collect.sh: line 105: nvidia-smi: command not found
== cuda libs  ===================================================
You can collect some of this information using our environment capture script:
https://github.com/tensorflow/tensorflow/tree/master/tools/tf_env_collect.sh
You can obtain the TensorFlow version with
python -c "import tensorflow as tf; print(tf.GIT_VERSION, tf.VERSION)"
Describe the problem
Describe the problem clearly here. Be sure to convey here why it's a bug in TensorFlow or a feature request.
Seeing a segmentation fault on matmul operation.
Source code / logs
Here is the source code:
import tensorflow as tf
a = tf.random_normal([100, 200])
b = tf.random_normal([200, 300])
res = tf.matmul(a, b)
tf.Session().run(res)
Here is the backtrace from gdb:
#0  0x00007fff513b9296 in Eigen::internal::gemm_pack_lhs<float, long, Eigen::internal::TensorContractionSubMapper<float, long, 1, Eigen::TensorEvaluator<Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::ThreadPoolDevice>, Eigen::array<long, 1ul>, Eigen::array<long, 1ul>, 16, true, false, 0, Eigen::MakePointer>, 48, 16, 0, false, false>::operator()(float*, Eigen::internal::TensorContractionSubMapper<float, long, 1, Eigen::TensorEvaluator<Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::ThreadPoolDevice>, Eigen::array<long, 1ul>, Eigen::array<long, 1ul>, 16, true, false, 0, Eigen::MakePointer> const&, long, long, long, long) ()
from /tensorflow/python/_pywrap_tensorflow_internal.so
#1  0x00007fff5142ce94 in Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const> const, Eigen::ThreadPoolDevice>::Context<Eigen::internal::gemm_pack_lhs<float, long, Eigen::internal::TensorContractionSubMapper<float, long, 1, Eigen::TensorEvaluator<Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::ThreadPoolDevice>, Eigen::array<long, 1ul>, Eigen::array<long, 1ul>, 16, true, false, 0, Eigen::MakePointer>, 48, 16, 0, false, false>, Eigen::internal::gemm_pack_rhs<float, long, Eigen::internal::TensorContractionSubMapper<float, long, 0, Eigen::TensorEvaluator<Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::ThreadPoolDevice>, Eigen::array<long, 1ul>, Eigen::array<long, 1ul>, 16, true, false, 0, Eigen::MakePointer>, 4, 0, false, false>, Eigen::internal::gebp_kernel<float, float, long, Eigen::internal::blas_data_mapper<float, long, 0, 0>, 48, 4, false, false>, Eigen::internal::TensorContractionInputMapper<float, long, 1, Eigen::TensorEvaluator<Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::ThreadPoolDevice>, Eigen::array<long, 1ul>, Eigen::array<long, 1ul>, 16, true, false, 0, Eigen::MakePointer>, Eigen::internal::TensorContractionInputMapper<float, long, 0, Eigen::TensorEvaluator<Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::ThreadPoolDevice>, Eigen::array<long, 1ul>, Eigen::array<long, 1ul>, 16, true, false, 0, Eigen::MakePointer>, Eigen::internal::blas_data_mapper<float, long, 0, 0> >::enqueue_packing_helper(long, long, long, bool) ()
from /tensorflow/python/_pywrap_tensorflow_internal.so
#2  0x00007fff4eab29c1 in Eigen::NonBlockingThreadPoolTempltensorflow::thread::EigenEnvironment::WorkerLoop(int) ()
from /tensorflow/python/../libtensorflow_framework.so
#3  0x00007fff4eab07d7 in std::_Function_handler<void (), tensorflow::thread::EigenEnvironment::CreateThread(std::function<void ()>)::{lambda()#1}>::_M_invoke(std::_Any_data const&) ()
from /tensorflow/python/../---Type  to continue, or q  to quit---
libtensorflow_framework.so
#4  0x00007fff4e2ecc80 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
#5  0x00007ffff7bc16ba in start_thread (arg=0x7ffe06ffd700)
at pthread_create.c:333
#6  0x00007ffff71e73dd in clone ()
at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
Include any logs or source code that would be helpful to diagnose the problem. If including tracebacks, please include the full traceback. Large logs and files should be attached. Try to provide a reproducible test case that is the bare minimum necessary to generate the problem.

@rmlarsen @benoitsteiner Can you take a look at this one?

Nagging Awaiting TensorFlower: It has been 14 days with no activity and the awaiting tensorflower label was assigned. Please update the label and/or status accordingly.

Nagging Awaiting TensorFlower: It has been 14 days with no activity and the awaiting tensorflower label was assigned. Please update the label and/or status accordingly.

@coolchicha any progress on this? I'm having a similar problem trying to compile a graph using tfcompile.
GDB traceback is
Program received signal SIGSEGV, Segmentation fault.
0x0000000000425bed in void Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long long>, 1ul> const, Eigen::TensorReshapingOp<Eigen::DSizes<long long, 2> const, Eigen::TensorImagePatchOp<-1l, -1l, Eigen::TensorMap<Eigen::Tensor<float const, 4, 1, long>, 16, Eigen::MakePointer> const> const> const, Eigen::TensorReshapingOp<Eigen::DSizes<long long, 2> const, Eigen::TensorMap<Eigen::Tensor<float const, 4, 1, long>, 16, Eigen::MakePointer> const> const> const, Eigen::ThreadPoolDevice>::evalProduct<true, true, false, 0>(float*) const ()
(gdb) bt
#0  0x0000000000425bed in void Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long long>, 1ul> const, Eigen::TensorReshapingOp<Eigen::DSizes<long long, 2> const, Eigen::TensorImagePatchOp<-1l, -1l, Eigen::TensorMap<Eigen::Tensor<float const, 4, 1, long>, 16, Eigen::MakePointer> const> const> const, Eigen::TensorReshapingOp<Eigen::DSizes<long long, 2> const, Eigen::TensorMap<Eigen::Tensor<float const, 4, 1, long>, 16, Eigen::MakePointer> const> const> const, Eigen::ThreadPoolDevice>::evalProduct<true, true, false, 0>(float*) const ()
#1  0x0000000000431465 in void tensorflow::xla::EigenConvF32Impl<Eigen::ThreadPoolDevice>(Eigen::ThreadPoolDevice const&, float*, float*, float*, long long, long long, long long, long long, long long, long long, long long, long long, long long, long long, long long, long long, long long, long long, long long, long long, long long, long long, long long, long long) ()
#2  0x0000000000403972 in __tensorflow_compiler_aot_tests_mnist_x86__convolutional_mnist ()
#3  0x000000000000001c in ?? ()
#4  0x0000000000000001 in ?? ()
#5  0x0000000000000003 in ?? ()
#6  0x0000000000000003 in ?? ()
#7  0x0000000000000001 in ?? ()
#8  0x0000000000000020 in ?? ()
#9  0x000000000000001a in ?? ()
#10 0x000000000000001a in ?? ()
#11 0x0000000000000001 in ?? ()
#12 0x0000000000000001 in ?? ()
#13 0x0000000000000000 in ?? ()
(gdb) quit

Nagging Awaiting TensorFlower: It has been 14 days with no activity and the awaiting tensorflower label was assigned. Please update the label and/or status accordingly.

Nagging Assignee @rohan100jain: It has been 14 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @rohan100jain: It has been 85 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @rohan100jain: It has been 100 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @rohan100jain: It has been 115 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @rohan100jain: It has been 130 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @rohan100jain: It has been 145 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @rohan100jain: It has been 160 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @rohan100jain: It has been 175 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @rohan100jain: It has been 190 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @rohan100jain: It has been 205 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @rohan100jain: It has been 220 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

is this problem still occuring?

i hit this problem while saved_model running online for predicting for some days. caused core dump. how to resolve it . any idea?

It has been 14 days with no activity and the awaiting response label was assigned. Is this still an issue?

Nagging Assignee @rmlarsen: It has been 14 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Please check with the latest version of TensorFlow. Feel free to reopen if the issues still persists.

is this problem still occuring?

Hi, Yes The problem persist till now.
when i try to execute bellow line in python 3.5, and my feature vector is 450x512, the error occured.
Error: "segmentation fault (core dumped)"
sim_mat = np.matmul(query_feats, np.transpose(gallery_feats))
any idea?


Add zero-shot-classification forte wrapper

This PR fixes #32 .
Description of changes
Added zero-shot-classification forte wrapper.
Test Conducted
TestZeroShotClassifier tests the model with a specified input and compares the output scores.

btw, let's update the README and docs (https://github.com/asyml/forte-wrappers/blob/main/docs/wrappers.rst)

The pipeline is broken because of a spacy release. I have fixed that in main. Can you update the branch?


python-six dependency

Describe the bug
Am I right that python-six dependency could be removed?

It is used in _basefakesocket.py.

@pgajdos is that an issue?

Well depends on how you look at it. You do not seem to support python 2 anymore and  Six is a Python 2 and 3 compatibility library.  From that one could deduce that six is not needed anymore.

Please note that six is still also used in https://github.com/cunla/fakeredis-py/blob/master/fakeredis/_fakesocket.py#L10


Typescript support

It would be nice to add a d.ts file to support Typescript out of the box.
Here's the d.ts file I created:
declare module 'enter-view' {
    export interface EnterViewArgs {
        selector: NodeListOf<Element> | Element | string;
        enter?: (el: Element) => void;
        exit?: (el: Element) => void;
        progress?: (el: Element, progress: number) => void;
        offset?: number;
        once?: boolean;
    }

    const enterView: (args: EnterViewArgs) => void;
    export default enterView;
}

For anyone stumbling on this post if this doesn't make it into the package;
just add the above to your custom typings folder in a file called enter-view.d.ts and you are good to go.

submit a PR please!


How to start the command correctly：whisper_online_server.py

The first terminal run：python3 whisper_online_server.py  --host <IP_ADDRESS>   --port 8891  --warmup-file   2023专八听力考场版音频_16kHz.wav
output：
INFO	Loading Whisper large-v2 model for auto...
INFO	done. It took 3.59 seconds.
INFO	Whisper is warmed up.
INFO	Listening on('<IP_ADDRESS>', 8891)
INFO	Connected to client on ('<IP_ADDRESS>', 34710)

Another terminal run：arecord -f S16_LE -c1 -r 16000 -t raw -D default | nc <IP_ADDRESS> 8891
output：
xcb_connection_has_error() 返回真
xcb_connection_has_error() 返回真
正在录音 原始資料 'stdin' : Signed 16 bit Little Endian, 频率16000Hz， Mono

How can I use my local browser's microphone to upload to the server for real-time transcription?
I asked GPT4 and it prepared a web code intent to collect my microphone data and upload it to <IP_ADDRESS>:8891. I'm wondering if I already have this job and it's superfluous

create a client for A TCP server


NavigationDecision.prevent Not works on ios

Is there an existing issue for this?

[X] I have searched the existing issues
[X] I have read the guide to filing a bug

Steps to reproduce
Can you give any suggestion to solve this problem.
Expected results
How to solve this issue in ios .
Actual results
after login using webview_flutter's webview i'll check it current url contains my redirect url then it matches i'll pop my page , but this flows worked in android perfectly , but  in ios after checking result url with my redirect url, and this condition was true and NavigationDecision.prevent after this it directly goes to onWebResourceError (Error), fields , this fields contains "Frame load interupted " error , how to solve this issue.
Code sample
Code sample
[Paste your code here]

navigationDelegate: (navigation) async {
if (navigation.url.toString().contains(AppConstant.redirectUrl)) {
return NavigationDecision.prevent;
}
return NavigationDecision.navigate;
},
onPageFinished: (url) {
if (url.contains(AppConstant.redirectUrl)) {
final uri = Uri.parse(url);
final String code = uri.queryParameters['code'] ?? '';
Navigator.pop(context, [code, codeVerifier]);
}
},
onWebResourceError: (error) {
_webViewController!.clearCache();
},
javascriptMode: JavascriptMode.unrestricted,
initialUrl: authorizeurl,
));

Screenshots or Video

Screenshots / Video demonstration
[Upload media here]

Logs
Logs
[Paste your logs here]

Flutter Doctor output
Doctor output
[Paste your output here]

'Frame load interupted'

@santhoshkumar4035
Check this solution and this implementation which should help to resolve your issue.
Closing for now. Also, your issue is more of how to implementation rather than a bug which indicates it as a support question so you can raise it in StackOverflow.


Demutation needs tracking of pointer aliasing

We have the following problem with demutation:
function f!(a,b)
  mutate!(a)
end

In this case, if the mutation on a really does mutate the content behind pointers, then to demutate f to
function f(a,b)
  a = mutate(a)
  a
end

requires that a and b do not point to the same memory cells somewhere inside, ie. are not aliased.
In order to enforce this, we would need to track such aliasing or alternatively make sure that it never occurs, e.g. by having  linear types.
Currently this is out of scope.

We opt for the "only affine/linear usage of mutated variables" solution.
This means that the following is allowed:
a = something
f!(a)
g!(a)
h!(a)

While this is not:
a = something
f!(a,a)

With this, for
julia> typecheck_hs_from_string_detailed("function test(x)
         function f(a,b,c)
           norm_convert(a)
           norm_convert(b)
           c
         end
         f(x,x,x)
       end
       ")

we get
Encountered error: While demutating, the following error was encountered:
 The function 'Just f' is called with the following vars in mutating positions:
[(x,2)]
But it is not allowed to have the same variable occur multiple times
()

which is good.

The problem is that
function test(x)
  function f(a,c)
    norm_convert(a)
    c
  end
  f(x,x)
end

is allowed. It is not clear how we should deal with non-mutating argument positions. If one variable occurs mutating, then it is not allowed to occur in all other arguments. But the problem is that this might not be clear in case of non-mutating arguments. Because here the variable might be hidden behind let bindings.
That is, is something like
function test(x)
  function f(a,c)
    norm_convert(a)
    c
  end
  let y = x
  f(x,y)
end

allowed in all cases?

In #158 we disallow cases like the above, where variables are renamed.
Furthermore, we claim that it is not possible to create aliased names statements of the form y = t (...) where t (...) is a non-trivial term.

Currently, we do not track pointer aliasing, instead we do something similar to rust and have move semantics for assignments, which makes it possible to disallow situations where aliasing happens.
This is done in #171.


Use semantic release for release management

introduction
Current Implementation
Just add plugin in maven and use it your commits
howtouse
Suggested Enhancement

release management based on your commits

Hi Jens, thank you for your input! Currently we do use semantic versioning, as you can see here: https://github.com/corona-warn-app/cwa-server/releases.


Interacting with tags on Contentful entries

There doesn’t seem to be a way to extract the tags on an entry, only fields of the content model can be accessed. It would be important to be able to list the tags assigned to an entry, and also to be able to add/remove tags on entries.
Ideally, it would be possible to check if a specific tag is assigned to an entry in a decision, but I imagine this is currently not possible, since arrays don't support the contains operator yet… Alternatively, I would have to loop over all the tags and compare each name with the tag I want to check. This is acceptable as well, for now.

Here's some more context for my use case regarding tags. I have a bird that is triggered every time an entry is published in Contentful and creates a project in XTRF. Now, I don't want this bird to create projects for every little change an author makes and publishes in Contentful.
Ideally, I would like a tag, something like Translate on publish. The bird could then check if that tag is assigned, and only proceed with project creation if so.
Currently, this is not possible, so I am using a custom field on the content model instead. This works, but has severe disadvantages:

this requires the customer to change all of their content models to fit our workflow
the field needs to be set to false after the bird runs – this can be done from the bird, but it sets the status to changed, which means we also need to republish the entry from the bird

Using tags instead would solve both problems and make the workflow quite flexible.


Android 7.0+ linking to private platform libraries

After we got our ASUS Zenfone AR we recognized, that warnings were generated caused by the changes to the access of private ndk libraries in future android releases.

Not only our own application is triggering this warning also every example project. Beside this annoying dialog, we want that our application runs also with future android releases.
The guide provided here:
https://developer.android.com/about/versions/nougat/android-7.0-changes.html#ndk
was not very helpful.
"You should update your app to include its own copy of those libraries " - from my unexperienced perspective i don't know how to get a copy of those libraries. Additionally i should say that we use cmake as a build tool, but like said, the warning dialog appears also with the examples which are build with ndk-build tool.
Maybe anyone knows how to get this working, cause other tango applications from the store don't trigger this dialog.

I have the exact same problem. Getting the logcat warnings is OK for now (until the tango libraries are made properly Android N compatible), but how can I prevent the annoying dialog box?

It seems like the popup disappears when compiling in Release mode.

Okay can you provide more information if your are using cmake or ndk-build? And where you defined this release mode? (Android Studio, Gradle) Cause i also set the CMAKE_BUILD_TYPE on 'Release' and nothing changed.
Additionally i was able to create a workaround based on a stackoverflow response.
https://stackoverflow.com/questions/46112418/tango-api-linking-against-private-native-libraries-api24/46181422#46181422
But it is more a dirty hack then a good solution, i copied the prebuilt shared private native libs via ADB from my ASUS (located in system/lib and system/lib64) and included them into my APK.

I also use cmake, I set release mode through Android Studio. My build.gradle targets API 23 like this:
defaultConfig {
        minSdkVersion 21
        targetSdkVersion 23
}

It might be the signed APK that is important here, as you say, not the compiling in Release mode.
I have not made any efforts trying to support API level 24+, I am hoping a future release of libtango_client_api.so will be made properly Android N compatible.


Disable unicorn/prevent-abbreviations for imports

By default (value internal), this rule reports/renames imports from internal modules.
// checkDefaultAndNamespaceImports
import * as err from './err';
import err from '/err';

// checkShorthandImports
import { prop } from './foo';

However, it will report the same issue where this is exported, where it should be fixed instead.
If there is a case where I want to keep using the abbreviated version for some reason, I can ignore the place where I export it.
But now I would also have to ignore it everywhere it's imported.
I suggest to disable this rule for imports, since it's redundant.
"unicorn/prevent-abbreviations": ["error", { checkDefaultAndNamespaceImports : false, checkShorthandImports: false }],

it will report the same issue where this is exported, where it should be fixed instead.

I agree with this, if you look at imports and exports as a consumer - provider relationship, then it makes sense that the provider (the exporting module) is responsible for amending the linting issue, not the consumer (the importing module).


Mu 23

Please, review this PR.

Looks good but pipeline is failing, locators and timeouts seems to be the issue, please take a look at that.

Please, Review it  I had problems with the playwright's new version and the change of locators.

Because some locators and functionality were chanched In Trello


Locals replays have incorrect metadata

Most of my local replays have this problem.

Can you attach such a replay plz?

5240193-JaggedAppliance.zip


Exporing MajorShardingType, ShardingType and LayerNorm for TE/JAX.

Exporing a new module, LayerNorm.
Exporting two Enums, MajorShardingType, ShardingType

MajorShardingType and ShardingType are used to indicate sharding patterns in TE/JAX's module, such as DenseGeneral, LayerNormDenseGeneral and LayerNormMLP. In case that users construct their own models via those modules, instead of TransformerLayer, they would need these two enum classes to enable multi-devices training. Refer here for details.

/te_ci

Merge this changes to #87 and close this.


Utilla bugs my arms

I am on steam vr, I use a htc vive pro 2. Why are my arms stuck in one place?

Certain mod menus get blocked by the devs, locking your arms in place, so don't blame utilla.
 Also just delete your illegal mods.

the funny thing is that this mod is basically for making illegal mods legal by letting you use them in modded lobbys. its like if they blocked like every legal mod


M3-2100 Fix clickable rows

Recreates Kayla's earlier PR, since I botched that feature branch.

Coverage decreased (-0.01%) to 33.336% when pulling 404311fdb5aa818f50803a42012ef551066763a0 on Jskobos:M3-2100 into 0d64de6d093656718d8d5b9fcd2b3c727891f722 on linode:feature/linode-row.


Added example of how to use web3

Abstracted away from ethereum so that all web3 functionality should be
within a single file (ethereum.rs).
In this simple example, all the accounts from the source chain are
printed to std out.
Error handling should definitely be improved.
There are no unit tests yet, as there is no meaningful functionality
yet. It is important that testing is done well once concrete use cases
get implemented and that we do not need to make actual calls to an
ethereum test net in order to run the mosaic tests.

Remember to delete accounts, now called Address


[WIP] fix(controller): Abort select call after 5 seconds

Without a timeout, the select call can possibly wait for an arbitrary
length of time. This helps detect these stalls (as reported in #939)
EDIT: Don't merge yet, I just noticed that a five second period without any event can also occur normally

Closing this, as we can't expect regular events from the event loop. I'll open a new PR with only the refactor commit


DuckDB 0.10.0 release uses ADBC version 0.7

According to the release notes for DuckDB 0.10.0, the ADBC driver has been updated to version 0.7. The ADBC documentation docs/api/adbc.md hasn't been updated to reflect this ADBC version bump, and still references ADBC 0.5.1.
This PR includes:

Statement that DuckDB 0.10.0 now uses ADBC version 0.7.0
Updated link to ADBC version 0.7.0 documentation

Thanks!


175171411 — Prep 4 Changes to default Scope

Changes

increases test coverage for User scopes.
Notes added to user.rb, scopes reorganized
In Rails 4.1 we are going to have to adjust the User scopes to unscope default_scope

More info:
https://guides.rubyonrails.org/upgrading_ruby_on_rails.html#changes-on-default-scopes
[#175171411]
https://www.pivotaltracker.com/story/show/175171411

@dougmartin
The idea here was just to add some spec tests. This PR is from Rails 4 -- we don't really need to merge it here, I just want to run the CI test with no changes to the User model to establish a baseline, then add these changes to a new Rails 4.1 branch, and lookout for failures.
Perhaps this PR should just be put in 'draft' mode.

Tests are all green, so I am going to close this one (it was just a test)


Superseded: Use cells in controllers

Superseded
By https://github.com/web3well/bls-wallet/pull/243. Those changes started from here, but they have now changed so much that there's really no benefit in reviewing this intermediary state.
(Keeping it here as a point of reference for now.)
What is this PR doing?
Uses cells for persistence.
This means a lot of cleanup. A lot of manual synchronization mess is gone. There's more to go though - this PR is attempting to translate the old messy logic into the cells API in a fairly direct way.
There's a few nice changes that are observable in the extension:

When you click 'confirm secret phrase' during onboarding the button enters a loading state until its action (setting up the wallet) is completed, followed by the navigation
When you click 'Add Wallet' the button enters a loading state as above, and when adding is complete the page no longer reloads, but the new wallet is displayed correctly
If you have another instance of the quillPage open, a new wallet will appear automatically when added by the other instance
Selected address is now in sync with the actual underlying state and syncs between open windows as above

How can these changes be manually tested?
Run the extension, observe the points above and make sure things generally work as expected.
Does this PR resolve or contribute to any issues?
Resolves #225, #226, #227
Checklist

[x] I have manually tested these changes
[x] Post a link to the PR in the group chat

Guidelines

If your PR is not ready, mark it as a draft
The resolve conversation button is for reviewers, not authors

(But add a 'done' comment or similar)

Superseded: https://github.com/web3well/bls-wallet/pull/243


HTTP response codes are not checked

Excluding status codes handled automatically by the reqwest crate, HTTP status code are not checked by CPM. Most importantly, this includes 4xx error responses like 404 Not Found. Whatever data the server sends in the response body is still saved to disk.
The location where the response status needs to be checked is here: https://github.com/pyocd/cmsis-pack-manager/blob/7afc42405da2da525c756b1b5f23be478575ca9c/rust/cmsis-pack/src/update/download.rs#L156

Should we close this after #199 was merged?


Vendor code not in remote repository

it is possible to push golang dependencies code into remote repository (like [1]).
My remote repository doesn't contains code [2], but beats project seems to push dependencies code [3].
How to do this ?
[1] : https://github.com/elastic/beats
[2] : https://github.com/nlamirault/abraracourcix/tree/master/vendor/github.com/garyburd
[3] : https://github.com/elastic/beats/tree/master/vendor/github.com/garyburd/redigo
Hi:
I find your issue for glide.I don't know how to do.
Can you tell me the way to solve it?

I use a recent version of glide, and i'm using 3 options to vendoring code :
$ glide -v
glide version 0.10.0
$ glide up -u -s -v

Thank you very very very much.


 Main issue is the landing page where there are many images

We've noticed that when fresh loading the site, there it takes a large time. This period is know as the first paint and is usually an inherent issue with server sided rendering frameworks like SvelteKit and React. Explore ways into how to improve this paint load.
*Note: Use of Googles Performance in the Debugger and Google Lighthouse are not bad resources.


[Bug]: Optional chaining throwing an error during build

Steps to reproduce
My Next.js build is failing on a syntax error through a function called in next.config.js.
Here are the logs:
10:30:56 AM: ❯ Loading plugins
10:30:56 AM:    -<EMAIL_ADDRESS>from Netlify app
10:30:56 AM:
10:30:56 AM: ────────────────────────────────────────────────────────────────
10:30:56 AM:   1. @netlify/plugin-nextjs (onPreBuild event)
10:30:56 AM: ────────────────────────────────────────────────────────────────
10:30:56 AM:
10:30:56 AM: Using Next.js 12.0.4
10:30:56 AM: Warning: support for Next.js >=11.1.0 is experimental
10:30:57 AM: error - Failed to load next.config.js, see more info here https://nextjs.org/docs/messages/next-config-error
10:30:57 AM:
10:30:57 AM: ────────────────────────────────────────────────────────────────
10:30:57 AM:   Plugin "@netlify/plugin-nextjs" failed
10:30:57 AM: ────────────────────────────────────────────────────────────────
10:30:57 AM:
10:30:57 AM:   Error message
10:30:57 AM:   /opt/build/repo/node_modules/next-contentlayer/dist/index-cjs.cjs:23
10:30:57 AM:                   return nextConfig.redirects?.() ?? [];
10:30:57 AM:                                               ^
10:30:57 AM:
10:30:57 AM:   SyntaxError: Unexpected token '.'
10:30:57 AM:
10:30:57 AM:   Plugin details
10:30:57 AM:   Package:        @netlify/plugin-nextjs
10:30:57 AM:   Version:        3.9.2
10:30:57 AM:   Repository:     git+https://github.com/netlify/netlify-plugin-nextjs.git
10:30:57 AM:   npm link:       https://www.npmjs.com/package/@netlify/plugin-nextjs
10:30:57 AM:   Report issues:  https://github.com/netlify/netlify-plugin-nextjs/issues
10:30:57 AM:
10:30:57 AM:   Error location
10:30:57 AM:   In "onPreBuild" event in "@netlify/plugin-nextjs" from Netlify app

This build was using:

Node v14.18.2 which should support optional chaining
Yarn 3.1.1

This is next.config.js in question:
const { withContentlayer } = require("next-contentlayer");

module.exports = withContentlayer()({});

A link to a reproduction repository
https://github.com/contentlayerdev/website
Plugin version
3.9.2
More information about your build

[ ] I am building using the CLI
[X] I am building using file-based configuration (netlify.toml)

What OS are you using?
No response
Your netlify.toml file

`netlify.toml`
[build]
  command = "npm run build"
  publish = ".next"

Relevant log output (or link to your logs)

Build logs
https://app.netlify.com/sites/contentlayer/deploys/61b0cf160f8bf03b2428c574

Hey! Could you upgrade the build plugin to @netlify/plugin-nextjs@rc and see if that fixes it?


How to append own custom providers?

I would like to develop and test other proxy providers.
You mention:
You can write and append your own custom providers and pass it to the ProxyFetcher class as attribute.
Every custom proxy provider must implement the IProxyProvider base interface.
@dataclass
class TestProvider(IProxyProvider):
   def _get_raw_proxies(self,) -> List[Any]:
      # Do some stuff

   def raw_proxy_to_object(raw_proxy: Any) -> Proxy:
      # Do some stuff

I don't understand, how can I pass TestProvider to the ProxyFetcher class as attribute.
fetcher = ProxyFetcher( ??? TestProvider ??? )

right now, the _proxy_providers attribute is protected.
I will make it public and then you can just use it as a regular class attribute

aiohttp docs suggest to use loop.time() (which is also monotonic):
You can do something like this:
        proxy = Proxy(
            protocol=Protocols.HTTPS,
            ip='<IP_ADDRESS>',
            port='8080',
            country='',
            anonymity=Anonymities.UNKNOWN,
        )
        judge_protocol = Protocols.HTTPS if proxy.protocol == Protocols.HTTPS else Protocols.HTTP
        async with aiohttp.ClientSession(
            timeout=ClientTimeout(total=30),
            connector=ProxyConnector.from_url(str(proxy))
        ) as session:
            try:
                start = asyncio.get_event_loop().time()
                async with session.get(f"{judge_protocol}://httpheader.net/azenv.php", ssl=False) as response:
                    response_time = asyncio.get_event_loop().time() - start
                    print(f'Proxy: {proxy} is valid, response time: {response_time:.4f} sec')
            except Exception:
                print(f'Proxy: {proxy} is invalid')


Fix DNS manager console is missing for RSAT client in Windows 10

I tried to click the edit link to fix this doc and it lead me to this blank repo, so I thought i'd try and create an issue to fix it.
Url: https://docs.microsoft.com/en-us/troubleshoot/windows-client/system-management-components/rsat-client-missing-dns-server-tool#the-unattend_x64xml-file-contents
The installx64.bat file contents:
@echo off
md ex expand -f:* WindowsTH-RSAT_WS_1709-x64.msu ex\
cd ex
md ex
copy ..\unattend_x64.xml ex\
expand -f:* WindowsTH-KB2693643-x64.cab ex\
cd ex
dism /online /apply-unattend="unattend_x64.xml"
cd ..\
dism /online /Add-Package /PackagePath:"WindowsTH-KB2693643-x64.cab"
cd ..\
rmdir ex /s /q

Should be:
@echo off
md ex
expand -f:* WindowsTH-RSAT_WS_1709-x64.msu ex\
cd ex
md ex
copy ..\unattend_x64.xml ex\
expand -f:* WindowsTH-KB2693643-x64.cab ex\
cd ex
dism /online /apply-unattend="unattend_x64.xml"
cd ..\
dism /online /Add-Package /PackagePath:"WindowsTH-KB2693643-x64.cab"
cd ..\
rmdir ex /s /q

i.e. (missing linebreak after md ex)

Thank you for the feedback. We have fixed this issue.


ScrolledWindow widget & example + 01-example typos

ScrolledWindow widget works well. Defaults to automatic scrollbars.
Example shows use of a TextView inside a scrolled window.
Minor edits:
'_' -> '-' changes were made in the sub names but not in the comments.
Also, some examples still have routine_names, rather than routine-names, but these are defined in the examples, so it's a matter of taste for the example writer, rather than a standarisation for the module. So I did'nt change these.

Please add GTK::Simple::ScrollWindow to META6.json
Please see https://travis-ci.org/perl6/gtk-simple/jobs/157427149#L1152

Added the extra files.
My error in not git adding the files. :(


mb_strlen() expects parameter 1 to be string, array given (View: /home/xxx/vendor/tcg/voyager/resources/views/bread/browse.blade.php)

Version information

Laravel: v5.6.28
Voyager: v1.1.3
PHP: 7.1
Database: Maria DB 10.1

Description
Whenever I try to browse some BREAD items I get the following error:
mb_strlen() expects parameter 1 to be string, array given (View: /home/eatnaked/vendor/tcg/voyager/resources/views/bread/browse.blade.php)
This seems to be fairly common but mainly centred around users/settings/locale or something that is mentioned in other bugs but this doesn't appear to be the case here... I've added some tables in BREAD and when trying to view them the above error is what I get.
I should note I can browse users just fine.
Line 154:
<?php echo e(mb_strlen( $data->{$row->field} ) > 200 ? mb_substr($data->{$row->field}, 0, 200) . ' ...' : $data->{$row->field}); ?>

Can you find out which field is causing the error (unchecking browse-checkbox, one after another) and tell us which datatype it is?

@emptynick Yes, i've done a little more digging and it's dying on fields that are cast as an array.
e.g.
    protected $casts = [
        'field_name' => 'array',
    ];

field_name is stored in the database as json data.

Same issue as @gdbytes , cant work with arrays/json, seems declaring  arrays on casts doesnt works

I dont really know how we should display an array or JSON in the browse-view.
Any suggestions?

I think that first of all you could display it as a text value (without throwing exceptions) so we could actually use the field without having to edit it the db and hide it from voyager.
Would be nice to have a json editor there or something to auto generate and handle fields one day.

I have mentioned to display array as a string as temp fix, if the field is visible the app crashes, so would be at least something to be able to see the fields.
Re JSON, there's currently a view to handle json fields in the edit form?
To handle arrays you could also simply show values one per line like in a textarea
index:value
index:value
etc.
In my case, i just need to give the opportunity to the user to input in textarea where each line is an array value.

Hi,
I went ahead an I have wrote a FormFields type called "array_text_area".
If selected this FormFields, a textarea will be shown, array will be processed thru lines so each line is an array value.
Zip with the edits is attached, could someone commit this here as well?
textarray.zip
TODO
Next step is adding the parsing of "index:value" so it could work an array with indexes as well
Feedback is appreciated,
Thanks

Any fixes about this? Thanks.


Option to avoid sparse arrays when calling webpackJsonp

Problem:
Following the discussion from here and here.
It appears that when DedupePlugin is enabled and NamedModulesPlugin is disabled then webpack will use sparse arrays like so:
webpackJsonp([ 0, 4 ], [ , , , , , , , , function(module, exports, __webpack_require__) {

Instead of objects like so:
webpackJsonp([ 3, 11 ], {
    373: function(module, exports, __webpack_require__) {

The sparse arrays break IE8 (and below).
Tested with webpack 1.12.13.
Potential solutions:

Never use sparse arrays / make IE8 support the default
Add an option to avoid sparse arrays / support IE8 (akin to UglifyJS's screw_ie8 option)

Workarounds:

Disable DedupePlugin (it might not even be reducing the output size)
Enable NamedModulesPlugin

After some discussion we decided for the following statement regarding IE8:
We don't support IE8 in webpack 2. IE8 is not supported by Microsoft and doesn't get security fixes. We think it's no responsible to allow web developers to build webapps which support IE8. They must break!


Can I change the default headers?

I want to remove the user-agent from my request, but I can't find a way after I check the requests source code. Need help!

s = Session()
s.headers.pop('User-Agent')

Above code would help.


ddrescue: 1.22 -> 1.23

See https://lists.gnu.org/archive/html/info-gnu/2018-02/msg00004.html
for release information
Motivation for this change
Things done

[X] Tested using sandboxing (nix.useSandbox on NixOS, or option build-use-sandbox in nix.conf on non-NixOS)
Built on platform(s)

[X] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[X] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[X] Tested execution of all binary files (usually in ./result/bin/)
[X] Fits CONTRIBUTING.md.

Success on x86_64-linux (full log)
Partial log (click to expand)
/nix/store/0i8awhl2yh9v6pvdf0ya6k2icy3pzk5s-ddrescue-1.23

Success on aarch64-linux (full log)
Partial log (click to expand)
/nix/store/rff6i63094fqr2d9d81nhbgqwg9jl290-ddrescue-1.23


(WIP) [triggers] Add Trigger Evaluation Schedule Types

Adding new attributes to Triggers, it will include the following changes:

evaluation_schedule_type
evaluation_schedule

More information about scheduling can be found on our documentation:
https://docs.honeycomb.io/working-with-your-data/triggers/#configuration

I'm going to close this out until the resulting API is ready. Tracking as a feature request in #241


Adding PM's feedback

I'm updating this article as per Femila's request.

Hi @andredm7, I'm your friendly neighborhood Microsoft Pull Request Bot (You can call me MSBOT). Thanks for your contribution!

It looks like you're a Microsoft contributor (Andre Della Monica). If you're full-time, we DON'T require a Contribution License Agreement. If you are a vendor, please DO sign the electronic Contribution License Agreement. It will take 2 minutes and there's no faxing! https://cla.microsoft.com.

TTYL, MSBOT;

@andredm7 : Thanks for your contribution to the Azure documentation! The author, @asteen, has been notified to review your proposed change.

@ajlam Hi Adam. If the changes look good, please sign off. For more information, see
Pull request comment automation. Thanks.

Wrong user tagged. I think this was meant for @ajamess 😄

Thanks, Andrea, and sorry for the bother. @ajamess Adam, if the changes look good, please sign off. For more information, see
Pull request comment automation. Thanks.


Be more specific when event is not added to app

When an EventWriter (or presumably an EventReader) is requested for an event that was not added to the app, the application panics on launch, with a message like

Resource requested by [system path] does not exist: bevy ecs::event::Events<[event struct]>

Because the Bevy API distinguishes between resources and events, it would be clearer to specify that the event does not exist.

These are implemented through the derive macro:
#[derive(SystemParam)]
pub struct EventReader<'w, 's, E: Event> {
    reader: Local<'s, ManualEventReader<E>>,
    events: Res<'w, Events<E>>,
}

As a result, changing this error message would involve either a) passing some custom information to the derive macro or b) swapping to a manual implmentation.
Both of those incur some pretty serious code quality costs that I don't think I'm willing to pay here.


Input/output error

My drive has a bad block and certain files cause input output error, but I can't seem to exclude them. Why not make it continue past errors like that?

OSError: [Errno 5] Input/output error: "the file path here"


How to efficiently debug while developing my own models.

Hi, Thanks to your wonderful work on this framework!
I want to develop my own model according to my idea. Previously, I usually use IDE  like Pycharm（ where I could debug line by line） to help me find and fix bugs. But when using NeRFstudio，we use commands like "ns-train xxxxx"  instead of " python train.py".  I mean the entry is seems not from python scripts and do not use  python interpreter, How can I debug my own model?
Is there some ways to efficiently Debug ?

If you want to set breakpoints and investigate some tensors during the training process, consider using the "set trace" functionality from the python debugger https://docs.python.org/3/library/pdb.html. It can be a powerful tool if you learn how to use it. Good luck.

Hi,maturk. Thank you for your advice,   I am trying to find the python entrypoints of bash  comands like "ns-train",  then excute codes in a python way. Then I can debug using IDE . Could you please give your opinion this method?I am a fresh pythoner, so
am not sure whether it can work out.

If you want to set breakpoints and investigate some tensors during the training process, consider using the "set trace" functionality from the python debugger https://docs.python.org/3/library/pdb.html. It can be a powerful tool if you learn how to use it. Good luck.

Hi,maturk. Thanks for your advice, I am trying to find the python entrypoints of bash comands like "ns-train", then excute codes in a python way. Then I can debug using IDE . Could you please give your opinion this method?I am a fresh pythoner, so
am not sure whether it can work out and whose method is better.

If you want to set breakpoints and investigate some tensors during the training process, consider using the "set trace" functionality from the python debugger https://docs.python.org/3/library/pdb.html. It can be a powerful tool if you learn how to use it. Good luck.

Hi,maturk. Thanks for your advice, I am trying to find the python entrypoints of bash comands like "ns-train", then excute codes in a python way. Then I can debug using IDE . Could you please give your opinion this method?I am a fresh pythoner, so am not sure whether it can work out and whose method is better.

I am not too familiar with this, but nerfstudio uses tyro (https://github.com/brentyi/tyro) as a CLI tool which is used to execute the various python scripts with correct arguments. You can look for the keywords "tyro.cli(" inside scripts like train.py, render.py, etc. You can see that the authors even define "entrypoint()" functions there.  Debugging with a dedicated IDE tools might not work, but you can try out the pdb library to manually set your trace points.

If you want to set breakpoints and investigate some tensors during the training process, consider using the "set trace" functionality from the python debugger https://docs.python.org/3/library/pdb.html. It can be a powerful tool if you learn how to use it. Good luck.

Hi,maturk. Thanks for your advice, I am trying to find the python entrypoints of bash comands like "ns-train", then excute codes in a python way. Then I can debug using IDE . Could you please give your opinion this method?I am a fresh pythoner, so am not sure whether it can work out and whose method is better.

I am not too familiar with this, but nerfstudio uses tyro (https://github.com/brentyi/tyro) as a CLI tool which is used to execute the various python scripts with correct arguments. You can look for the keywords "tyro.cli(" inside scripts like train.py, render.py, etc. You can see that the authors even define "entrypoint()" functions there.  Debugging with a dedicated IDE tools might not work, but you can try out the pdb library to manually set your trace points.

Thank you so much for your detailed explianation.

If you want to set breakpoints and investigate some tensors during the training process, consider using the "set trace" functionality from the python debugger https://docs.python.org/3/library/pdb.html. It can be a powerful tool if you learn how to use it. Good luck.

Hi,maturk. Thanks for your advice, I am trying to find the python entrypoints of bash comands like "ns-train", then excute codes in a python way. Then I can debug using IDE . Could you please give your opinion this method?I am a fresh pythoner, so am not sure whether it can work out and whose method is better.

I am not too familiar with this, but nerfstudio uses tyro (https://github.com/brentyi/tyro) as a CLI tool which is used to execute the various python scripts with correct arguments. You can look for the keywords "tyro.cli(" inside scripts like train.py, render.py, etc. You can see that the authors even define "entrypoint()" functions there.  Debugging with a dedicated IDE tools might not work, but you can try out the pdb library to manually set your trace points.

Thank you so much for your detailed explianation. I will try it later.

train.py in nerfstudio/scripts/train.py is equivalent to ns-train. You can just replace everything ns-train with a call to that file.

train.py in nerfstudio/scripts/train.py is equivalent to ns-train. You can just replace everything ns-train with a call to that file.

thank you so much for your advice.

train.py in nerfstudio/scripts/train.py is equivalent to ns-train. You can just replace everything ns-train with a call to that file.

I successfully debugged locally. Additionally, do not install nerfstudio, otherwise "import nerfstudio" instruction will firstly find the installed package of "nerfstudio". Then I add system path of "xxx/nerfstudio/nerfstudio" to the python script and run "python train.py". It works at last.

Perhaps an easier way is to do the editable install pip install -e <path/to/local/nerfstudio/clone>.

hi @zParquet, did you debug it in an IDE?

Hi, thanks @zParquet. I'm not sure if my answer will be of value to everyone, as I also haven't fully understood how it was successful.

Edit the configuration in PyCharm: script: /path/to/nerfstudio/nerfstudio/scripts/train.py. script parameter:  nerfacto --data data/nerfstudio/poster
You might still be unable to run it successfully after setting it up, as it will report an error related to viser. I upgraded viser in the terminal: pip install --upgrade viser, and it reported an error: “ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behavior is the source of the following dependency conflicts. Nerfstudio 0.3.4 requires viser==0.1.3, but you have viser 0.1.13 which is incompatible. Successfully installed viser-0.1.13”.
The error doesn't matter(?), run the configuration again in PyCharm and it should go successful this time.

@anas-zafar yeah. I debugged it in pycharm and it worked normally.

Hi,
If you are going to debug nerfstudio models (NeRF, NeRFacto,..), remove "ns-train" and keep others. For example:
vanilla-nerf --vis viewer+wandb --data/.../


[WIP] feat: Add transition status based on websocket messages

Fix routes/api response error check
Fix Layout component notifications
Fix all pages fallback error tips

solve: #311


K8s prod requirements

Fixes #5459

For the memory adjustments, I documented the second workaround that was listed in the issue. I was able to execute the steps for both Helm and config, but wasn't sure how to verify that the new cache and SQL memory size values were actually in effect (the Admin UI doesn't appear to reflect these limits). Will possibly need a technical review. If we also want to describe the first workaround, I will need some more technical context on this.
For expanding the persistent volume claims, I was able to increase the disk sizes in production (GKE) even after manually setting allowVolumeExpansion to false. I documented the requirement to set this to true anyway, but could use clarity from an engineer on why that might have happened. Also, because I wasn't able to test this by changing the boolean, it's not clear to me whether the value has to be true before the pod is created, or only before the PVC is resized. The official k8s docs imply the former, but an OpenShift doc explicitly states that the pod has to have been created from a StorageClass where this value is true. I thought I should go with the first-party docs.

This change is

Online preview: http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/b4391fe0d24fde512f97e7597c878740fc83b37a/
Edited pages:

v19.1/orchestrate-cockroachdb-with-kubernetes.md
v19.2/orchestrate-cockroachdb-with-kubernetes.md

Online preview: http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/f7d1d6b9ec5f5fc22c5ab3adf02b1bb7cad1b04a/
Edited pages:

v19.1/orchestrate-cockroachdb-with-kubernetes.md
v19.2/orchestrate-cockroachdb-with-kubernetes.md

@bdarnell Would you be able to review the updates to the memory adjustments? Also see my initial comment on this.

Online preview: http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/5a9661ed746538dc229eab61aff6124a1d759ee8/
Edited pages:

v19.1/orchestrate-cockroachdb-with-kubernetes.md
v19.2/orchestrate-cockroachdb-with-kubernetes.md

Online preview: http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/1cd04e1a7d439071d38016c518d31406e0ce25fc/
Edited pages:

v19.1/orchestrate-cockroachdb-with-kubernetes.md
v19.2/orchestrate-cockroachdb-with-kubernetes.md

Online preview: http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/b5516deb676b41d79a01203b8fb25accc8489755/
Edited pages:

v19.1/orchestrate-cockroachdb-with-kubernetes.md
v19.2/orchestrate-cockroachdb-with-kubernetes.md

Online preview: http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/50c09f924f61259fc1f243b52a03e9ec3214a3fb/
Edited pages:

v19.1/orchestrate-cockroachdb-with-kubernetes.md
v19.2/orchestrate-cockroachdb-with-kubernetes.md

Online preview: http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/85c7c25bfa47ed1e8e969f2736cb5bca348b716e/
Edited pages:

v19.1/orchestrate-cockroachdb-with-kubernetes.md
v19.2/orchestrate-cockroachdb-with-kubernetes.md
v20.1/orchestrate-cockroachdb-with-kubernetes.md


Gh 1191 fix travis

Don't merge. Only opening pull request to find errors.

Codecov Report

Merging #1912 into develop will decrease coverage by 3.36%.
The diff coverage is n/a.

@@              Coverage Diff              @@
##             develop    #1912      +/-   ##
=============================================
- Coverage      65.56%   62.19%   -3.37%
+ Complexity      2171     1491     -680
=============================================
  Files            861      423     -438
  Lines          28309    14184   -14125
  Branches        3589     1853    -1736
=============================================
- Hits           18560     8822    -9738
+ Misses          8292     4577    -3715
+ Partials        1457      785     -672

Impacted Files
Coverage Δ
Complexity Δ

...cardinality/serialisation/HllSketchSerialiser.java

...affer/rest/service/v1/example/ExamplesService.java

...ava/uk/gov/gchq/gaffer/rest/JaxRsErrorFactory.java

...er/accumulostore/utils/IteratorOptionsBuilder.java

...apstore/operation/CountAllElementsDefaultView.java

...chq/gaffer/parquetstore/SingleUseParquetStore.java

...ation/handler/FederatedOperationOutputHandler.java

...er/accumulostore/key/AccumuloRuntimeException.java

...n/java/uk/gov/gchq/gaffer/cache/impl/JcsCache.java

...ulostore/operation/handler/AddElementsHandler.java

... and 429 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d6040f9...b6ffaef. Read the comment docs.

Testing fix

Closing while tidying up


Typo - Statup.cs to Startup.cs

Hi @jwidmer, I'm your friendly neighborhood .NET Foundation Pull Request Bot (You can call me DNFBOT). Thanks for your contribution!

This seems like a small (but important) contribution, so no Contribution License Agreement is required at this point. Real humans will now evaluate your PR.

TTYL, DNFBOT;

:shipit:

Thanks for PR! Merged in 00e0d2ffe8dccbcff925ee1e602bac6ec1df4ac0


Window Resize Re-render

Included a small piece of code that simply refreshes the current step when the screen is resized. This modification is in reference to issue #57.

Thanks for this @lleblanc42, looks good.  Will take a proper look and get it merged in over the weekend.


Keep the top layer node at the top

It is better to keep the top layer nodes always on top as sometimes they are automatically shown in the second or third layer.

The manual positioning of the top layer nodes causes some paths to appear as they are linked to the wrong nodes.


autocompletion is calling /metadata instead of /labels and /series

Hello,
I'm trying to use the autocomplete feature, this is how I'm setting up my promQL extention:
const promQL = new PromQLExtension().setComplete({             remote: {                 apiPrefix: '/v1/prom',                 httpMethod: 'GET'             }         });
From the Readme file, it's saying by default it is calling /api/v1/labels and /api/v1/series. But i don't see these calls being triggered, I'm only seeing /v1/prom/metadata being triggered.
Reason why I can't use the metadata endpoint being, it is sending back all of the metrics from all of the instances, and I'm not able to pass in a query to the metadata endpoint. On the other hand, labels and metrics allow me to send in a query so i can setup a proxy and send in a query to filter the response by instances.
So is there a way i can set the autocomplete feature to make GET requests to the labels and the series endpoints instead of the metadata endpoint?

Hello @stenwolf
Hopefully changing the HTTP Method used shouldn't change or block the queries going to /v1/prom/labels and to /v1/prom/series and it is the regular behaviour that the autocompletion feature is asking to these two endpoints to get the required info.
The usage of the metadata endpoint is here to display the metrics helper during the autocompletion. But it's only happening if there is not too much metadata to get.
Do you have some errors in the browser console ?
Which version of codemirror-promql are you using ? With which version of codemirror ?
Is it possible to see how did you integrate codemirror-promql ?
I look at the code and I didn't find why the code would have the behaviour your are describing. I'm not saying there is no issue, I'm just saying that so far I don't explain or understand how to code is doing what you are experimenting.

Hi, I don't see any related error in console, the only one is 404 for the /v1/prom/metadata, it's because i dont want to expose this endpoint. Speaking of that, is there a way for me to specify i don't want metadata endpoint to be called? If not I guess i can create a proxy endpoint and just returns nothing.
For the versions, im using "codemirror-promql": "0.19.0", and these are the versions im using for codemirror
    "@codemirror/autocomplete": "0.19.14",
    "@codemirror/basic-setup": "0.19.1",
    "@codemirror/highlight": "0.19.7",
    "@codemirror/language": "0.19.8",
    "@codemirror/lint": "0.19.6",
    "@codemirror/state": "0.19.9",
    "@codemirror/view": "0.19.47",

this is how I set up my codemirror-promql
        const promQL = new PromQLExtension().setComplete({
            remote: {
                apiPrefix: '/v1/tsdb',
                httpMethod: 'GET',
            },
        });

        const defaultExtentions = [
            enterKey(),
            basicSetup,
            promQL.asExtension(),
            EditorView.updateListener.of(editorViewUpdateListener),
        ];

        editorView = new EditorView({
                state: EditorState.create({
                    extensions: [
                        ...defaultExtentions,
                        ...themeOptions[currentTheme.value],
                    ],
                }),
                parent: document.getElementById(editorID.value),
            });

Hi, I don't see any related error in console, the only one is 404 for the /v1/prom/metadata, it's because i dont want to expose this metadata endpoint. Speaking of that, is there a way for me to specify i don't want metadata endpoint to be called? If not I guess i can create a proxy endpoint and just returns nothing.
For the versions, im using "codemirror-promql": "0.19.0", and these are the versions im using for codemirror
    "@codemirror/autocomplete": "0.19.14",
    "@codemirror/basic-setup": "0.19.1",
    "@codemirror/highlight": "0.19.7",
    "@codemirror/language": "0.19.8",
    "@codemirror/lint": "0.19.6",
    "@codemirror/state": "0.19.9",
    "@codemirror/view": "0.19.47",
    "codemirror-promql": "0.19.0",

this is how I set up my codemirror-promql
        const promQL = new PromQLExtension().setComplete({
            remote: {
                apiPrefix: '/v1/prom',
                httpMethod: 'GET',
            },
        });

        const defaultExtentions = [
            enterKey(),
            basicSetup,
            promQL.asExtension(),
            EditorView.updateListener.of(editorViewUpdateListener),
        ];

        editorView = new EditorView({
            state: EditorState.create({
                extensions: [
                    ...defaultExtentions,
                    ...themeOptions[currentTheme.value],
                ],
            }),
            parent: document.getElementById(editorID.value)
        });

Thanks for details provided.
I tried to reproduce the issue and so far I didn't success :(.
Here what I have:

index.html

<!DOCTYPE html>

    <meta charset="UTF-8">
    <title>PromQL</title>

index.ts

import {PromQLExtension} from "codemirror-promql";
import {EditorView} from "@codemirror/view";
import {EditorState} from "@codemirror/state";
import {basicSetup} from "@codemirror/basic-setup";

const promQL = new PromQLExtension().setComplete({
    remote: {
        apiPrefix: '/v1/prom',
        httpMethod: 'GET',
    },
});

new EditorView({
    state: EditorState.create({
        extensions: [basicSetup, promQL.asExtension()],
        doc: '',
    }),
    // eslint-disable-next-line @typescript-eslint/no-non-null-assertion
    parent: document.querySelector('#editor')!,
});

package.json

{
  "name": "cmp-investigation",
  "version": "1.0.0",
  "description": "",
  "scripts": {
    "start": "webpack serve --config webpack.dev.ts",
    "test": "echo \"Error: no test specified\" && exit 1"
  },
  "author": "",
  "license": "ISC",
  "dependencies": {
    "@codemirror/autocomplete": "0.19.14",
    "@codemirror/basic-setup": "0.19.1",
    "@codemirror/highlight": "0.19.7",
    "@codemirror/language": "0.19.8",
    "@codemirror/lint": "0.19.6",
    "@codemirror/state": "0.19.9",
    "@codemirror/view": "0.19.47",
    "codemirror-promql": "0.19.0"
  },
  "devDependencies": {
    "html-webpack-plugin": "^5.5.0",
    "webpack": "^5.70.0",
    "webpack-cli": "^4.9.2",
    "webpack-dev-server": "^4.7.4",
    "ts-loader": "^9.2.8",
    "ts-node": "^10.7.0",
    "typescript": "^4.6.2"
  }
}

webpack.dev.ts

import path from 'path';
import { Configuration } from 'webpack';
import { Configuration as DevServerConfig } from 'webpack-dev-server';
import HtmlWebpackPlugin from "html-webpack-plugin";

declare module 'webpack' {
    interface Configuration {
        devServer?: DevServerConfig | undefined;
    }
}

const config: Configuration = {
    mode: "development",
    entry: path.resolve(__dirname, './src/index.ts'),
    plugins: [
        new HtmlWebpackPlugin({
            template: path.resolve(__dirname, './src/index.html'),
            templateParameters: {},
        }),
    ],
    module: {
        rules: [
            {
                test: /\.tsx?$/,
                loader: 'ts-loader',
                exclude: /node_modules/,
            },
        ],
    },
    resolve: {
        extensions: ['.tsx', '.ts', '.js'],
    },
    devServer: {
        allowedHosts: 'all',
        proxy: {
            '/v1/prom': {
                target: 'https://prometheus.demo.do.prometheus.io',
                pathRewrite: {'^/v1/prom':'/api/v1'},
                changeOrigin: true
            }
        }
    }
}

export default config;

And so far I can see the request going to the series and labels endpoint

To deactivate the query going to the endpoint /api/v1/metadata, you can simply set the parameter maxMetricsMetadata to 0 :
const promQL = new PromQLExtension().setComplete({
    maxMetricsMetadata: 0,
    remote: {
        apiPrefix: '/v1/prom',
        httpMethod: 'GET',
    },
});

Thank you, I see it is calling the /label endpoint, I thought it was calling /labels. So I was searching for labels and didn't see anything popping up. I still don't see the /series endpoint being called though. After I set this property from your snippet above maxMetricsMetadata: 0, I'm still seeing /metadata being called.

Could this be the reason why /series endpoint is not being called? Because /metadata is returning a 404?

the autocompletion is calling the different endpoints when it is required and it depends of the context (i.e. of where you are in the PromQL expression). So it can be normal the endpoint /series is not called.
To see the endpoint /series called, you can try something like that <insert_a_metric_name>{<start_typing a label>}, like I  am showing in my example.

it is also the same notes for the endpoint /labels that is indeed called under a certain context. It is basically called with this kind of expression:
sum by().
Other all, to know if your autocompletion is working fine, you should see the list of the metrics proposed, labels or label value depending of the context.

Ah I see it, thank you very much! It is indeed working as intended. Last thing I wanted to ask is the /metadata endpoint, as I'm still seeing it's being called even with maxMetricsMetadata: 0, would you mind whenever you have a chance to verify it on your side if it is working correctly please?
This is what I have to setup the promQL extension
        const promQL = new PromQLExtension().setComplete({
            maxMetricsMetadata: 0,
            remote: {
                lookbackInterval: 12 * 60 * 60 * 1000 * 1000, // TODO: 12000 hours, change this
                apiPrefix: '/v1/tsdb',
                httpMethod: 'GET',
            },
        });

Ah I see it, thank you very much! It is indeed working as intended.
Last thing I wanted to ask is the /metadata endpoint, as I'm still seeing it's being called even with maxMetricsMetadata: 0, would you mind whenever you have a chance to verify it on your side if it is working correctly please?
This is what I have to setup the promQL extension
        const promQL = new PromQLExtension().setComplete({
            maxMetricsMetadata: 0,
            remote: {
                lookbackInterval: 12 * 60 * 60 * 1000 * 1000, // TODO: 12000 hours, change this
                apiPrefix: '/v1/prom',
                httpMethod: 'GET',
            },
        });

Actually nevermind, I rebuilt my workspace and all is working now, thank you so much for the help!


ModelSelect2 deselect opens choices

When you deselect an item is it expected to open the choices?  It is a bit of an unexpected behavior if this is how it is suppose to work.  Is there a way to just deselect an item without the list of choices opening?

same for me, perhaps open is triggered by click ?

This is the default Select2 behavior. That being said, Select2 is not opinionated and can change the default behavior.
So, you have two options here:

(And dirty) Override the event triggered on click on that element
In https://select2.org/configuration/options-api you can find how to override SelectionAdapter (in this case MultipleSelectionAdapter) and do your own customisation in there.  (Maybe you need to look at the ResultsAdapter in that same page as well).


Ignore non CRD files in directories used in --local-crds

What happened?
I ran into an issue recently, when the --local-crds directory contains non CRD files.
kubectl-validate --local-crds ./test/ ./test/
Error: no kind "PodDisruptionBudget" is registered for version "policy/v1" in scheme "pkg/runtime/scheme.go:100"

What did you expect to happen?
Non CRD file shout have been ignored and k8s manifest been validated
How can we reproduce it (as minimally and precisely as possible)?
Just place your resource manifests and CRDs in the same directory.
For example place a crd and a pdb in the same directory "test":
---
apiVersion: apiextensions.k8s.io/v1
kind: CustomResourceDefinition
metadata:
  name: kialis.kiali.io
spec:
  group: kiali.io
  names:
    kind: Kiali
    listKind: KialiList
    plural: kialis
    singular: kiali
  scope: Namespaced
  versions:
  - name: v1alpha1
    served: true
    storage: true
    subresources:
      status: {}
    schema:
      openAPIV3Schema:
        type: object
        x-kubernetes-preserve-unknown-fields: true

---
apiVersion: policy/v1
kind: PodDisruptionBudget
metadata:
  name: postgres
  namespace: visual-regression-tracker
spec:
  minAvailable: 1
  selector:
    matchLabels:
      application: spilo
      cluster-name: vrt-postgres-db
      spilo-role: replica

Run kubectl-validate:
kubectl-validate --local-crds ./test/ ./test/
Error: no kind "PodDisruptionBudget" is registered for version "policy/v1" in scheme "pkg/runtime/scheme.go:100"

Anything else we need to know?
No response
Kubernetes version

kubectl-valdiate version: 0.0.3
$ kubectl version
WARNING: This version information is deprecated and will be replaced with the output from kubectl version --short.  Use --output=yaml|json to get the full version.
Client Version: version.Info{Major:"1", Minor:"26", GitVersion:"v1.26.0", GitCommit:"b46a3f887ca979b1a5d14fd39cb1af43e7e5d12d", GitTreeState:"clean", BuildDate:"2022-12-08T19:58:30Z", GoVersion:"go1.19.4", Compiler:"gc", Platform:"linux/amd64"}
Kustomize Version: v4.5.7
Server Version: version.Info{Major:"1", Minor:"28", GitVersion:"v1.28.5", GitCommit:"9cf543f4f17cbc5b74c24880e77590eeb1af683c", GitTreeState:"clean", BuildDate:"2024-01-31T09:07:34Z", GoVersion:"go1.20.12", Compiler:"gc", Platform:"linux/amd64"}
WARNING: version difference between client (1.26) and server (1.28) exceeds the supported minor version skew of +/-1

Definitely a bug we want to fix.
In addition to this I think it also makes sense to default the local CRD source to the user provided yaml files. Especially now that we support multiple CRD file sources.

I can take a look at this

/assign
should be fixed by #118
sorry @Schnides123 I ended up fixing this one myself


make globus and paramiko optional dependencies

Is your feature request related to a problem? Please describe.
Both paramiko and globus dependencies are rarely used, and bring in weight to the base parsl install.
At least paramiko has caused problems even when not being used due to occasional incorrect binary installs of its unix .so file.
These dependencies don't need to be installed most of the time.
Describe the solution you'd like
The components which use these - the globus staging provider, and the ssh channel - should become install optoins in the same way as the various other components are optional.

hello @benclifford I would like to work on this issue. Also if you could please give me some pointers i will really appreciate it.

Hi @benclifford! I linked PR regarding this issue, can you please review it?


solution for vscode adding semicolon in ts based single file components.

Even if in   "prettier.semi": false is specified in vsCode settings json file,  vscode will add semicolon in the ts part.
This can be avoided when specifying:
"vetur.format.defaultFormatterOptions": {
"prettier": {
"stylelintIntegration": true,
"eslintIntegration": true,
"semi": false,
"singleQuote": true,
"tabWidth": 2
}
}

You should install Prettier extension and add a .prettierrc file at root level with the preferred settings.
Vetur is just using prettier under the hood, unless you tell him to use another formatter or you are formatting HTML, for which the default is not Prettier.
VSCode settings.json is not the right place to put Prettier configuration

@paulvanbladel Please verify if the solution suggest by @IlCallo resolves your issue and if so, close this issue.


mac does not allow the use of DISALLOW_COPY_AND_ASSIGN on objects that derive from ValueObject

compilation on the mac fails when we use DISALLOW_COPY_AND_ASSIGN in
ValueObject or any class that derives from ValueObject.
This needs some investigation.

Assuming this is stale.


Unable to unzip dataset archive

There is a problem in unzipping the zip file into the 7z archive to download for the dataset.
Can you resolve and publish it in a mirror?

Hi @mfox94
I guess you may need to use 7-Zip (https://www.7-zip.org/) to unzip the file.

Hi @tqtg
7zip display the message error of file damaged.
The problem happen only when I try to unzip the zip file, not the 7z file. I think there is a problem in the compression of the latter one.
Could you upload the archive without this problem, please? Maybe on Google drive for a faster download..

Hi @tqtg
7zip displays the message error of file damaged.
The problem happens only when I try to unzip the zip file, not the 7z file. I think there is a problem in the compression of the latter one.
Could you upload the archive without this problem, please? Maybe on Google drive for a faster download..

Could you provide me the link that causes the problem?
FYI: the datasets (EMNLP'15 paper) are provided by Duyu Tang from his homepage http://ir.hit.edu.cn/~dytang/

http://ir.hit.edu.cn/~dytang/paper/emnlp2015/emnlp-2015-data.7z

@mfox94 I uploaded the data to GG Drive (please request for access): https://drive.google.com/file/d/1OQ_ggjlNUWiTg_zFXc0_OpYXpJRwJP3y

Thank you very much, it seems work!


Typescript syntax highlight not correctly working

VSCode Version: 1.24
OS Version: Windows 10 (latest)

Steps to Reproduce:
Basically, a project that was correctly working and highlighting its syntax, it's failing at it after the new update (which I installed today). Take a look:

Methods should be highlighted like here:

Since this broke just after installing the new patch... what fix can I apply? Can the devs acknowledge this problem and take it in account for a next update?
EDIT: some variables are also not being correctly highlighted (they appear white in my theme).
EDIT 2: it is really annoying sometimes:

Please test in the latest vscode insiders build. If you still see the problem, please share the source code from those screenshots at text