ZeRO-offload performance issues

Describe the bug
The performance drops significantly when using ZeRO-Offload to train Llama2 model.

model
ZeRO Offload
TOTAL TIME
TOTAL/AVG FORWARD TIME
TOTAL/AVG BACKWARD TIME
TOTAL/AVG ADAM TIME

llama2-0.3B
true
150s
6s/0.02s
66s/0.26s
78s/0.31s

llama2-0.3B
false
23s
7s/0.02s
11s/0.04s
6s/0.02s

llama2-1.2B
true
490s
4.8s/0.02s
174s/0.87s
310s/1.5s

llama2-1.2B
false
31s
11s/0.03s
10s/0.05s
16s/0.08s

To Reproduce
Steps to reproduce the behavior:
please run this code
import torch
import time
import deepspeed
from transformers import LlamaConfig, LlamaForCausalLM
from torch.utils.data import DataLoader, Dataset

# 伪造数据集
class FakeDataset(Dataset):
    def __init__(self, size=1000, seq_length=128, vocab_size=32000):
        self.size = size
        self.seq_length = seq_length
        self.vocab_size = vocab_size

    def __len__(self):
        return self.size

    def __getitem__(self, idx):
        input_ids = torch.randint(0, self.vocab_size, (self.seq_length,))
        attention_mask = torch.ones(self.seq_length)
        labels = input_ids.clone()
        return {"input_ids": input_ids, "attention_mask": attention_mask, "labels": labels}

# 创建未训练的LLaMA模型配置
# config = LlamaConfig(
#     vocab_size=32000,  # 词汇表大小
#     hidden_size=1024,   # 隐藏层维度
#     num_hidden_layers=16,  # 层数
#     num_attention_heads=32,  # 注意力头的数量
#     intermediate_size=2752,  # 中间层大小
# )

# 1.2B
config = LlamaConfig(
    vocab_size=32000,  # 词汇表大小
    hidden_size=2048,   # 隐藏层维度
    num_hidden_layers=16,  # 层数
    num_attention_heads=32,  # 注意力头的数量
    intermediate_size=8256,  # 中间层大小
)

# 7B
# config = LlamaConfig(
#     vocab_size=32000,  # 词汇表大小
#     hidden_size=4096,   # 隐藏层维度
#     num_hidden_layers=32,  # 层数
#     num_attention_heads=128,  # 注意力头的数量
#     intermediate_size=11008,  # 中间层大小
# )

# 使用自定义配置初始化未经训练的模型
model = LlamaForCausalLM(config)

# 打印模型的参数量
total_params = sum(p.numel() for p in model.parameters())
print(f"Total number of parameters: {total_params}")

# 生成伪造数据集
batch_size = 1
dataset = FakeDataset(size=100, seq_length=512, vocab_size=config.vocab_size)
dataloader = DataLoader(dataset, batch_size=batch_size, shuffle=True)

ds_config = {
    "train_batch_size": batch_size,
    "optimizer": {
        "type": "Adam",
        "params": {
            "lr": 0.001,
            "betas": [0.9, 0.999],
            "eps": 1e-8,
            "weight_decay": 0
        }
    },
    "zero_optimization": {
        "stage": 2,
        "offload_optimizer": {
            "device": "cpu",
        },
        "contiguous_gradients": True,
        "overlap_comm": True
    },
    "fp16": {
        "enabled": False,
        "loss_scale": 0,
    }
}

# DeepSpeed 初始化
model_engine, optimizer, _, _ = deepspeed.initialize(
    model=model,
    model_parameters=model.parameters(),
    config_params=ds_config
)

def train_one_epoch():
    model_engine.train()
    total_loss = 0
    adam_time = 0
    forward_time = 0
    backward_time = 0
    flag = True
    for batch in dataloader:
        if flag:
            st = time.time()
            inputs = {key: val.to(model_engine.device) for key, val in batch.items()}

            outputs = model_engine(**inputs)
            loss = outputs.loss
            forward_time += time.time() - st

            st = time.time()
            model_engine.backward(loss)
            backward_time += time.time() - st
            # flag = False

        st = time.time()
        model_engine.step()
        adam_time += time.time() - st

        total_loss += loss.item()

    # return total_loss / len(dataloader), adam_time / len(dataloader)
    return forward_time, backward_time, adam_time

def test_adam_execution_time(epochs=1):
    start_time = time.time()

    total_adam_time = 0
    total_forward_time = 0
    total_backward_time = 0
    for epoch in range(epochs):
        # avg_loss, adam_time = train_one_epoch()
        forward_time, backward_time, adam_time = train_one_epoch()
        # print(f"Epoch {epoch + 1}, Average Loss: {avg_loss:.4f}, Average adam time: {adam_time:.4f}")
        print(f"Epoch {epoch + 1}:" +
              f"\n\tAverage forward time: {forward_time / len(dataloader):.4f}" +
              f"\n\tAverage backward time: {backward_time / len(dataloader):.4f}" +
              f"\n\tAverage adam time: {adam_time / len(dataloader):.4f}")
        total_adam_time += adam_time
        total_forward_time += forward_time
        total_backward_time += backward_time

    end_time = time.time()
    print(f"Total execution time: {end_time - start_time:.2f} seconds," +
          f"\n\tTotal adam time: {total_adam_time:.4f}," +
          f"\n\tAverage adam time: {total_adam_time / (epochs * len(dataloader)):.4f}," +
          f"\n\tTotal forward time: {total_forward_time:.4f}," +
          f"\n\tAverage forward time: {total_forward_time / (epochs * len(dataloader)):.4f}," +
          f"\n\tTotal backward time: {total_backward_time:.4f}," +
          f"\n\tAverage backward time: {total_backward_time / (epochs * len(dataloader)):.4f},"
          )

test_adam_execution_time(epochs=2)

Expected behavior
The ZeRO-offload performance drop too significantly.
ds_report output
Please run ds_report to give us details about your setup.
Screenshots
If applicable, add screenshots to help explain your problem.
System info (please complete the following information):

OS: Ubuntu 22.04 LTS
GPU count and types x1 A100
Interconnects (if applicable) None
Python version 3.9
DeepSpeed version 0.15.3
pytorch version 2.4.1
Any other relevant info about your setup

Launcher context
Are you launching your experiment with the deepspeed launcher, MPI, or something else?
Docker context
Are you using a specific docker image that you can share?
Additional context
Add any other context about the problem here.

The performance with ZeRO-Offload is expected to drop because it is having to do many more transfers between cpu memory and gpu memory. The effect will be greater for the smaller models as you show here because there is less computation to be overlapped to hide the transfer times. Offload is meant to be used with larger models that can't fit into gpu memory.

@jomayeri
Thanks for your reply.
The PCIe bandwidth is 32GB/s, but in this case, for the llama2-0.3B we have total 0.3B x 2 bytes = 0.6GB and it took 0.22(0.26-.0.04) seconds which the speed is 2.7 GB/s.
Why is there such a large gap between them？

Looking at your ds_config you are offloading the optimizer states not the parameters. The optimizer multiplier on model size is typically ~12 bytes. That makes the math (0.3*12)/0.22 = 16 GB/s. Perhaps you are only getting 1 DIMMs worth of bandwidth.

@hezhiqian01 Could you please add torch.cuda.synchronize() when you measure the time cost for fwd,bwd,step? I rerun the script (and thank you providing it), the fwd time reported from your script is 0.02s while from the profiler is 0.13s.
And it is recommanded to 1) use fp16 or bf16 (mixed precision training), using fp32 will double the transfer volumes. 2) set larger batch size would lead to better performance for offloading cases.

Looking at your ds_config you are offloading the optimizer states not the parameters. The optimizer multiplier on model size is typically ~12 bytes. That makes the math (0.3*12)/0.22 = 16 GB/s. Perhaps you are only getting 1 DIMMs worth of bandwidth.

I am a little confused.
As the paper description that "During the backward propagation on the loss, the gradient for different parameters are computed at different point in the backward schedule. ZeRO-Offload can transfer these gradients for each parameter individually or in small groups to the CPU memory immediately after they are computed. Therefore, only a small amount of memory is required to temporarily hold the gradients on the GPU memory before they are transferred to CPU memory."
The data needed to be transferred is only the gradients?
Am I right?

Looking at your ds_config you are offloading the optimizer states not the parameters. The optimizer multiplier on model size is typically ~12 bytes. That makes the math (0.3*12)/0.22 = 16 GB/s. Perhaps you are only getting 1 DIMMs worth of bandwidth

It seems that the "12 bytes" is for the ZeRO-2 not for the zero-offload?
For the ZeRO-Offload the communication Volume is 2M per single direction


Broken SSR support since >2.0.1

var HEAD = document.head || document.getElementsByTagName('head')[0];
^ ReferenceError: document is not defined at /node_modules/vue-programmatic-invisible-google-recaptcha/dist/vue-programmatic-invisible-google-recaptcha.umd.js:204:16

Hey there - sorry you're having trouble with this.
Honestly I don't use SSR for my projects so I was never sure of SSR support for this component. I made a few changes around 2.0 but nothing to my knowledge that would make SSR support worse.
Are you using nuxt.js for your SSR project? Have you tried whitelisting this component in some way during the initialization? Can you provide any more detail of how you're installing this component and your SSR configuration - I'm sorta ignorant on SSR usage so the more detail the better.  Thanks.

I don't think it's actually related to the SSR usage.. it happened when changes were made to the build. I looked at the min'd source, and noticed that there are checks built into 2.0.1 to check if it's a browser or on the server.. and starting in 2.1.0 that no longer exists.
Something changed in this commit:
cfa0bc80bef7b9416e64e0d839e025d910a0a05b

Hey - yea idk this is a bit strange. Really only one dependency was updated in that commit - rollup-plugin-vue. A user over there has a question about ssr support here, maybe that can help.
Although - one thing I noticed that I took out because I didn't see it being used was the browser key in the package.json. I added that back right now and built again and pushed. Will you please update to the latest version of  vue-programmatic-invisible-google-recaptcha - 2.1.3 and see if it's working for you now? I have a feeling that could be it. Thank you - let me know.

That might be the fix, but now I'm getting other compile-time errors regarding plugins in your .babelrc. My project isn't using Babel 7.. I'm still on 6. due to a few outdated 3rd party libraries. Here's what it reports:
ReferenceError: Unknown plugin "@babel/plugin-transform-runtime"
I might have to stay at version 2.0.1 of your library until I can get everything in my project upgraded.

Hmm darn, I thought we were close! Although yea Babel 6 was released a while ago and may be the main issue here - it's hard to say.
Well, when you update to Babel 7 then maybe you can let us know if it starts working for you? I'll be standing by to hear how it goes. Thanks.

There are limitations in my project that won't let me upgrade for quite a
while.. But I'll let you know as soon as I can. Thanks a lot for the help
either way.
On Tue., May 7, 2019, 3:52 p.m. John Datserakis<EMAIL_ADDRESS>wrote:

Hmm darn, I thought we were close! Although yea Babel 6 was released a
while ago and may be the main issue here - it's hard to say.
Well, when you update to Babel 7 then maybe you can let us know if it
starts working for you? I'll be standing by to hear how it goes. Thanks.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/promosis/vue-programmatic-invisible-google-recaptcha/issues/1#issuecomment-490250807,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAAWU3SKOSN7VECVHPK5YD3PUHTZFANCNFSM4HG67PKA
.


describeTable does not return an ACTIVE status

I'm using dynalite, and when I create a table and then call describeTable, I'm always getting a CREATING status, even after 40 seconds (max I tried) after the createTable was issued.

@lukiano can you give me some more details on how you're using dynalite, and the client code you're using to check this?
There are tests to ensure CreateTable results in an ACTIVE status and they're currently passing, so I suspect it's something to do with your setup or your DynamoDB client.

Hmm, I just tried the test in a different machine and it passed. Let me do some more tests and if my computer is faulty in some way, then I'll close this. Thanks for the prompt response

What happens is that the AWS SDK for Node.JS caches the result of describeTable. The first time going to dynalite it returned a CREATING status, but then dynalite changed to ACTIVE, but the describeTable method was still returning CREATING.

@lukiano woah, really? Is that documented somewhere? It doesn't seem to be mentioned in the normal docs: http://docs.aws.amazon.com/AWSJavaScriptSDK/latest/AWS/DynamoDB.html#describeTable-property

We attached a proxy sniffer and no requests were being sent to dynalite after the first one

@lukiano I suspect there's something up with your code. The following works just fine for me (using the AWS SDK):
var AWS = require('aws-sdk')

var db = new AWS.DynamoDB({endpoint: 'http://localhost:4567'})

function checkTable(err, data) {
  if (err) throw err
  var status = (data.Table || data.TableDescription).TableStatus
  console.log(status)
  if (status != 'ACTIVE') {
    setTimeout(db.describeTable.bind(db, {TableName: 'test'}, checkTable), 100)
  }
}

db.createTable({
  TableName: 'test',
  AttributeDefinitions: [{AttributeName: "id", AttributeType: "S"}],
  KeySchema: [{AttributeName: "id", KeyType: "HASH"}],
  ProvisionedThroughput: {ReadCapacityUnits: "1", WriteCapacityUnits: "1"},
}, checkTable)

If I save this to a file and run it I get:
$ node test.js
CREATING
CREATING
CREATING
CREATING
CREATING
ACTIVE

Perhaps you're binding some state in a closure or memoizing accidentally?


nodePackages.prisma: 5.12.1 -> 5.16.1

Description of changes

Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[x] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[x] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/prs-ready-for-review/3032/4196

Result of nixpkgs-review pr 324858 run on x86_64-linux 1

2 packages built:

documenso
prisma-engines

please see #229475 to migrate packages out of nodePackages


Attempts the same install multiple times despite failure

The installation will be attempted as many times as the formula occurs in the dependency tree regardless of prior failures of the build (with the same options or lack thereof) as an explicit item in the Brewfile or as a dependency of other items in the Brewfile.
Succeeded in installing libassuan
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::FormulaLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/libgcrypt.rb
Installing libgcrypt formula. It is not currently installed.
==> Using the sandbox
==> Downloading https://gnupg.org/ftp/gcrypt/libgcrypt/libgcrypt-1.7.3.tar.bz2
Already downloaded: /Users/joe/Library/Caches/Homebrew/libgcrypt-1.7.3.tar.bz2
==> ./configure --disable-silent-rules --enable-static --prefix=/usr/local/Cellar/libgcrypt/1.7.3 --disable-asm --with-libgpg-error-prefix=/usr/local/opt/libgpg-error
==> make
==> install_name_tool -change /usr/local/Cellar/libgcrypt/1.7.3/lib/libgcrypt.20.dylib /private/tmp/libgcrypt-20161113-34926-3f85io/libgcrypt-1.7.3/src/.libs/libgcrypt.20.dylib /private/tmp/libgcrypt-2016
==> make check
Last 15 lines from /Users/joe/Library/Logs/Homebrew/libgcrypt/04.make:
HMAC_SHA3_384            0ms    10ms    10ms
HMAC_SHA3_512            0ms    10ms    10ms
/bin/sh: line 1: 44135 Segmentation fault: 11  GCRYPT_IN_REGRESSION_TEST=1 ${dir}$tst
FAIL: benchmark
/bin/sh: line 1: 44153 Segmentation fault: 11  GCRYPT_IN_REGRESSION_TEST=1 ${dir}$tst
FAIL: bench-slope
SKIP: hashtest-256g
======================================
4 of 25 tests failed
(1 test was not run)
Please report to http://bugs.gnupg.org
======================================
make[2]: *** [check-TESTS] Error 1
make[1]: *** [check-am] Error 2
make: *** [check-recursive] Error 1

READ THIS: https://git.io/brew-troubleshooting

Failed in installing libgcrypt
Skipping install of libksba formula. It is already up-to-date.
Succeeded in installing libksba
Skipping install of pth formula. It is already up-to-date.
Succeeded in installing pth
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::FormulaLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/dirmngr.rb
Installing dirmngr formula. It is not currently installed.
==> Installing dependencies for dirmngr: libgcrypt
==> Installing dirmngr dependency: libgcrypt
==> Using the sandbox
==> Downloading https://gnupg.org/ftp/gcrypt/libgcrypt/libgcrypt-1.7.3.tar.bz2
Already downloaded: /Users/joe/Library/Caches/Homebrew/libgcrypt-1.7.3.tar.bz2
==> ./configure --disable-silent-rules --enable-static --prefix=/usr/local/Cellar/libgcrypt/1.7.3 --disable-asm --with-libgpg-error-prefix=/usr/local/opt/libgpg-error
==> make
==> install_name_tool -change /usr/local/Cellar/libgcrypt/1.7.3/lib/libgcrypt.20.dylib /private/tmp/libgcrypt-20161113-44586-4jkbsi/libgcrypt-1.7.3/src/.libs/libgcrypt.20.dylib /private/tmp/libgcrypt-2016
==> make check
Last 15 lines from /Users/joe/Library/Logs/Homebrew/libgcrypt/04.make:
HMAC_SHA3_384            0ms    10ms    10ms
HMAC_SHA3_512            0ms    10ms    10ms
/bin/sh: line 1: 53789 Segmentation fault: 11  GCRYPT_IN_REGRESSION_TEST=1 ${dir}$tst
FAIL: benchmark
/bin/sh: line 1: 53807 Segmentation fault: 11  GCRYPT_IN_REGRESSION_TEST=1 ${dir}$tst
FAIL: bench-slope
SKIP: hashtest-256g
======================================
4 of 25 tests failed
(1 test was not run)
Please report to http://bugs.gnupg.org
======================================
make[2]: *** [check-TESTS] Error 1
make[1]: *** [check-am] Error 2
make: *** [check-recursive] Error 1

READ THIS: https://git.io/brew-troubleshooting

Failed in installing dirmngr
Skipping install of docker formula. It is already up-to-date.
Succeeded in installing docker
Skipping install of docker-machine formula. It is already up-to-date.
Succeeded in installing docker-machine
Skipping install of libyaml formula. It is already up-to-date.
Succeeded in installing libyaml
Skipping install of docker-compose formula. It is already up-to-date.
Succeeded in installing docker-compose
Skipping install of docutils formula. It is already up-to-date.
Succeeded in installing docutils
Skipping install of double-conversion formula. It is already up-to-date.
Succeeded in installing double-conversion
Skipping install of eigen formula. It is already up-to-date.
Succeeded in installing eigen
Skipping install of emacs formula. It is already up-to-date.
Succeeded in installing emacs
Skipping install of etl formula. It is already up-to-date.
Succeeded in installing etl
Skipping install of exiv2 formula. It is already up-to-date.
Succeeded in installing exiv2
Skipping install of expat formula. It is already up-to-date.
Succeeded in installing expat
Skipping install of frei0r formula. It is already up-to-date.
Succeeded in installing frei0r
Skipping install of lame formula. It is already up-to-date.
Succeeded in installing lame
Skipping install of libcaca formula. It is already up-to-date.
Succeeded in installing libcaca
Skipping install of libogg formula. It is already up-to-date.
Succeeded in installing libogg
Skipping install of libvorbis formula. It is already up-to-date.
Succeeded in installing libvorbis
Skipping install of snappy formula. It is already up-to-date.
Succeeded in installing snappy
Skipping install of speex formula. It is already up-to-date.
Succeeded in installing speex
Skipping install of theora formula. It is already up-to-date.
Succeeded in installing theora
Skipping install of x264 formula. It is already up-to-date.
Succeeded in installing x264
Skipping install of xvid formula. It is already up-to-date.
Succeeded in installing xvid
Skipping install of xz formula. It is already up-to-date.
Succeeded in installing xz
Skipping install of zimg formula. It is already up-to-date.
Succeeded in installing zimg
Skipping install of ffmpeg formula. It is already up-to-date.
Succeeded in installing ffmpeg
Skipping install of fftw formula. It is already up-to-date.
Succeeded in installing fftw
Skipping install of filebeat formula. It is already up-to-date.
Succeeded in installing filebeat
Skipping install of findutils formula. It is already up-to-date.
Succeeded in installing findutils
Skipping install of flac formula. It is already up-to-date.
Succeeded in installing flac
Skipping install of freeimage formula. It is already up-to-date.
Succeeded in installing freeimage
Skipping install of fzf formula. It is already up-to-date.
Succeeded in installing fzf
Skipping install of readline formula. It is already up-to-date.
Succeeded in installing readline
Skipping install of gawk formula. It is already up-to-date.
Succeeded in installing gawk
Skipping install of gdbm formula. It is already up-to-date.
Succeeded in installing gdbm
Skipping install of gdm formula. It is already up-to-date.
Succeeded in installing gdm
Skipping install of node formula. It is already up-to-date.
Succeeded in installing node
Skipping install of generate-json-schema formula. It is already up-to-date.
Succeeded in installing generate-json-schema
Skipping install of gflags formula. It is already up-to-date.
Succeeded in installing gflags
Skipping install of glew formula. It is already up-to-date.
Succeeded in installing glew
Skipping install of glog formula. It is already up-to-date.
Succeeded in installing glog
Skipping install of gnome-common formula. It is already up-to-date.
Succeeded in installing gnome-common
Skipping install of icon-naming-utils formula. It is already up-to-date.
Succeeded in installing icon-naming-utils
Skipping install of gnome-icon-theme formula. It is already up-to-date.
Succeeded in installing gnome-icon-theme
Skipping install of gnu-sed formula. It is already up-to-date.
Succeeded in installing gnu-sed
Skipping install of pinentry formula. It is already up-to-date.
Succeeded in installing pinentry
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::FormulaLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/gpg-agent.rb
Installing gpg-agent formula. It is not currently installed.
==> Installing dependencies for gpg-agent: libgcrypt
==> Installing gpg-agent dependency: libgcrypt
==> Using the sandbox
==> Downloading https://gnupg.org/ftp/gcrypt/libgcrypt/libgcrypt-1.7.3.tar.bz2
Already downloaded: /Users/joe/Library/Caches/Homebrew/libgcrypt-1.7.3.tar.bz2
==> ./configure --disable-silent-rules --enable-static --prefix=/usr/local/Cellar/libgcrypt/1.7.3 --disable-asm --with-libgpg-error-prefix=/usr/local/opt/libgpg-error
==> make
==> install_name_tool -change /usr/local/Cellar/libgcrypt/1.7.3/lib/libgcrypt.20.dylib /private/tmp/libgcrypt-20161113-54240-93lkeb/libgcrypt-1.7.3/src/.libs/libgcrypt.20.dylib /private/tmp/libgcrypt-2016
==> make check
Last 15 lines from /Users/joe/Library/Logs/Homebrew/libgcrypt/04.make:
HMAC_SHA3_384            0ms    10ms    10ms
HMAC_SHA3_512            0ms    10ms    10ms
/bin/sh: line 1: 63443 Segmentation fault: 11  GCRYPT_IN_REGRESSION_TEST=1 ${dir}$tst
FAIL: benchmark
/bin/sh: line 1: 63461 Segmentation fault: 11  GCRYPT_IN_REGRESSION_TEST=1 ${dir}$tst
FAIL: bench-slope
SKIP: hashtest-256g
======================================
4 of 25 tests failed
(1 test was not run)
Please report to http://bugs.gnupg.org
======================================
make[2]: *** [check-TESTS] Error 1
make[1]: *** [check-am] Error 2
make: *** [check-recursive] Error 1

READ THIS: https://git.io/brew-troubleshooting

Failed in installing gpg-agent
Skipping install of libusb formula. It is already up-to-date.
Succeeded in installing libusb
Skipping install of libusb-compat formula. It is already up-to-date.
Succeeded in installing libusb-compat
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::FormulaLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/gnupg2.rb
Installing gnupg2 formula. It is not currently installed.
==> Installing dependencies for gnupg2: libgcrypt, gpg-agent, dirmngr
==> Installing gnupg2 dependency: libgcrypt
==> Using the sandbox
==> Downloading https://gnupg.org/ftp/gcrypt/libgcrypt/libgcrypt-1.7.3.tar.bz2
Already downloaded: /Users/joe/Library/Caches/Homebrew/libgcrypt-1.7.3.tar.bz2
==> ./configure --disable-silent-rules --enable-static --prefix=/usr/local/Cellar/libgcrypt/1.7.3 --disable-asm --with-libgpg-error-prefix=/usr/local/opt/libgpg-error
==> make
==> install_name_tool -change /usr/local/Cellar/libgcrypt/1.7.3/lib/libgcrypt.20.dylib /private/tmp/libgcrypt-20161113-63894-biwvji/libgcrypt-1.7.3/src/.libs/libgcrypt.20.dylib /private/tmp/libgcrypt-2016
==> make check
Last 15 lines from /Users/joe/Library/Logs/Homebrew/libgcrypt/04.make:
HMAC_SHA3_384            0ms    10ms    10ms
HMAC_SHA3_512            0ms    10ms    10ms
/bin/sh: line 1: 73101 Segmentation fault: 11  GCRYPT_IN_REGRESSION_TEST=1 ${dir}$tst
FAIL: benchmark
/bin/sh: line 1: 73119 Segmentation fault: 11  GCRYPT_IN_REGRESSION_TEST=1 ${dir}$tst
FAIL: bench-slope
SKIP: hashtest-256g
======================================
4 of 25 tests failed
(1 test was not run)
Please report to http://bugs.gnupg.org
======================================
make[2]: *** [check-TESTS] Error 1
make[1]: *** [check-am] Error 2
make: *** [check-recursive] Error 1

READ THIS: https://git.io/brew-troubleshooting

Failed in installing gnupg2
Skipping install of godep formula. It is already up-to-date.
Succeeded in installing godep
Skipping install of google-sparsehash formula. It is already up-to-date.
Succeeded in installing google-sparsehash
Skipping install of govendor formula. It is already up-to-date.
Succeeded in installing govendor
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::FormulaLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/gpgme.rb
Unlinking argp-standalone formula.
It is currently installed and conflicts with gpgme.
Unlinking /usr/local/Cellar/argp-standalone/1.3... 0 symlinks removed
Installing gpgme formula. It is not currently installed.
==> Installing dependencies for gpgme: libgcrypt, gpg-agent, dirmngr, gnupg2
==> Installing gpgme dependency: libgcrypt
==> Using the sandbox
==> Downloading https://gnupg.org/ftp/gcrypt/libgcrypt/libgcrypt-1.7.3.tar.bz2
Already downloaded: /Users/joe/Library/Caches/Homebrew/libgcrypt-1.7.3.tar.bz2
==> ./configure --disable-silent-rules --enable-static --prefix=/usr/local/Cellar/libgcrypt/1.7.3 --disable-asm --with-libgpg-error-prefix=/usr/local/opt/libgpg-error

etc.

Consider this a WONTFIX because Homebrew Bundle is not aware of Homebrew-level dependencies.

That would be really awesome of the dependency were GHC and the build were left unattended.

Consider this a WONTFIX because Homebrew Bundle is not aware of Homebrew-level dependencies.

To be clearer: it's intentional that Homebrew Bundle is not aware of how e.g. Homebrew resolves dependencies. The list of things in a Brewfile are simply arguments to be passed to brew install.


Memory problems

After setting up the exporter the fortigate keeps using more and more memory until it crashes, is this a known issue, and is there a fix/workaround?
Fortigate 60F

Hello!
Yes, indeed for some versions of FortiOS there are known memory leaks: https://github.com/bluecmd/fortigate_exporter#known-issues
The recommended version train right now is 6.4 - we haven't had any issues with it and some metrics require that version or newer.

We currently have 2 6.4.0 FortiGate's with this issue.
We also have a 6.4.6 Fortigate, i will monitor that one aswell to see if it has the same problems.

Just read in #62 that it looks like this issue is solved from at least 6.4.5.
Unfortunately we do not have the time to upgrade one version at a time to give you updated information, but it looks like you should recommend 6.4.5 or higher as the leak is still present in 6.4.0


drag selection going outside of search box moves caret to document

Type: Bug
When I want to modify the start of a search term in the small search window, my instinct is that I delete by drag-selecting it. This is much quicker than doing shift-home by keyboard.
The good thing is it doesn't require precise mouse movement, once the drag-select starts I can finish the selection anywhere left of the search box. After that I can quickly type new text.
This worked perfectly until the last update.
Now if the mouse moves to the part of the window below breadcrumbs that shows code sctructure,
the caret is moved to the document, and my typing goes into the document instead of the search box. If I finish the drag by going down to the document, this doesn't happen (but that is too far down in most cases to be quick).
VS Code version: Code 1.76.0 (92da9481c0904c6adfe372c12da3b7748d74bdcb, 2023-03-01T10:22:44.506Z)
OS version: Windows_NT x64 10.0.19044
Modes:
Sandboxed: Yes

System Info

Item
Value

CPUs
Intel(R) Core(TM) i7-7700 CPU @ 3.60GHz (8 x 3600)

GPU Status
2d_canvas: enabledcanvas_oop_rasterization: disabled_offdirect_rendering_display_compositor: disabled_off_okgpu_compositing: enabledmultiple_raster_threads: enabled_onopengl: enabled_onrasterization: enabledraw_draw: disabled_off_okskia_renderer: enabled_onvideo_decode: enabledvideo_encode: enabledvulkan: disabled_offwebgl: enabledwebgl2: enabledwebgpu: disabled_off

Load (avg)
undefined

Memory (System)
30.91GB (15.80GB free)

Process Argv
c:\Dev\BPet-AENG-DEV-FCS\LibSrc\BuilderFiles\... --crash-reporter-id beeacb82-76dc-4358-bba1-7d7debef436f

Screen Reader
no

VM
0%

Extensions (43)

Extension
Author (truncated)
Version

overtype
ada
0.2.0

Bookmarks
ale
13.3.1

project-manager
ale
12.7.0

alignment
ann
0.3.0

vscode-color
ans
0.4.5

close-all
ben
1.0.2

docs-view
bie
0.0.11

npm-intellisense
chr
1.4.4

gitignore
cod
0.9.0

vscode-svgviewer
css
2.0.0

vscode-eslint
dba
2.4.0

git-extension-pack
don
0.1.3

githistory
don
0.6.20

xml
Dot
2.5.1

gitlens
eam
13.3.2

vscode-npm-script
eg2
0.3.29

vscode-npm
fkn
3.3.0

vscode-pull-request-github
Git
0.60.0

gdl
Gra
1.26.2

better-cpp-syntax
jef
1.17.2

json-escaper
jos
1.1.2

markdown-viewer
jul
1.0.0

private-extension-manager
jul
1.4.9

guid
kos
0.0.1

rainbow-csv
mec
3.5.0

perforce
mjc
4.15.7

perl-debug
mor
0.6.3

language-gettext
mro
0.2.2

isort
ms-
2022.8.0

python
ms-
2023.4.0

vscode-pylance
ms-
2023.3.10

jupyter
ms-
2023.2.1000592019

jupyter-keymap
ms-
1.1.0

jupyter-renderers
ms-
1.0.15

vscode-jupyter-cell-tags
ms-
0.1.6

vscode-jupyter-slideshow
ms-
0.1.5

cpptools
ms-
1.14.4

hexeditor
ms-
1.9.11

formatdump
pba
0.0.5

tmlanguage
ped
0.12.0

vscode-lldb
vad
1.8.1

vscode-todo-highlight
way
1.0.5

vscode-open-in-github
ziy
1.3.6

A/B Experiments
vsliv368:30146709
vsreu685:30147344
python383:30185418
vspor879:30202332
vspor708:30202333
vspor363:30204092
vslsvsres303:30308271
pythonvspyl392:30443607
vserr242:30382549
pythontb:30283811
vsjup518:30340749
pythonptprofiler:30281270
vshan820:30294714
vstes263cf:30335440
pythondataviewer:30285071
vscod805:30301674
binariesv615:30325510
bridge0708:30335490
bridge0723:30353136
cmake_vspar411:30581797
vsaa593:30376534
pythonvs932:30410667
cppdebug:30492333
vscaac:30438847
vsclangdc:30486549
c4g48928:30535728
dsvsc012cf:30540253
azure-dev_surveyone:30548225
pyindex848:30662994
nodejswelcome1:30587005
282f8724:30602487
pyind779:30671433
89544117:30613380
pythonsymbol12:30671437
a9j8j154:30646983
vsctsb:30677850
vscodeenable:30660116
pythonb192cf:30669361

dragging text doesn't work at all in find (it always just unexpectedly drops it into the editor), so it should probably just be disabled for that input.


Add a changelog

We should discuss the possibility of maintaining a CHANGELOG file. Currently it can be difficult to know which changes have been deployed, and a CHANGELOG file would greatly help with that. It might prove to cause some overhead, so we'll have to discuss if it's worth it.

Closed by #491


The image file could not be opened in targetsdkversion 29

Expected Behavior
Set / change profile picture
Actual Behavior
ERROR:The image file could not be opened
Specifications

Image Picker Version: 2.1.10
Android OS:10
Phone: Nokia 8.1

Code :
openGallery():Promise<string>{
    return new Promise((resolve,reject)=>{
      this.checkPermission().then(granted=>{
        if (granted) {

          let options = {
            quality:80,
            maximumImagesCount:1
          };

          this.picker.getPictures(options).then(uri=>{
            console.log("URI of picked image "+uri);
            this.cropImage(uri.toString()).then(croppedImage=>{
              resolve(croppedImage);
            }).catch(err=>{
              reject("error in cropIMage "+JSON.stringify(err));
              console.log("error in getPrictures_crop "+JSON.stringify(err))
            })
          }).catch(err=>{
             reject("error in getPictures "+JSON.stringify(err));
             console.log("getPictures "+err);
          })
        }
      })
    })
  }

android:requestLegacyExternalStorage="true" add this to your manifest file

Many thanks @hirenpatel868 . It works perfect.

great, I've faced with it too. Thanks. I think, author must add this to the main page

android:requestLegacyExternalStorage="true" is temporary and it is not work while your app published in Google Play.
Right now i have this issue in my app.

android:requestLegacyExternalStorage="true" is temporary and it is not work while your app published in Google Play.
Right now i have this issue in my app.

Simply not true. Published and having no issues. Also google documentation states nothing about such things. Please be careful with spreading fake info. However targeting API level 30, this fix will not work. works for 29 only.

Hey guys this issue should be fixed in 2.3.0
Thanks!

Not resolved,still getting an error
Caused by: java.io.FileNotFoundException: /storage/emulated/0/DCIM/Camera/IMG_20200604_112539.jpg: open failed: EACCES (Permission denied) android 10

android:requestLegacyExternalStorage="true" add this to your manifest file

error: No resource identifier found for attribute 'requestLegacyExternalStorage' in package 'android'
This is what I am getting when I add android:requestLegacyExternalStorage="true" in manifest file
Unable to build APK

are u using targetSdkVersion 29 compileSDKVersion 29

android:requestLegacyExternalStorage="true" add this to your manifest file

error: No resource identifier found for attribute 'requestLegacyExternalStorage' in package 'android'
This is what I am getting when I add android:requestLegacyExternalStorage="true" in manifest file
Unable to build APK

are u using targetSdkVersion 29 compileSDKVersion 29

Yes I am using targetSdkVersion 29

 <application
        android:label="@string/app_name"
        android:requestLegacyExternalStorage="true">

 <application
        android:label="@string/app_name"
        android:requestLegacyExternalStorage="true">

Yes, @sameerjj I tried the same but still, I am getting the same error.


Added option to exclude info vuln by default

I'm assuming the color change is intentional across dashboards

I'm assuming the color change is intentional across dashboards

Yes, to keep it similar to other dashboards.


Update starter template to use vue-eslint

Hello,
With the release of official vue-eslint I guess it's not a bad idea to integrate it right out of the box for every NUXT project.
Hope it helps.

/cc @pi0


[FEATURE] JRTB-0: create  Skeleton Spring boot project

Create skeleton Spring boot project for JRTB.
Acceptance criteria:

Spring boot project created.

Implemented in https://github.com/RuSichPT/javarush-telegrambot/pull/2


[ArPow] Remove symreader patch

When completing https://github.com/dotnet/installer/pull/11955, a patch was required in symreader to remove a test project. The patch is addressed in symreader with https://github.com/dotnet/symreader/pull/249. Once the change to symreader is picked up by source-build, the patch can be removed.

Resolved with https://github.com/dotnet/installer/pull/12066.


Could I separate registry/repository:tag override for VarnishClusters Object ?

Hey,
I would like to override only the the Registry the same way I did with the Varnish-Operator(https://github.com/IBM/varnish-operator/pull/87), because I don't want to pull my images from internet each time I don't have it on the node.
I would be open to do the PR
Thanks,
Arthur

I could do the same as VictoriaMetrics did : https://github.com/VictoriaMetrics/operator/blob/633f5fcef44a901085d48b9de079af79be52739d/config/crd/bases/operator.victoriametrics.com_vmagents.yaml#L705

This is a good point. We should probably stick with the same scheme so as to maintain backward compatibility. While we're at it, does it make sense to do this for the other images too?

Yes, I think it does, as I would like to override with my own ECR for all images used by Varnish Cluster and Operator in my Kubernetes cluster

So in fact, after a closer look in pair with @chubchubsancho, there is no need to do that.
If you overide the image of the Operator, it will set a environment variable. This CONTAINER_IMAGE is then used to set image for the VarnishCluster if you don't specify them.
You can find the code that does just that in https://github.com/IBM/varnish-operator/blob/f004366cc6f0b5f04b46f8739ca9195fc8f8e107/pkg/varnishcluster/config/config.go#L55


Starting the type variable showcase.

Created an sku redactor example for the type variables showcase.

Very nice job, just last few nits.


[BUG] button component broken for C3 and S3 (and H2?) (PACMAN-240)

component version: 1.0.0
board: esp32 S3 rev 0
2 issues:

component suppose to be for all chip models, but it is missing declaration for C3 and S3:

#if CONFIG_IDF_TARGET_ESP32
#define ADC_BUTTON_WIDTH       ADC_WIDTH_BIT_12
#elif CONFIG_IDF_TARGET_ESP32S2
#define ADC_BUTTON_WIDTH       ADC_WIDTH_BIT_13
#endif

and error:
../managed_components/espressif__button/button_adc.c: In function 'button_adc_init':
../managed_components/espressif__button/button_adc.c:104:27: error: 'ADC_BUTTON_WIDTH' undeclared (first use in this function); did you mean 'ADC_BUTTON_ATTEN'?
         adc1_config_width(ADC_BUTTON_WIDTH);
                           ^~~~~~~~~~~~~~~~
                           ADC_BUTTON_ATTEN
../managed_components/espressif__button/button_adc.c:104:27: note: each undeclared identifier is reported only once for each function it appears in
[2/12] Performing build step for 'bootloader'
[1/1] cd /home/chegewara/esp/master/examples/get-started/hello_world/build/bootloader/esp-idf/esptool_py && /home/chegewara/.espressif/python_env/idf4.4_py3.8_env/bin/python /home/chegewara/esp/master/components/partition_table/check_sizes.py --offset 0x8000 bootloader 0x0 /home/chegewara/esp/master/examples/get-started/hello_world/build/bootloader/bootloader.bin
Bootloader binary size 0x4ef0 bytes. 0x3110 bytes (38%) free.
[3/10] Building C object esp-idf/main/CMakeFiles/__idf_main.dir/hello_world_main.c.obj
ninja: build stopped: subcommand failed.
ninja failed with exit code 1

please update documentation, iot_button_create and iot_button_register_cb, the names has been changed (maybe even more functions)
https://docs.espressif.com/projects/espressif-esp-iot-solution/en/latest/input_device/button.html

button hold event is called 2 times every time:

I (4701) TAG: BUTTON_LONG_PRESS_HOLD
I (4701) TAG: BUTTON_LONG_PRESS_HOLD
I (4711) TAG: BUTTON_LONG_PRESS_HOLD
I (4711) TAG: BUTTON_LONG_PRESS_HOLD
I (4721) TAG: BUTTON_LONG_PRESS_HOLD
I (4721) TAG: BUTTON_LONG_PRESS_HOLD
I (4731) TAG: BUTTON_LONG_PRESS_HOLD
I (4731) TAG: BUTTON_LONG_PRESS_HOLD
I (4741) TAG: BUTTON_LONG_PRESS_HOLD
I (4741) TAG: BUTTON_LONG_PRESS_HOLD

Hello @chegewara ,
I uploaded version 2.0.0 of button component from esp-iot-solution master branch: https://components.espressif.com/component/espressif/button
The bugs you mentioned should be fixed there.
We are working on a more transparent connection between our component registry and source code (typically on Github).
You should be able to see homepage link in https://components.espressif.com/component/espressif/button now!

Great, thanks.
homepage is working there and i will test component and report.

Seems to be ok now.


CTRL-F Options

When pressing CTRL-F it only searches/replaces the active file and there is no way to search the files I have currently open.
Describe the solution or feature you'd like
When I do a CTRL-F is should be able to select between This Document, All Open Documents, or the Current Selection.
Describe alternatives you've considered
Using another tool
Additional context
I typically have many open windows and I need to find certain text in the open

You can use ctrl+shift+F to search across your workspace + open editors.


ENH: Reorder within-segment rows of carpetplot with hierarchical clustering

Simple implementation of reordering of rows in the carpetplot using hierarchical clustering. Supersedes #684.

Hello @oesteban, thank you for submitting the Pull Request!

In the file niworkflows/viz/plots.py:

Line 205:32: E203 whitespace before ':'
Line 324:22: F821 undefined name 'get_dendrogram'
Line 1179:47: E203 whitespace before ':'

To test for issues locally, pip install flake8 and then run flake8 niworkflows.

Codecov Report

Merging #686 (b8eeb1d) into master (8fc145d) will decrease coverage by 0.18%.
The diff coverage is 2.04%.

@@            Coverage Diff             @@
##           master     #686      +/-   ##
==========================================
- Coverage   48.00%   47.81%   -0.19%
==========================================
  Files          45       45
  Lines        5702     5726      +24
  Branches      810      815       +5
==========================================
+ Hits         2737     2738       +1
- Misses       2869     2892      +23
  Partials       96       96

Flag
Coverage Δ

reportlettests
∅ <ø> (∅)

unittests
47.81% <2.04%> (-0.19%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

niworkflows/viz/plots.py
5.85% <2.04%> (-0.09%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update bad7029...b8eeb1d. Read the comment docs.

Seems to be working.
Before:

After:


Problem with com.google.gms:google-services:4.1.0

Step 1: Are you in the right place?
Maybe.
Step 2: Describe your environment

Android device: Emulator
Android OS version: O
Google Play Services version: 4.1.0
Firebase/Play Services SDK version:

    implementation 'com.google.firebase:firebase-core:16.0.3'
    implementation 'com.google.firebase:firebase-auth:16.0.3'
    implementation 'com.google.firebase:firebase-perf:16.1.0'
    implementation 'com.google.firebase:firebase-database:16.0.2'
    implementation 'com.google.firebase:firebase-firestore:17.1.0'
    implementation 'com.google.firebase:firebase-invites:16.0.3'
    implementation 'com.google.firebase:firebase-messaging:17.3.1'

    implementation 'com.google.android.gms:play-services-auth:16.0.0'
    implementation 'com.google.android.gms:play-services-maps:15.0.1'
    implementation 'com.google.android.gms:play-services-vision:15.0.2'

FirebaseUI version: both 4.1.0 and 4.2.0

   implementation "com.firebaseui:firebase-ui-auth:4.2.0"
   implementation "com.firebaseui:firebase-ui-storage:4.2.0"

Step 3: Describe the problem:
When change the version of com.google.gms:google-services from 4.0.x to 4.1.0
Steps to reproduce:

Start app with google-services version 4.0.2. It's working fine.
Change google-services version 4.1.0, sync and run
Crash
Adding FirebaseApp.initializeApp(applicationContext) won't help

Observed Results:
2018-09-13 17:49:12.515 27842-27842/xxx.xxxxxxx E/AndroidRuntime: FATAL EXCEPTION: main
    Process: xxx.xxxxxxx, PID: 27842
    java.lang.RuntimeException: Unable to create application xxx.xxxxxxx.MainApplication: java.lang.IllegalStateException: Default FirebaseApp is not initialized in this process xxx.xxxxxxx. Make sure to call FirebaseApp.initializeApp(Context) first.
        at android.app.ActivityThread.handleBindApplication(ActivityThread.java:5743)
        at android.app.ActivityThread.-wrap1(Unknown Source:0)
        at android.app.ActivityThread$H.handleMessage(ActivityThread.java:1656)
        at android.os.Handler.dispatchMessage(Handler.java:106)
        at android.os.Looper.loop(Looper.java:164)
        at android.app.ActivityThread.main(ActivityThread.java:6494)
        at java.lang.reflect.Method.invoke(Native Method)
        at com.android.internal.os.RuntimeInit$MethodAndArgsCaller.run(RuntimeInit.java:438)
        at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:807)
     Caused by: java.lang.IllegalStateException: Default FirebaseApp is not initialized in this process xxx.xxxxxxx. Make sure to call FirebaseApp.initializeApp(Context) first.
        at com.google.firebase.FirebaseApp.getInstance(com.google.firebase:firebase-common@@16.0.2:240)
        at com.google.firebase.firestore.FirebaseFirestore.getInstance(com.google.firebase:firebase-firestore@@17.0.5:49)
        at xxx.xxxxxxx.MainApplication.onCreate(MainApplication.kt:57)
        at android.app.Instrumentation.callApplicationOnCreate(Instrumentation.java:1119)
        at android.app.ActivityThread.handleBindApplication(ActivityThread.java:5740)
        at android.app.ActivityThread.-wrap1(Unknown Source:0)
        at android.app.ActivityThread$H.handleMessage(ActivityThread.java:1656)
        at android.os.Handler.dispatchMessage(Handler.java:106)
        at android.os.Looper.loop(Looper.java:164)
        at android.app.ActivityThread.main(ActivityThread.java:6494)
        at java.lang.reflect.Method.invoke(Native Method)
        at com.android.internal.os.RuntimeInit$MethodAndArgsCaller.run(RuntimeInit.java:438)
        at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:807)

Expected Results:
App won't crash and start normally
Relevant Code:
class MainApplication : Application() {
override fun onCreate() {
      super.onCreate()
     ...

     // Adding `FirebaseApp.initializeApp(applicationContext)` here won't help
      val settings = FirebaseFirestoreSettings.Builder()
              .setTimestampsInSnapshotsEnabled(true)
              .build()
      val firestore = FirebaseFirestore.getInstance()
      firestore.firestoreSettings = settings
  }
}

@MacNakrub there is a known issue where google-services 4.1.0 does not work with the latest versions of the Android Gradle Plugin (mostly 3.3.0-alpha0x).  We are working on it!
Going to close this issue, we're tracking it elsewhere.

@samedson could you ref issue where this is being tracked, thanks!

@AndroidGecko it's being tracked internally, so if I gave you a link it wouldn't work for you ... sorry for the lack of transparency

Can we get some indication of when we might see this fixed? Days, weeks, months?

Now that 3.3 is in beta, can we get some more information about this? Very difficult to test out the alphas and betas (as the AS team suggests frequently) if Google's own tools don't work with them.

Sorry I don't have a timeline yet, please keep using google-services:4.0.1 for now

This thing haven't been fixed yet?
I want to update to 3.3 beta 3 because they have fixed the problem with the sound when you have open the emulator and you use bluetooth headphones.

Have you tried version 4.2.0 of the google-services plugin?

@samtstern Where release notes could be found for 4.2.0?
Is it possible to add link to a changelog page here? https://developers.google.com/android/guides/google-services-plugin

> Could not resolve all artifacts for configuration ':classpath'.
   > Could not find com.google.gms:google-services:4.2.0.
     Searched in the following locations:
       - https://dl.google.com/dl/android/maven2/com/google/gms/google-services/4.2.0/google-services-4.2.0.pom
       - https://dl.google.com/dl/android/maven2/com/google/gms/google-services/4.2.0/google-services-4.2.0.jar
       - https://jcenter.bintray.com/com/google/gms/google-services/4.2.0/google-services-4.2.0.pom
       - https://jcenter.bintray.com/com/google/gms/google-services/4.2.0/google-services-4.2.0.jar
       - https://maven.fabric.io/public/com/google/gms/google-services/4.2.0/google-services-4.2.0.pom
       - https://maven.fabric.io/public/com/google/gms/google-services/4.2.0/google-services-4.2.0.jar

> Could not resolve all artifacts for configuration ':classpath'.
   > Could not find com.google.gms:google-services:4.2.0.
     Searched in the following locations:
       - https://dl.google.com/dl/android/maven2/com/google/gms/google-services/4.2.0/google-services-4.2.0.pom
       - https://dl.google.com/dl/android/maven2/com/google/gms/google-services/4.2.0/google-services-4.2.0.jar
       - https://jcenter.bintray.com/com/google/gms/google-services/4.2.0/google-services-4.2.0.pom
       - https://jcenter.bintray.com/com/google/gms/google-services/4.2.0/google-services-4.2.0.jar
       - https://maven.fabric.io/public/com/google/gms/google-services/4.2.0/google-services-4.2.0.pom
       - https://maven.fabric.io/public/com/google/gms/google-services/4.2.0/google-services-4.2.0.jar

Seeing the same for 4.1.0.

The same issue for 4.1.0

Could not resolve all artifacts for configuration ':classpath'.
Could not find com.google.gms:google-services:4.1.0.
Searched in the following locations:
- https://dl.google.com/dl/android/maven2/com/google/gms/google-services/4.1.0/google-services-4.1.0.pom
- https://dl.google.com/dl/android/maven2/com/google/gms/google-services/4.1.0/google-services-4.1.0.jar
- https://jcenter.bintray.com/com/google/gms/google-services/4.1.0/google-services-4.1.0.pom
- https://jcenter.bintray.com/com/google/gms/google-services/4.1.0/google-services-4.1.0.jar
- https://maven.fabric.io/public/com/google/gms/google-services/4.1.0/google-services-4.1.0.pom
- https://maven.fabric.io/public/com/google/gms/google-services/4.1.0/google-services-4.1.0.jar
- https://plugins.gradle.org/m2/com/google/gms/google-services/4.1.0/google-services-4.1.0.pom
- https://plugins.gradle.org/m2/com/google/gms/google-services/4.1.0/google-services-4.1.0.jar
Required by:
project :

for nativescripters using nativescript-plugin-firebase check https://github.com/EddyVerbruggen/nativescript-plugin-firebase/issues/1072

Hi @MacNakrub  @danallen88 and @Pitel  was getting the same issue,  according to the documentation the artifact is located on https://dl.bintray.com/android/android-tools/ so I added to the build.gradle maven { url 'https://dl.bintray.com/android/android-tools' } and now it`s working well

Hey all there's an ongoing issue with the Google Maven repo (google() or maven.google.com) so if you're having trouble with your dependencies today, that's the reason.  It doesn't have anything to do with FirebaseUI so please refrain from adding more comments here.

I'm getting this error with google-services 4.2.0 and android gradle plugin 3.3.2

I think mean it should be:
classpath 'com.google.gms:google-services:4.1.0'

Hi, I have the same issue even if I change version to
classpath 'com.google.gms:google-services:4.1.0'
Need Hepl plz !

Change this to
classpath 'com.google.gms:google-services:4.3.2'
work for me

Android studio error: JAVA_LETTER_OR_DIGIT when changed to com.google.gms:google-services:4.3.2


idea: Add op.lister() and make op.list() return Vec<Entry>

The behavior between op.read() and op.list() is not consist.
op.read() returns the content in an easily usable format. However, op.list() returns a Lister object which requires users to work with the stream according to their specific needs, even when they simply want a list of files.
So I think it's a good idea to:

Rename op.list() to op.lister() -> Result<Lister>
Add op.list() -> Resutl<Vec<Entry>> which will read a whole dir's content.
So does for op.scan() -> Result<Vec<Entry>>

Started as a RFC in https://github.com/apache/incubator-opendal/pull/2774


Inline doesn't stay open

I just tested this on the plunker(http://plnkr.co/edit/ZSjN8f?p=preview), but the inline version disappears after a click.

this is how they work. they both disappear.

Sorry I wasn't clear. I know that's how they work as is. I added the option 'inline' to the picker options like this:
            vm.optionsTo = {format: 'DD.MM.YYYY', inline: true};

THAT version disapears and should not.


Title (Page/Tab) to be adapted

The title of Page/Tab should be "ECRIN | Clinical Research Repository"

done


[formrecognizer] deprecate track 1 package after we GA track 2

https://pypi.org/project/azure-cognitiveservices-formrecognizer/

Dup of #13534


Revert InputSelector.cpp until further research

Description
Revert for: #2344 , introduced in https://github.com/trustwallet/wallet-core/pull/2305
How to test
run unit tests
Types of changes

Should fix #2344 will re-open the improvements as a draft for further research

Checklist

[x] Create pull request as draft initially, unless its complete.
[ ] Add tests to cover changes as needed.
[ ] Update documentation as needed.
[ ] If there is a related Issue, mention it in the description.

If you're adding a new blockchain

[ ] I have read the guidelines for adding a new blockchain.

Hello, great.
What happens to these coins that are lost in this bug?
Does it go back to the wallet?
Do I have to do something?

@hewigovens , @Milerius.
Hello, great.
What happens to these coins that are lost in this bug?
Does it go back to the wallet?
Do I have to do something?

@nonomaxxis we will reimburse your loss, 100 DOGE, is that number correct?

@nonomaxxis we will reimburse your loss, 100 DOGE, is that number correct?

Yes that's correct.

Ok, would you like to receive it on DSpDKw6wdnrnxZBtAEn1txYSqPb5uMmxXp or a new address?

Yes, address is correct.

Ok, would you like to receive it on DSpDKw6wdnrnxZBtAEn1txYSqPb5uMmxXp or a new address?

Yes, address is correct.

Done in https://blockchair.com/dogecoin/transaction/ec85672c742810866fc9253ee0fdfaf17109d79d079ab3aaa72716988c15800a?from=trustwallet


Horizontal Pane Splitting puts cursor on incorrect line

Environment
Windows build number: [run `[Environment]::OSVersion` for powershell, or `ver` for cmd]
10.0.19041.0
Windows Terminal version (if applicable):
0.10.781.0
Any other software?
N/A

Steps to reproduce

Open Windows Terminal
Trigger Horizontal pane split

Expected behavior
I expect the pane to be split horizontally with the cursor on the same line as the current directory prompt similar to below screen shot.

Actual behavior
When you do the first horizontal pane split the cursor jumps down a line in the newly opened pane. However, if you split horizontally a second time, the second pane cursor appears correctly. See below gif.

A vertical pane split does not exhibit the same behavior.

GAH that's not great.
Could you share the config for whatever shell you're using? I'm betting that this is due to that first line that's getting printed in your prompt. Clearly the right text is in the buffer (because the third pane you create refreshes the contents of the second pane to be displayed correctly), but maybe we missed a frame or something.
I'd also bet that #5181 either made this way better or worse (see #5291).

So, I'm using ZSH, so do you want the zshrc file I have? I've been using the same zshrc file for quite a while, this only started happening in the last month or 2.

I should clarify, ZSH using Oh My ZSH.

zshrc-bak.txt

Yikes okay, I'm not seeing this on my build with the same .zshrc, but it's entirely possible that the bits from #5181 fixed this, making it hard for me to repro. I'm pulling a 0.10 build now to check if that build will repro this.

Okay I unfortunately can't get this to repro on 0.10.781 either, even with the same zsh config. I'm really hoping that this is just going to go away in 0.11, but since I can't be sure, I think I'm just going to have to stick it in the 1.x milestone.

@zadjii-msft Wanted to let you know. I updated to 0.11.1121.0 and I can no longer replicate this issue. Everything seems to be working correctly again. Thanks for looking into this.

I'm glad to hear it! Thanks for following up on this thread 😄


Exponentiation by squaring tests

looks good 👍

please, put in some description in the first message above ^^^^.
please, move your tests into a separate file.


[Popper] Shadow clipping in Safari

MenuList composition or other Popper related components have shadow clipping in Safari after animation completion.

[x] The issue is present in the latest release.
[x] I have searched the issues of this repository and believe that this is not a duplicate.

Current Behavior 😯

Your Environment 🌎

Tech
Version

Material-UI
v4.9.10

Browser
Safari 13.1

🙈 could it be a rendering issue of Safari? Any idea on how to fix it?

Probably yes, translate3d uses GPU for rendering and mixin GPU based rendering property with CPU based rendering properties was the cause of such issues in the past, but that was long time ago and should be fixed now. I think it needs investigation and need to try different approaches.

@oliviertassinari it's not external dependency. We provide all styles for these components.

I'm encountering this issue as well using a Popper component wrapped by a Fade component. As a temporary workaround, I can remove Fade. If you have ideas for other workarounds that would allow us to keep the transition, I'd love to hear those.
Also I see the external dependency label here. Does that mean this issue is not something you're planning to fix within the library?

The external dependency label is meant to signal that Material-UI is stuck on the resolution of the bug on Safari side. At least, it seems that it's that way that we have no leverage to solve the issue. Does somebody want to report it to WebKit's bug tracker.

@oliviertassinari, @chybisov, @caitecoll, I suppose I fought the solution: you should add position: relative to child that has box-shadow property. Example.

@Norserium thank you, I will try to check it soon.

I can confirm that position: relative solves the issue. However, considering Safari 14.0 was just released and solve the issue, I'm closing.


ACL deny for clients connecting via MQTT_SN

Environment

OS: Alpine 3.5
Erlang/OTP: 19
EMQ: 2.3.1

Description
I am using the emq_auth_pgsql plugin for auth and acl. I have an auth table as follows:

and an acl table as follows:

I have the following emq_auth_pgsql settings
## Authentication Query: select password or password, salt
auth.pgsql.auth_query = select substring(password,'^(?:pbkdf2:sha256:36000\$)(?:.+\$)(.+)$') as password, substring(password,'^(?:pbkdf2:sha256:36000\$)(.+)(?:\$.+)$') as salt from device_deviceauth where device_id='%u'

## ACL Query. Comment this query, the acl will be disabled.
auth.pgsql.acl_query = select allow, ipaddr, device_id as clientid, '%u' as username, access, topic from device_deviceacl where device_id = '%c'

When i connect the client with clientid=123 using mqtt on port 1883 acl and auth work fine. However, when using a mqtt-sn client with the same clientid (that is clientid=123), i can connect successfully, but the acl fails when subscribing the topic.
This is the error message:
12:28:24.177 [error] Client(123@<IP_ADDRESS>:58306): Cannot SUBSCRIBE [{<<"R/123">>,[{qos,1}]}] for ACL Deny
12:28:24.178 [error] gen_fsm <0.1563.0> in state connected terminated with reason: false in emq_sn_gateway:transform/2 line 591
12:28:24.178 [error] CRASH REPORT Process <0.1563.0> with 0 neighbours exited with reason: false in emq_sn_gateway:transform/2 line 591 in gen_fsm:terminate/7 line 559
12:28:24.179 [error] Supervisor emq_sn_gateway_sup had child sn_gateway started with {emq_sn_gateway,start_link,undefined} at <0.1563.0> exit with reason false in emq_sn_gateway:transform/2 line 591 in context child_terminated

I filed an additional issue regarding the crash due to ACL deny ( #1397)
Any idea?

Neither does this work:
auth.pgsql.acl_query = select allow, ipaddr, device_id as clientid, '$all' as username, access, topic from device_deviceacl where device_id = '%c'

My mistake. I changed the order of clientid and username field in the sql query. The correct query is
auth.pgsql.acl_query = select allow, ipaddr, null as username, device_id as clientid, access, topic from device_deviceacl where device_id = '%c'


Pre select first element during search

Is your feature request related to a problem? Please describe.
Very often searching a file takes +10 seconds. However 99% the time the result I search for already appears as the first result very quickly.
So I want to press  to select it. However during a search nothing is pre-selected

So  doesn't work. I have to either wait 10/20 seconds for the search to be over. Or press  then  to select element at the bottom then  to open it.
Describe the solution you'd like
Select the first element during the search so I can just
Is it smart-open or telescope issue ?
Well I think it's telescope behaviour not to select anything during search. But it makes sense for all of their native finders as search is super quick (<1s) even on super large files. And also smart-open already knows what file I know (because of frencency) without scanning everything. So unlike other finders I would like to have a pre selection of first element during search

You can have two keymaps one for cwd and one for all files, and former is very fast.

Having two keymaps for similar things is always annoying because I always mix them up.
Also the problem is not related to using only cwd or not but rather I have a huge repository I work with at work. This repository has a massive build folder when I compile.
The root of the issue was this package is slow because it surprisingly has ignore_file set to false which is IMO a terrible idea. Especially as it wasn't customizable.
https://github.com/danielfalk/smart-open.nvim/pull/80
So when you have a massive .build folder not ignored because ignore=false it's slow.

Yeah this is a telescope behavior as far as I can tell.  It seems to wipe out the selection when more results are added to the picker.  I don't know if there is a fix, but if someone can figure out a way to make this work, that would be great.

The root of the issue was this package is slow because it surprisingly has ignore_file set to false which is IMO a terrible idea. Especially as it wasn't customizable. #80 So when you have a massive .build folder not ignored because ignore=false it's slow.

Let's be civil here now.
Anyway, by default, ripgrep does respect .gitignore, unless I'm missing something.  The only parameters that smart-open adds are,  --files,  --glob-case-insensitive, --line-buffered, --hidden, --ignore-file=<basedir>/.ff-ignore
So, as long as build is in .gitignore, then I would expect this ripgrep command to skip over that directory.  If that's not happening, maybe there's a bug we can take a look at.

Anyway, by default, ripgrep does respect .gitignore, unless I'm missing something

I don't think it does. Take a look at my PR. It sets no_ignore to false by default which is not the case currently (so currently it's doing the equivalent of no_ignore true so it doesn't follow the .git ignore).
Can you test with and without my PR and telling if I'm missing something

bith rg and this plugin indeed skip files in .gitignore by default

Hi, I'm very new to neovim and telescope in general and I think I'm affected by this too, when I just start telescope from my user directory ~.
Does it mean telescope generally can't work from the user directory? Appreciate your guidance! 🙏

There are a lot of files, you can cd to where your project is, then open nvim.


Each time i click on a new video, a new Share button appears

I have only tested this on the 2012 layout, but im guessing that its because only the video and the link changes, so it adds a new share button because usually those would go away.

This also happens on the 2016 theme as well

I have only tested this on the 2012 layout, but im guessing that its because only the video and the link changes, so it adds a new share button because usually those would go away.

I've had this happen a couple times (though not to this extent). Stuff like this is why I've started testing a major rework of the watch page for all layouts. If it goes well, this rework will have completely replaced watch metadata HTML, so the layout won't break anymore. That said, this update may take a while to come out, since it involves reworking a substantial portion of the extension's code.

I bet a YouTube update caused the glitch

So until this is fixed I disabled the extension on my browser.


Chinese translation for readme

add Chinese version of readme :)

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

 All committers have signed the CLA.

Unfortunately we aren't able to maintain this version of the README. Thanks for the contribution.


Invert gradient op

This one should be pretty simple. It would be nice to have an op that acts as the identity function in feedforward, but during backpropagation it propagates the negative of the gradients. This is useful when joining two datasets as it allows for the suppression of features that distinguish between domains. Its referred to as a gradient reversal layer in http://arxiv.org/pdf/1505.07818v4.pdf

You can do it by using stop_gradient --
http://stackoverflow.com/questions/36456436/how-can-i-define-only-the-gradient-for-a-tensorflow-subgraph/36480182#36480182
On Mon, Sep 12, 2016 at 3:58 PM, alexatknit<EMAIL_ADDRESS>wrote:

This one should be pretty simple. It would be nice to have an op that acts
as the identity function in feedforward, but during backpropagation it
propagates the negative of the gradients. This is useful when joining two
datasets as it allows for the suppression of features that distinguish
between domains. Its referred to as a gradient reversal layer in
http://arxiv.org/pdf/1505.07818v4.pdf
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/tensorflow/tensorflow/issues/4342, or mute the thread
https://github.com/notifications/unsubscribe-auth/AABaHODc8-bx34C_YTaS3JOlNbSBK5-Mks5qpdkRgaJpZM4J7Hwx
.

Nice!

Thanks Yaroslav. Closing this out.


Mute audio on unfocus

Add an audio setting to mute the audio on windows unfocus.

Please rebase. After that, I will merge the PR.


[tests] First Github CI trial

Let's try out Github actions instead of Travis because it's pretty slow.
For now, the build is the same to measure speed. We can split it later.

GitHub tests are running in around 2mins instead of 15mins, this is a game changer !

Wow, didn't know that. Nice!
Installing dependencies manually (not from requirements.txt) isn't nice though, is there a reason?

It was the same in the travis build.
numpy and Cython need to be installed before pesq. For the rest, it can be installed from requirements.txt
Yes, gaining 10minutes is really cool !

Then they should be a dependency of pesq, or at least we should put that in the requirements.txt – because anyone trying to install Asteroid will run into the problem of not having these two things installed, right?

The problem is that pesq needs a two-step install. It is in the requirements, but it doesn't install at once. At least, it was the case at the time I wrote the travis build. I'll try tonight if I can get rid of this line

I think the problem is that their list of dependencies is broken, but I think it was fixed in GH master

My previous commit tried to install pesq without install numpy and cython before and it didn't work (as expected).
This problem was fixed in python-pesq's master, so I asked for a new PyPI release with the fix (ref.
In the mean time, I'll do the install by hand in the CI.

@jonashaag, agree to move away from travis?

Definitely! I have to preference at all

What's a bit worrisome with the current CI scripts is that lots of things are hardcoded (requirements, flake8 options, paths to ignore etc.). I'm not sure if there are standard config files where we can put all of these things (pyproject.toml maybe?). Otherwise I suggest creating shell scripts for all of them, or putting everything together in a Makefile. Reason being that you should be able to run all of the CI stuff on your local machine before pushing to GH.

Apparently you can also put some stuff into setup.cfg: https://github.com/django/django/blob/master/setup.cfg
Oh boy this entire Python packaging and CI business is such a mess :-D I'm not an expert in that area unfortunately so I'm not sure what's best practise

I understand your concern. Let's wait until pesq new release and reorganize everything to be ran easier locally before pushing. I'd go with a bash script, yes.

Oh boy this entire Python packaging and CI business is such a mess :-D I'm not an expert in that area unfortunately so I'm not sure what's best practise

I've also read quite a bit about it in the past days but it's not crystal clear either ^^


[📑 Docs]: New Tutorial - Configuring Kafka Schemas using AsyncAPI v3.0

What Dev Docs changes are you proposing?
As part of the 2023 AsyncAPI Mentorship Program, we want to write a Tutorial on configuring Schemas for Kafka using the AsyncAPI Spec 3.0.
Code of Conduct

[X] I agree to follow this project's Code of Conduct

I would like to work on this issue


Run unit tests on Travis-CI

Add config to run ./gradlew test on Travis-CI.
References

https://docs.travis-ci.com/user/languages/android/
https://developer.android.com/studio/test/command-line.html

@npmccallum can you add this to our CI please? Currently it just does ./gradlew build as far as I can see.

Travis CI currently runs this: ./gradlew clean build check test
That should be good enough, no?

How come we don't see that in the output here then?
https://travis-ci.org/freeotp/freeotp-android/jobs/303414023
* I'm not saying you're wrong I just don't get why we're not seeing that?

Huh. I copy and pasted that from a recent test run, but now I can't find it. Is ./gradlew build connectedCheck wrong? Why would Travis CI run that by default?
(I don't know what I'm doing. So I won't pretend I have answers here.)

sounds like a how long is a piece-of-string type question ;)
Here's how long it is
$ ./gradlew -q tasks
Configuration 'compile' in project ':app' is deprecated. Use 'implementation' instead.
Configuration 'testCompile' in project ':app' is deprecated. Use 'testImplementation' instead.

------------------------------------------------------------
All tasks runnable from root project
------------------------------------------------------------

Android tasks
-------------
androidDependencies - Displays the Android dependencies of the project.
signingReport - Displays the signing info for each variant.
sourceSets - Prints out all the source sets defined in this project.

Build tasks
-----------
assemble - Assembles all variants of all applications and secondary packages.
assembleAndroidTest - Assembles all the Test applications.
assembleDebug - Assembles all Debug builds.
assembleRelease - Assembles all Release builds.
build - Assembles and tests this project.
buildDependents - Assembles and tests this project and all projects that depend on it.
buildNeeded - Assembles and tests this project and all projects it depends on.
clean - Deletes the build directory.
cleanBuildCache - Deletes the build cache directory.
compileDebugAndroidTestSources
compileDebugSources
compileDebugUnitTestSources
compileReleaseSources
compileReleaseUnitTestSources
mockableAndroidJar - Creates a version of android.jar that's suitable for unit tests.

Build Setup tasks
-----------------
init - Initializes a new Gradle build.
wrapper - Generates Gradle wrapper files.

Help tasks
----------
buildEnvironment - Displays all buildscript dependencies declared in root project 'freeotp-android'.
components - Displays the components produced by root project 'freeotp-android'. [incubating]
dependencies - Displays all dependencies declared in root project 'freeotp-android'.
dependencyInsight - Displays the insight into a specific dependency in root project 'freeotp-android'.
dependentComponents - Displays the dependent components of components in root project 'freeotp-android'. [incubating]
help - Displays a help message.
model - Displays the configuration model of root project 'freeotp-android'. [incubating]
projects - Displays the sub-projects of root project 'freeotp-android'.
properties - Displays the properties of root project 'freeotp-android'.
tasks - Displays the tasks runnable from root project 'freeotp-android' (some of the displayed tasks may belong to subprojects).

Install tasks
-------------
installDebug - Installs the Debug build.
installDebugAndroidTest - Installs the android (on device) tests for the Debug build.
uninstallAll - Uninstall all applications.
uninstallDebug - Uninstalls the Debug build.
uninstallDebugAndroidTest - Uninstalls the android (on device) tests for the Debug build.
uninstallRelease - Uninstalls the Release build.

Verification tasks
------------------
check - Runs all checks.
connectedAndroidTest - Installs and runs instrumentation tests for all flavors on connected devices.
connectedCheck - Runs all device checks on currently connected devices.
connectedDebugAndroidTest - Installs and runs the tests for debug on connected devices.
deviceAndroidTest - Installs and runs instrumentation tests using all Device Providers.
deviceCheck - Runs all device checks using Device Providers and Test Servers.
lint - Runs lint on all variants.
lintDebug - Runs lint on the Debug build.
lintRelease - Runs lint on the Release build.
lintVitalRelease - Runs lint on just the fatal issues in the release build.
test - Run unit tests for all variants.
testDebugUnitTest - Run unit tests for the debug build.
testReleaseUnitTest - Run unit tests for the release build.

Those are all the things we could do. So I guess it's up to us, but I'd at least like to see our unit tests get run after the investment I made in adding to them :P

so yeah, I'm not entirely convinced that any of the check group of tasks help us in the CI as we have no devices (emulated or otherwise) connected there.

I agree completely that our tests should run. I'm just not sure I understand the difference between a check and a test. If you want to propose a PR for this, I'll ACK it. But I'm not sure I'm much help. (Sorry!)

Ah ok looks like we fell into this default with Travis:
https://docs.travis-ci.com/user/languages/java/#Projects-Using-Gradle
I'll tee up a PR later to customize this build step to run the gradle tasks we're after:
https://docs.travis-ci.com/user/customizing-the-build/#Customizing-the-Build-Step


Feature: Analyze strace output

Application Inspector currently analyzes program source code (and other static assets). Other tools, like Attack Surface Analyzer, examines changes made to an operating system's attack surface. In between the two exists runtime analysis, and tools like procmon and strace.
What if we could analyze the output of one of those tools, filtering out the "noise" to see what an application is doing in terms of syscalls?
As an example, there are many different functions that can be used to write to the file system, but very few syscalls that they all eventually need to route to.
Describe the solution you'd like
The user may run strace while exercising their application, with output piped to a file with a specific name or extension. When Application Inspector runs, it can analyze that file (parse, de-duplicate, filter out false positives) and add those characteristics to the output.
Describe alternatives you've considered
None - The existing functionality may be "enough" as is.
Additional context
There may be significant challenges in filtering out the uninteresting syscalls. For example, given a basic JavaScript file that writes some text to a new file, the strace output includes:
strace -f node test.js 2>&1 | grep open

open("/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3
open("/lib/x86_64-linux-gnu/libdl.so.2", O_RDONLY|O_CLOEXEC) = 3
open("/lib/x86_64-linux-gnu/librt.so.1", O_RDONLY|O_CLOEXEC) = 3
open("/usr/lib/x86_64-linux-gnu/libstdc++.so.6", O_RDONLY|O_CLOEXEC) = 3
open("/lib/x86_64-linux-gnu/libm.so.6", O_RDONLY|O_CLOEXEC) = 3
open("/lib/x86_64-linux-gnu/libgcc_s.so.1", O_RDONLY|O_CLOEXEC) = 3
open("/lib/x86_64-linux-gnu/libpthread.so.0", O_RDONLY|O_CLOEXEC) = 3
open("/lib/x86_64-linux-gnu/libc.so.6", O_RDONLY|O_CLOEXEC) = 3
[pid  1298] open("/dev/urandom", O_RDONLY|O_NOCTTY|O_NONBLOCK) = 9
[pid  1298] open("/etc/resolv.conf", O_RDONLY) = 9
[pid  1298] open("/etc/nsswitch.conf", O_RDONLY) = 9
[pid  1298] open("/dev/urandom", O_RDONLY) = 9
[pid  1298] open("/dev/null", O_RDONLY|O_CLOEXEC) = 9
[pid  1298] open("/mnt/c/tmp/test.js", O_RDONLY|O_CLOEXEC) = 10
[pid  1304] open("mynewfile1.txt", O_WRONLY|O_CREAT|O_APPEND|O_CLOEXEC, 0666) = 10

We might be able to filter based on some attributes present in the strace output (in the case above, perhaps O_WRONLY|O_CREAT|O_APPEND, but I'm sure there will be many scenarios where there won't be enough information to decide. We'd have to do some experimentation here to see how feasible this is.

I think this is possible using the current application inspector.
First gather your stract output in a file.
Next make your strace specific rules for AI.
Scan the strace output with the AI rules.
If we want to directly have somthing like "run this program and gather the strace" I think thats out of scope for AI.


fix: Update the Chinese translation in lr-scheduler.md

Correct a translation error. In previous Chinese edition of lr-scheduler.md, "Factor Scheduler" and "Multi Factor Scheduler" are translated into the same word "多因子调度器" and it might confuse readers before they read the original discourse.

Rewrite several sentences because they were incorrectly or improperly statemented due to machine translation.

Great work @Nietism ! Could you make the minor changes?

Thanks for you suggestion! The previous translating is not good indeed.


Keys

The team has 4 'climbing office' keys.

[x] Track who has keys at the moment
[x] Pass keys from one person to another
[ ] Recipient verifies key exchange

Decided not to add verification of keys - instead an email is sent to both sender and recipient confirming the key was transferred.


Invite base users to the community

Get things started with some users excited about Dragon EMR (Epic) automation

Thanks for joining @eddywilliams

You bet.  I'm looking forward to seeing what we can do here.  I think it has a lot of potential.


Fixed : Custom Auto-Labeling Workflow for GitHub

Pull Request for PyVerse 💡
Fixed #259
Requesting to submit a pull request to the PyVerse repository.

Issue Title
Please enter the title of the issue related to your pull request.
Enter the issue title here.

Auto-Labeling Workflow for GitHub
Info about the Related Issue
Here's a suggested description for your pull request (PR) related to the auto-labeling workflow:

Pull Request Description
Title: Implement Auto-Labeling Workflow for GitHub Issues
Description:
This pull request introduces an automated labeling workflow for GitHub issues. The workflow checks the issue body for mentions of participation roles and applies appropriate labels based on the contributor's involvement in specific open-source programs.
Key Features:

Automatic Labeling: The workflow automatically adds labels to issues when they are opened, reopened, or edited.
Participation Role Detection: It checks for the following roles:

If the issue body contains "GSSOC", the label gssoc-ext is added.
If the issue body contains "Hacktoberfest", the label hacktoberfest-accepted is added.
If both roles are mentioned, both labels are applied.

Console Logging: Clear logs are provided to indicate which labels are being added or if no relevant roles are found.

Benefits:

Enhances contributor engagement by clearly marking contributions based on their participation roles.
Streamlines the labeling process, reducing manual effort for maintainers.
Provides visibility into contributions for both GSSOC and Hacktoberfest participants.

Checklist
Please confirm the following:

[X] My code follows the guidelines of this project.
[X] I have performed a self-review of my own code.
[X] I have commented my code, particularly wherever it was hard to understand.
[X] I have made corresponding changes to the documentation.
[X] My changes generate no new warnings.
[X] I have added things that prove my fix is effective or that my feature works.
[X] Any dependent changes have been merged and published in downstream modules.

@samyak-aditya give me some time I will check the PR and then merge it till then you can work on other issues.

Hey @UTSAVS26 Merge this PR


Gateway registrations are stored on servers by gateway_id

Fixes #3290

I know we discuss on the dev call awhile back that this might be a good candidate to do a database migration for. Any thoughts?

Some tests likely need to change as well

I know we discuss on the dev call awhile back that this might be a good candidate to do a database migration for. Any thoughts?

Ahh yes, I forgot about that! Thanks for the reminder, I'll give that a shot.

This is ready for review, except I'm not sure what strategy we want to use to test the migration. The V0 data uses the same pubkey for node_pub_key and gateway_id:
https://github.com/fedimint/fedimint/blob/b76f0a9459e6387f1be1f7dec3115e7a285c9493/modules/fedimint-ln-server/src/lib.rs#L1435-L1439
...
https://github.com/fedimint/fedimint/blob/b76f0a9459e6387f1be1f7dec3115e7a285c9493/modules/fedimint-ln-server/src/lib.rs#L1512-L1528
So asserting that gateways are keyed by gateway_id in the migration test passes even if the migration doesn't run. I think it would be worth rewriting create_db_with_v0_data() to generate more realistic data. Does this seem reasonable?

So asserting that gateways are keyed by gateway_id in the migration test passes even if the migration doesn't run. I think it would be worth rewriting create_db_with_v0_data() to generate more realistic data. Does this seem reasonable?

When adding a migration, you should create a new test, called create_db_with_v1_data that tests the migration from a "v1 backup", where the V1 backup contains a db backup of the new data.
That said, this is a bit weird, since the database change here is actually backwards compatible, since they're both the same kind of key. Usually the database change would cause the v0 db backup to be invalid, which is not the case for this change. So I would agree that we should change the v0 test to use different keys for node_pub_key and gateway_id.

Do you want to backport to 0.1? Otherwise don't worry about DB migrations.

This PR currently only consists of DB migration code it seems, what's the status here?

Is the main functionality still being worked on?
Do we want migrations? This is only needed if we intend to backport to the v0.1 branch

I think we decided we don't want to backport, so we're going to skip the migration. Apologies for the delay on this one - I've been busy and simply haven't gotten around to removing the migration.

@tvolk131 What is the status of this?

Since we stabilized Fedimint since then we'll need migrations now :see_no_evil:

@tvolk131 What is the status of this?

No update, haven't touched this in a while but I can circle back to it this week!

Since we stabilized Fedimint since then we'll need migrations now 🙈

Ope! Sorry I didn't get around to this sooner! but as Justin mentioned, could be a great test for a simple migration.

Fixed in https://github.com/fedimint/fedimint/pull/4114


Run GCC 11 tests with the most recent language standard

It doesn't look like we're testing with a compiler using up-to-date language standards, and this meant we missed at least one bug recently:
https://github.com/cython/cython/pull/5029.
It seems like the GCC11 tests may as well double as "GCC11 with up-to-date language standards"

So it looks like this exposed one minor incompatibility (std::typeinfo is/has become non-copyable), so shouldn't be merged right now but it's a useful exercise anyway.
I'll follow in the next few days.


tor newnym issue ??

Select your issue type: (check at least one)

[x] Bug
[x] Question
[ ] Suggestion
[ ] Other (please describe):

Hello,
Works perfectly if the correct password could be guessed in the first 10 tries.
After 10 or so tries the TOR consoles startes showin notice : "Rate limiting NEWNYM request: delaying x second(s)".  During this instagram-py keeps trying the same password over and over again.

it happens to me to it sucks

Yeah it happens to me too, but i´m searching methods to speed it up. If I find anything I´ll comment it below


Segmentation fault when running classification exp

Hi,
This Segmentation fault issue appeared every time I run a classification setting (no matter which network is used). Any ideas? It happens when the first epoch is finished.

Hello!
We retried some of our network to make a confirm,and it shows no Segmentation fault at present.Perhaps the following methods can help you:
1.Check if the library version in your environment meets the requirements of requirements.txt
2.We noticed that you used a self-made dataset.You can check if your dataset format is incorrect and if it meets the parameters you provided for the network.
3.If the above methods cannot solve your problem, you can consider replacing the GPU device you are using,which has more graphics memory for example.


Grouping models

It would be useful to be able to organize the models within "groups" in this way:
group Software {
    model Software1 {
        // software 1 field
    }
    model Software2 {
            // software 1 field
    }
}

And in prisma/client such a thing:
prisma.software.software1.findFirst(...)

Hi @karim2012, may we ask more about your use case? Understanding the reasons behind this feature request will help us know how to prioritise this feature request :)
Are you perhaps working in a scenario where you have tables with the same name in different database namespaces/schemas?
If so, may I recommend taking a look at Prisma's multiSchema preview feature?

@jkomyno I tried to understand how multiSchema work but from what I understand they don't do exactly what I meant ...
The grouping I mean is not at the database level, but only at the prism level
Basically following the example of code I wrote above, if you want to get the data from the Software2 table you will have to do it like this:
prisma.software.software1.findMany()
//               ^? This is the name of the group

This way if you have so many tables, you can create these groups that help organize things... imagine if your computer only had the desktop and all the files were inside without being able to create folders... it would be difficult to organize so many files


API responded with status 401!

Undiscord Version
v5.2.1
Browser
Firefox 111.0.1 (64-bit)
Extension
TamperMonkey 4.18.1 2022-11-13
Reproduction steps

Open browser and navigate to discord.com.
Open UnDiscord.
Open a DM you want to wipe/delete.
Filled required boxes to perform wipe. (Author ID, Server ID, Channel ID).
Attempt to delete messages.

Actual results
Started at 4/2/2023, 6:18:31 PM
authorId = "[REDACTED]" guildId = "[REDACTED]" channelId = "[REDACTED]" minId = "[REDACTED]" maxId = "[REDACTED]" hasLink = false hasFile = false
Fetching messages...
Error searching messages, API responded with status 401!
{"message":"401: Unauthorized","code":0}
CoreException {}
Expected results
For it to properly delete my messages.
Bug affects

[X] DMs
[ ] DMs (group)
[ ] Channels
[ ] Channel (NSFW)

Additional information & file uploads
I did manually fill my token after initially encountering this issue, but it did not have any effect on the actual results. I'm at a loss for what's causing this error.*

You might have to manually clear out all of the fields if your browser has autofill enabled. Then, hit "fill token" again.
The problem appears to be that some of the fields, including the hidden by default "message range" ones, are detected as passwords and the browser autofills garbage into them. I'm not sure if this is the problem in your case but this fixed it for me.

Столкнулся с той же проблемой, но нашёл решение. Это всё из-за автозаполнения полей браузером. Чтобы решить проблему, нужно: 1. В окне скрипта, есть вкладка "General", тут нужно нажать me, current, current, чтобы они заполнились. 2. Вкладка "Messages Interval", тут надо стереть всё что браузер сам вписал и оставить поля пустыми. 3. Вкладка "Advanced Settings" тут стираем всё что вписано в поле Authorization token и нажимаем fill. 4. Готово. Можно снова запускать скрипт.

You might have to manually clear out all of the fields if your browser has autofill enabled. Then, hit "fill token" again. The problem appears to be that some of the fields, including the hidden by default "message range" ones, are detected as passwords and the browser auto-fills garbage into them. I'm not sure if this is the problem in your case but this fixed it for me.

@larryqiann That's true, I have faced the same issue, and I found out that some fields were auto-filled. So I disabled auto-fill and cleared all the fields and it worked just fine for me.

Autofilled fix in #631


SDPMVP-17593: Add the variable set for channel creation

The ari package was referencing the wrong version of ARI.
Fixed it to point to the ./.

I don't see any change in the go.mod here

That is correct. No need to be changed the go.mod here.


Licenses for service accounts?

I would like to see information regarding licensing service accounts, so that automated/on-prem services can manipulate data in O365 - such as depositing log files in SharePoint online.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 1f28ec79-1d61-21ae-a11e-b429d32a3346
Version Independent ID: 2f068dd8-b9c9-7266-159a-09b90501c100
Content: Understand subscriptions and licenses in Office 365 for business
Content Source: Office365-Admin/subscriptions-and-billing/subscriptions-and-licenses.md
Service: o365-administration
GitHub Login: @cmcatee-MSFT
Microsoft Alias: cmcatee

@officedocsbot assign @mypil

@RadioActiveLamb - Thank you for submitting feedback.
I will get this issue over to the O365ITPro writing team for investigation.
Thank you for reporting and making the docs better. Much appreciated.
I made a note to request the team to update this when the work is complete.

@RadioActiveLamb Thank you for your feedback. Usually Service accounts  aren't linked to a person, they're used autonomously and only for specific tasks. In these cases you can create an service account without a product license (“Create user without product License” options when creating the account) and assign admin roles as per your requirement. If the Service account needs access to a specific mailbox or a SharePoint site you may need to assign the required licenses for it like you would assign a user. Hope this Helps!
Regards
Sriraman

@RadioActiveLamb - From our understanding, the issue you raised has been answered by msbemba. If you feel it hasn't been answered, please re-open this issue.
Thank you for your contribution to make the docs better! Much appreciated!

@officedocsbot close


Algorithms

A contribution that will help readers to understand all kinds of algorithms and their utility.
Description:
Related issue (if applicable): fixes #
Pull request in home-assistant.io with documentation (if applicable): home-assistant/home-assistant.io#<home-assistant.io PR number goes here>
Example entry for configuration.yaml (if applicable):

Checklist:

[ ] The code change is tested and works locally.
[ ] Local tests pass with tox. Your PR cannot be merged unless tests pass

If user exposed functionality or configuration variables are added/changed:

[ ] Documentation added/updated in home-assistant.io

If the code communicates with devices, web services, or third-party tools:

[ ] New dependencies have been added to the REQUIREMENTS variable (example).
[ ] New dependencies are only imported inside functions that use them (example).
[ ] New or updated dependencies have been added to requirements_all.txt by running script/gen_requirements_all.py.
[ ] New files were added to .coveragerc.

If the code does not interact with devices:

[ ] Tests have been added to verify that the new code works.

Hi @yashrajbharti,
It seems you haven't yet signed a CLA. Please do so here.
Once you do that we will be able to review and accept this pull request.
Thanks!


ENH: New arguments, documentation, and tests for ndimage.binary_opening

Opening a new pull request with a separate feature branch.
binary_opening function has been extended. New arguments have been added at the end. Created a new test to check backward compatibility.
Fixes #7453

@jaimefrio , may I ask you to take a look at this?

All indentation used multiples of 4 spaces before. I thought that was the norm.

Thanks, Aditya! In it goes.

Hi, sorry I'm a bit late with this - it would be good to add .. versionadded:: 1.1.0 to these keywords (example: https://github.com/scipy/scipy/blob/master/scipy/stats/stats.py#L3991)


fix(jsDoc): remove one space indentation on multiple enters after closing jsDoc

This PR fixes #92094

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: AshreneRoy sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.

@AshreneRoy Thanks for looking into this. However I'm not sure this is the correct fix. The file you changed is language agnostic for the most part so we'd like avoid hardcoding jsdoc logic into it.
@rebornix May know more about what the proper fix would

Sure @mjbvz. Would be great if @rebornix could point me to the right approach.

Please let me know if we are waiting for something here @mjbvz @rebornix

Closing as we don't want to add jsdoc specific logic in core. Instead the fix should be somewhere in the JS/TS language configuration:
https://github.com/microsoft/vscode/blob/e8760a5d6c0e09ab692e5b3e414eca018745490f/extensions/typescript-language-features/src/languageFeatures/languageConfiguration.ts#L0-L1
although the linked issue has also [been closed at this point]((https://github.com/microsoft/vscode/issues/92094#issuecomment-707424495) so I'm not sure if this can be fixed with our current APIs

Closing as we don't want to add jsdoc specific logic in core. Instead the fix should be somewhere in the JS/TS language configuration:
https://github.com/microsoft/vscode/blob/e8760a5d6c0e09ab692e5b3e414eca018745490f/extensions/typescript-language-features/src/languageFeatures/languageConfiguration.ts#L0-L1
although the linked issue has also [been closed at this point]((https://github.com/microsoft/vscode/issues/92094#issuecomment-707424495) so I'm not sure if this can be fixed with our current APIs


Add ros2 interface show

ros2 interface show was added.
I hardly use ros2 interface list only. If you want to use it, shall I add the alias?

I hardly use ros2 interface list only. If you want to use it, shall I add the alias?

I guess there is no hard, the more the merrier


v28 localhost download no longer available on ragezone

Hi, would you be able to provide the v28 localhost, since the one on Ragezone is gone? Thanks.

This link should work: https://mega.nz/file/eQBmFQIQ#UkbQDVi6hKdxygh5d2uwtLz5JZ_ViAmJYFd1azgqFv0


create async sql tutorial001 for python3.10

replaced typing.List with list

📝 Docs preview for commit 29695a7a2420bf639f393d203fa4659fc5074181 at: https://0c071d84.fastapitiangolo.pages.dev

import databases?
Is it possible to use standard sqlalchemy.ext.asyncio?

Hi @SXHRYU, thanks for your interest and patience, we already reviewed your PR but it seems this section (https://fastapi.tiangolo.com/how-to/async-sql-encode-databases/) is deprecated now, so I'll leave the final decision to @tiangolo. 🤔

Thanks for the interest! :coffee:
I wanted to re-write the SQL docs with SQLModel, I just finished that here: https://github.com/fastapi/fastapi/pull/12285
The new docs are here: https://fastapi.tiangolo.com/tutorial/sql-databases/
I also plan on adding support and docs for working with async code with SQLModel, and then I'll update the docs here.
Given that, I'll pass on this one, but thanks for the effort! :cake:


feat: add url shortener

The deploy instructions will be added later.

I guess the instructions for creating Fauna's DB schema will follow, maybe? I'm looking forward to seeing it!


Commenting out some failing unit tests to test code coverage badge.

 DO NOT APPROVE.
Commenting out some failing unit tests to test code coverage badge.
Issues Resolved
[List any issues this PR will resolve]
Check List

[ ] New functionality includes testing.

[ ] All tests pass

[ ] New functionality has been documented.

[ ] New functionality has javadoc added

[ ] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Codecov Report

:exclamation: No coverage uploaded for pull request base (main@fb560ba). Click here to learn what that means.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main       #4   +/-   ##
=======================================
  Coverage        ?   44.92%
=======================================
  Files           ?      199
  Lines           ?     4632
  Branches        ?      585
=======================================
  Hits            ?     2081
  Misses          ?     2549
  Partials        ?        2

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update fb560ba...c04a68f. Read the comment docs.


Voice messages unique cases

Add support for parse cases with low prevalence (>20) if they're acquired from voice message.

Done here.