Extending the Exceptionless language support to Java

I previously contacted the exceptionless developers about upcoming language support and they informed me that the next project will probably be Java.
I find this project an awesome piece of software so I wanted to contribute to the new client.
This issue should start a conversation about the future Java client of this software.
As a discussion starter I would like to ask the following questions:

Since Java does not support extension methods how would you use the ExceptionLess client?
What other parts of the current client need to be changed due to language restrictions in Java?`

I hope we'll find some people who are willing to contribute in any way!
Lukas

I think the best approach would be to do what we do for the JavaScript client for event submission if there is no extension method support (https://github.com/exceptionless/Exceptionless.JavaScript/wiki/Sending-Events). I wonder what it would take to just do a port of our .NET PCL (or JavaScript) client to Java.. I think if we could port our .NET client that would be the best but I'm not sure on all the limitations. Could you look into this?
Going forward, if you wanted to take the lead on this. Would you like me to create the repo and then you could fork it?

I'd be more than happy to meet up with you and talk it over as well.

I think this would be a good approach. I will look into this but I am quite positive that we can recreate most of the functionality except the features using extension methods.
I think creating a repo would be a nice start.

I've created a repo if you want to create a fork and work on it: https://github.com/exceptionless/Exceptionless.Java I'd start by porting the C# client over and try to keep as close as you can. We really appreciate this and will help out where we can!

I'm closing this as we've created a java repo that we can create issues on :).

@xbelt I'm checking in to see if you needed any assistance getting the Java client going or if you've had any luck.

@niemyjski University has kept me very busy the last few month so I could not get much work done but I hope I'll have more time to work on this project in the near future.

@xbelt Thanks for the update. I hope you do well in your studies.

@niemyjski Did this ever get published?

@scottcate nope, we are still accepting pull requests for a Java client, our api is super simple to use. Would you be interested in contributing one?

Probably not, a friend was asking for one. I don't have the skill set required to help.

We'd really like to have one, it just comes down to resources


Improve commentary; reuse code in stream transport tests.

Netty4StreamTransport is a bit dense, so this is an initial attempt to clarify
it somewhat.
The directionality in the bidirectional stream was easy to lose track of --
I've renamed LocalMsg and RemoteMsg to SendMsg and RecvMsg
respectively; and the method names write and admitRemote have been renamed
send and recv.
The stream recvs RecvMsgs from the remote and sends SendMsgs from the
local side of the stream.
I've tried to add commentary around Netty4StreamTransport's internal state
machine.  In trying to clarify this, I improved the scoping of the RecvMsg
promise by removing it from the instance scope and protecting it within the
RemotePending remote state.
Finally, I've extracted a bunch of common code from within
Netty4StreamTransportTest so the tests are easier to read.

https://github.com/BuoyantIO/linkerd/commit/9fe3c4d8791d1f7f9779486578ad050bd3c61158


CMake support

This file helps to include C++/WinRT library in a CMake project.
For documentation see comments in the file.

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: janosvitok sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.

Thanks for the suggestion! We'll keep it in mind, however we are not in a position to take source code submissions just yet.


feat(diagnostics): Add tokio-console support to zebrad

Motivation
We want to find out why Zebra is slow to sync, so we need to see what its async tasks are doing.
Depends-On: #4517
Close #2112
This is part of fixing the high priority ticket #4456.
API Specifications
Integration instructions:
https://github.com/tokio-rs/console/blob/main/console-subscriber/README.md#getting-started
tokio-console requires per-layer filtering:
https://docs.rs/tracing-subscriber/latest/tracing_subscriber/layer/index.html#per-layer-filtering
https://docs.rs/tracing-subscriber/latest/tracing_subscriber/registry/struct.Registry.html
Designs
Add tokio-console as an optional dependency, enabled by the tokio-console feature.
Add the console layer to the existing tracing layer stack, making the required changes to the rest of the stack.
Instructions
Compile and launch zebrad with these compile-time configs:
RUSTFLAGS="--cfg tokio_unstable" cargo build --release --no-default-features --features="tokio-console" --bin zebrad
target/release/zebrad

Then in another terminal:
cargo install --locked tokio-console
tokio-console

Solution

Add optional tokio-console support

Use a tracing Registry for tokio-console, and a fmt::Subscriber if it is not enabled

Features & Dependencies:

Add the tokio-console feature and dependencies
Always activate tokio/tracing feature in production
Always activate all tokio features in tests

Refactoring:

Refactor tracing-subscriber init to simplify it

Diagnostics:

Log the installed tracing layers at info level, after tracing is initialised

Review
Anyone can review this PR, I'm not sure who is most familiar with tracing or async executors.
This might need a review call.
Reviewer Checklist

[ ] Code implements Specs and Designs
[ ] Existing tests pass

Follow Up Work
See PR #4539 for a list of follow-up work.
Out of scope:

Work out why this change enables some debug logs (it's not meant to, but it's a developer tool, so it doesn't matter)

I marked this as a high priority for review, because it increases the sync speed

@Mergifyio update

For future follow-up https://github.com/tokio-rs/tracing/tree/master/tracing-opentelemetry

@oxarbitrage did you want to do a review call for this PR, or did you want to hand the review to someone else?

* When I enable it and run it, a get a lot of TRACE messages though I'm using the default logging (`info`), e.g.
  ```
   2022-06-07T23:02:49.902673Z TRACE {zebrad="0be50cc" net="Main"}:sync:try_to_sync: zebrad::components::sync: waiting for pending blocks tips.len=1 in_flight=2013 lookahead_limit=2000 state_tip=Some(Height(105626))
  ```

I think I must have set up the logging filters wrong (on tracing_subscriber::fmt::Layer):
https://github.com/ZcashFoundation/zebra/pull/4519/files#diff-f3a497bdec8cf6c584ff806e24fe9e531a24cf8d8ef0fa09a57b42238e76a837R65-R72
I'll see if I can fix that quickly today, it's something that should work!

* `tokio-console` [docs](https://github.com/tokio-rs/console#instrumenting-your-program) mention
  > if you are manually configuring the tracing subscriber using the [EnvFilter](https://docs.rs/tracing-subscriber/latest/tracing_subscriber/filter/struct.EnvFilter.html) or [Targets](https://docs.rs/tracing-subscriber/latest/tracing_subscriber/filter/targets/struct.Targets.html) filters...

  However this PR does not seem to do that, but it works. Do you know why? If I try to add that filter to the Zebra config it logs a lot of stuff to the terminal, which is not what we want. I guess I'm confused about the relationship between tracing & logging.

The PR calls console_subscriber::spawn(), which automatically adds the correct per-layer filter to the tokio-console layer:
https://docs.rs/console-subscriber/latest/console_subscriber/fn.spawn.html
(We're not using EnvFilter or Targets to set up that layer.)

I think I must have set up the logging filters wrong (on tracing_subscriber::fmt::Layer): https://github.com/ZcashFoundation/zebra/pull/4519/files#diff-f3a497bdec8cf6c584ff806e24fe9e531a24cf8d8ef0fa09a57b42238e76a837R65-R72
I'll see if I can fix that quickly today, it's something that should work!

OK!

The PR calls console_subscriber::spawn(), which automatically adds the correct per-layer filter to the tokio-console layer: https://docs.rs/console-subscriber/latest/console_subscriber/fn.spawn.html
(We're not using EnvFilter or Targets to set up that layer.)

Got it, thanks! For some reason I assumed  spawn() counted as "manually configured"

* When I enable it and run it, a get a lot of TRACE messages though I'm using the default logging (`info`), e.g.

2022-06-07T23:02:49.902673Z TRACE {zebrad="0be50cc" net="Main"}:sync:try_to_sync: zebrad::components::sync: waiting for pending blocks tips.len=1 in_flight=2013 lookahead_limit=2000 state_tip=Some(Height(105626))

I think I must have set up the logging filters wrong (on tracing_subscriber::fmt::Layer):
https://github.com/ZcashFoundation/zebra/pull/4519/files#diff-f3a497bdec8cf6c584ff806e24fe9e531a24cf8d8ef0fa09a57b42238e76a837R65-R72
I'll see if I can fix that quickly today, it's something that should work!

The logging filters are correct, but a few functions (crawl_and_dial, try_to_sync) seem to evade the layer filter and the global span.
Since this only happens with the tokio-console feature, I added a TODO to fix it later.
(It might be a tracing_subscriber bug.)

This worked fine in the last CI run, and I just added a TODO and a minor cleanup.
So I'm going to admin-merge this PR.


chore: add factorypath to gitignore

This was missing inside the .gitignore. The gitignore seems kinda small, have you thought about simply adding something like this https://www.toptal.com/developers/gitignore/api/java,visualstudiocode,eclipse,intellij,maven,gradle ?

Hi @MartinWitt !
Thanks for your PR. I assume .factorypath is for development on Eclipse?

gitignore seems kinda small, have you thought about simply adding something like this https://www.toptal.com/developers/gitignore/api/java,visualstudiocode,eclipse,intellij,maven,gradle

I always add globs to .gitignore when I know I want to ignore them. For example, templates also ignore the jar files but in #696 we need the sonar-java.jar to execute as a sonar-lint plugin. Of course, this is one exceptional case, but I feel the generic .gitignores are more verbose than they need to be.

I assume .factorypath is for development on Eclipse?

From my understanding, the eclipse compiler generates these because vscode has no more resource files inside the project folder.  In short it appears during my development.


Configure PDF export from the document

Description
As part of #2942 first PDF/A support landed. But the exported PDF standard can only be controlled through the CLI. I would like to configure my document as PDF/A from inside the document.
Maybe something like
#pdf_standard("A2-b")

or even a list like the CLI supports.
This could just be ignored by PNG/SVG export.
Use Case
Some documents will only make sense as PDF/A like electronic invoices with file embeddings.

I think it makes sense to either have it completely controlled by CLI or completely controlled from within the document (which is what Latex does, I think), but having both would seem kind of weird to me.

In my opinion this makes more sense as a CLI flag

This doesn't really seem viable considering Typst's current model, where World implementations are given a good degree of freedom to manipulate the laid out document in various ways. (Although I guess target information might be exposed in the future depending on the outcome of https://github.com/typst/typst/issues/4174#issuecomment-2165246219 , but that's still just informative and not enforced, and can be arbitrarily manipulated by the World implementation.)
At most, it could be an assertion such as assert(target().type == pdf and target().standard == "A-2b"), but that would depend on exposing target information as outlined above.

To elaborate on the use case: Electronic invoices might fail to export with PDF/A-2. They need to contain file embeddings that require PDF/A-3. In cases like this, the document knows it can only compile for certain specifications and could communicate that to the compiler/exporter.
I see your point though about it being weird to configure through both, CLI options and the document.
Thank you for linking #4174. That could allow to skip the file embedding in cases where the document knows it would fail the export. But the result would not be an electronic invoice (still better than no PDF at all in some cases I guess).

After thinking about this more, I will close the issue.
Configuration through both, the Typst file and the CLI/editor/tool, is really strange. For the use case of e-invoices it seems enough to configure the right export through the tooling. Especially if we get something like #4174 to optionally prevent compilation failures for other exports.


Vitest workspace run doesn't pick .env from individual projects

Describe the bug
I have a monorepo with different projects in packages/*, when we run vitest inside of this packages the .env.{mode} it's picked correctly, but when running in the root of the monorepo, 0 variables are caught.
We have a vitest.workspace.mts file in the root with the following:
export default ["packages/*", "apps/*"];

We define the vitest.config.ts in the packages/ like this:
import tsconfigPaths from "vite-tsconfig-paths";
import { defineProject } from "vitest/config";

export default defineProject({
  envPrefix: ["SHERPAS_", "DATABASE_", "FLY_", "PRIMARY_"],
  plugins: [
    tsconfigPaths({
      root: "../..",
    }),
  ],
  test: {
    hookTimeout: 20_000,
    exclude: [
      "node_modules",
      "dist",
      ".idea",
      ".git",
      ".cache",
      "src/tests/**/*.{ts,tsx}",
    ],
    environment: "jsdom",
  },
});

Initially created as discussion here: #5446
Reproduction
stackblitz.com/edit/vitest-dev-vitest-pxuer9?file=packages%2Flib1%2F.env.test
System Info
System:
    OS: macOS 14.0
    CPU: (10) arm64 Apple M2 Pro
    Memory: 72.27 MB / 16.00 GB
    Shell: 5.9 - /bin/zsh
  Binaries:
    Node: 20.11.1 - ~/Library/Caches/fnm_multishells/70491_1711450154965/bin/node
    npm: 10.2.4 - ~/Library/Caches/fnm_multishells/70491_1711450154965/bin/npm
    pnpm: 8.15.5 - ~/Library/pnpm/pnpm
    bun: 1.0.0 - ~/.bun/bin/bun
  Browsers:
    Chrome: 123.0.6312.86
    Safari: 17.0
  npmPackages:
    vitest: ^1.4.0 => 1.4.0

Used Package Manager
pnpm
Validations

[X] Follow our Code of Conduct
[X] Read the Contributing Guidelines.
[X] Read the docs.
[X] Check that there isn't already an issue that reports the same bug to avoid creating a duplicate.
[X] Check that this is a concrete bug. For Q&A open a GitHub Discussion or join our Discord Chat Server.
[X] The provided reproduction is a minimal reproducible example of the bug.

I've tried to fix it but no luck.. there's one moment that env empties and couldn't follow where is deleted/lost.
While this issue gets fixed -- no hurry. There' a workaround using dotenv-flow:
In the vitest|vite.config.m|ts file just put that, and will load the variables correctly from the root or inside the package.
import dotenvFlow from "dotenv-flow";
const env = dotenvFlow.config({ path: import.meta.dirname });

The underlying issue might be same as https://github.com/vitest-dev/vitest/issues/5016. Manually loading dotenv should be a good workaround.
To avoid mixing different environment variables from multiple projects, it might be better to load it during setupFiles, which is what I suggested in https://github.com/vitest-dev/vitest/discussions/5003#discussioncomment-8187275


Update it

Updated italian translations up to 19.50 (2020-07-13)

Hi,
Thanks for your contribution!
It wouldn't work, unless strings from it.auto files are removed. Please revise it.auto file and add this to this PR.

@iliarostovtsev done!

Great! Thank you!


Crown Snapchat Filter

Is your feature request related to a problem? Please describe.
Want to apply a "Crown Snapchat Filter" on an image.
Describe the solution you'd like
Using python libraries to Implement a "Crown Snapchat Filter". ( OpenCV, Matplotlib)
Output

Hi this is not required in this repo it is already available


Presetting text programatically loses padding

I am trying to preset some text in JVFloatLabeledTextField on controller's viewDidLoad. As soon as i try to edit the textfield it becomes normal. Please find attached screenshot. FYI : I am using autoresizing with XIB.

Set textfield text in viewDidAppear
-(void)viewDidAppear:(BOOL)animated {
    [super viewDidAppear:animated];
    textField.text     = @"Testing"];
}

or
dispatch_async(dispatch_get_main_queue(), ^{
textField.text     = @"Testing"];
});

Thanks a lot man!
Sincerely,
*Pratik Gujarati *(CEO & Founder)
Innovative Iteration Software Solutions
TF - 410, Marvella Corridor, Near Bhagwan Mahavir College, V.I.P Road,
Vesu, Surat - 395007
Tel : +91<PHONE_NUMBER> | www.innovativeiteration.com | Skype :
innovative_iteration, pratik_gujarati
[image: Facebook] https://www.facebook.com/innovativeiteration/  [image:
Google Plus] https://plus.google.com/u/0/104136065470067947955/posts  [image:
Find Us]
https://www.google.co.in/maps/place/Innovative+Iteration+Software+Solutions/@21.143376,72.789561,15z/data=!4m2!3m1!1s0x0:0x8fba9958f0bd9a05?sa=X&ved=0ahUKEwjx2N_E_vjKAhUGBY4KHRnjAngQ_BIIVzAK
On Fri, Sep 1, 2017 at 3:03 PM, Rajkumar<EMAIL_ADDRESS>wrote:

Set textfield text in viewDidAppear
-(void)viewDidAppear:(BOOL)animated {
[super viewDidAppear:animated];
textField.text     = @"Testing"];
}
or
dispatch_async(dispatch_get_main_queue(), ^{
textField.text     = @"Testing"];
});
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/jverdi/JVFloatLabeledTextField/issues/174#issuecomment-326535968,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AdoT6KJ_kgpJxcwbrwu7qABFSSOT4hYgks5sd89ggaJpZM4O43of
.

I tried both suggestions but it didn't work. Any more idea ?


[WIP] tools/deploy script for interfacing with the bot server.

Sample session:
$ cd  ~/Documents/gitclones/python-zulip-api
$ source zulip-api-py3-venv/bin/activate
$ tools/deploy prepare c-four -p zulip_bots/zulip_bots/bots/connect_four -c ~/Documents/zulip/tworc -m connect_four.py -s $SERVER -k $KEY
pack: Created zip file at: .bots/c-four.zip.
upload: Uploaded the bot package to botfarm.
clean: Removed .bots/c-four.zip.
process: The bot has been processed by the botfarm.
$ tools/deploy prepare hello -p zulip_bots/zulip_bots/bots/helloworld -c ~/Documents/temp/zulip/onerc -m helloworld.py -s $SERVER -k $KEY
pack: Created zip file at: .bots/hello.zip.
upload: Uploaded the bot package to botfarm.
clean: Removed .bots/hello.zip.
process: The bot has been processed by the botfarm.
$ tools/deploy --server $SERVER --key $KEY stop test
stop: The bot has been stopped by the botfarm.
$ tools/deploy --server $SERVER --key $KEY start hello
start: The bot has been started by the botfarm.
$ tools/deploy --server $SERVER --key $KEY start c-four
start: The bot has been started by the botfarm.

Testing Instructions
1. Fetch this PR.
git fetch origin pull/337/head:deploy
git checkout deploy

2. Getting Deployment Key Go to https://nightly.zulipdev.org and login using GitHub, followed by copying the API key there, and closing the page. Apologies for the crude interface. I'm pretty sure there are some bugs in there as well, and I'll be refining it as we go on.
3. Environment Setup On your local terminal,
export KEY="your-copied-key-here"
export SERVER="https://nightly.zulipdev.org"

### 4. **Deployment** - Now, for deployment, first we need to *prepare* a bot. That involves installing its dependencies and making its docker image and this process can take some time. Sample command for preparing the bot:

tools/deploy --server $SERVER --key $KEY prepare my-bot-name
--path zulip_bots/zulip_bots/bots/helloworld
--config ~/Downloads/zuliprc
--main helloworld.py

This command, if successful, should give an output akin to:

pack: Created zip file at: .bots/hello.zip.
upload: Uploaded the bot package to botfarm.
clean: Removed .bots/hello.zip.
process: The bot has been processed by the botfarm.

### 5. **Starting and stopping the bot** - use the bot name you just specified above for these commands:

tools/deploy --server $SERVER --key $KEY start my-bot-name
tools/deploy --server $SERVER --key $KEY stop my-bot-name

PM me/message on https://chat.zulip.org/#narrow/stream/127-integrations/topic/botfarm regarding testing and any bugs you find.

Merged!  Thanks @aero31aero!


Train script hangs with no errors

root@spot-a100-1670595978:/app# python3 train.py --config config/train_cord.yaml --pretrained_model_name_or_path
 "naver-clova-ix/donut-base" --dataset_name_or_paths "['/app/jsonl']" --exp_version "abay_experiment"

resume_from_checkpoint_path: None
result_path: ./result
pretrained_model_name_or_path: naver-clova-ix/donut-base
dataset_name_or_paths:
  - /app/jsonl
sort_json_key: False
train_batch_sizes:
  - 8
val_batch_sizes:
  - 1
input_size:
  - 1280
  - 960
max_length: 768
align_long_axis: False
num_nodes: 1
seed: 2022
lr: 3e-05
warmup_steps: 300
num_training_samples_per_epoch: 800
max_epochs: 30
max_steps: -1
num_workers: 8
val_check_interval: 1.0
check_val_every_n_epoch: 3
gradient_clip_val: 1.0
verbose: True
exp_name: train_cord
exp_version: abay_experiment
Config is saved at result/train_cord/abay_experiment/config.yaml
/usr/local/lib/python3.8/dist-packages/pytorch_lightning/utilities/seed.py:48: LightningDeprecationWarning: `pytorch_lightning.utilities.seed.seed_everything` has been deprecated in v1.8.0 and will be removed in v1.10.0. Please use `lightning_lite.utilities.seed.seed_everything` instead.
  rank_zero_deprecation(
Global seed set to 2022
/usr/local/lib/python3.8/dist-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3190.)
  return _VF.meshgrid(tensors, **kwargs)  # type: ignore[attr-defined]
Some weights of DonutModel were not initialized from the model checkpoint at naver-clova-ix/donut-base and are newly initialized because the shapes did not match:
- encoder.model.layers.0.blocks.1.attn_mask: found shape torch.Size([3072, 100, 100]) in the checkpoint and torch.Size([768, 100, 100]) in the model instantiated
- encoder.model.layers.1.blocks.1.attn_mask: found shape torch.Size([768, 100, 100]) in the checkpoint and torch.Size([192, 100, 100]) in the model instantiated
- encoder.model.layers.2.blocks.1.attn_mask: found shape torch.Size([192, 100, 100]) in the checkpoint and torch.Size([48, 100, 100]) in the model instantiated
- encoder.model.layers.2.blocks.3.attn_mask: found shape torch.Size([192, 100, 100]) in the checkpoint and torch.Size([48, 100, 100]) in the model instantiated
- encoder.model.layers.2.blocks.5.attn_mask: found shape torch.Size([192, 100, 100]) in the checkpoint and torch.Size([48, 100, 100]) in the model instantiated
- encoder.model.layers.2.blocks.7.attn_mask: found shape torch.Size([192, 100, 100]) in the checkpoint and torch.Size([48, 100, 100]) in the model instantiated
- encoder.model.layers.2.blocks.9.attn_mask: found shape torch.Size([192, 100, 100]) in the checkpoint and torch.Size([48, 100, 100]) in the model instantiated
- encoder.model.layers.2.blocks.11.attn_mask: found shape torch.Size([192, 100, 100]) in the checkpoint and torch.Size([48, 100, 100]) in the model instantiated
- encoder.model.layers.2.blocks.13.attn_mask: found shape torch.Size([192, 100, 100]) in the checkpoint and torch.Size([48, 100, 100]) in the model instantiated
- encoder.model.layers.3.blocks.1.attn_mask: found shape torch.Size([48, 100, 100]) in the checkpoint and torch.Size([12, 100, 100]) in the model instantiated
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
Resolving data files: 100%|████████████████████████████████████████████████████████████| 16197/16197 [00:00<00:00, 27669.39it/s]
Resolving data files: 100%|██████████████████████████████████████████████████████████████| 2001/2001 [00:00<00:00, 13913.31it/s]
Resolving data files: 100%|██████████████████████████████████████████████████████████████| 1801/1801 [00:00<00:00, 14983.16it/s]
Using custom data configuration jsonl-9ae412abd68dd439
Found cached dataset imagefolder (/root/.cache/huggingface/datasets/imagefolder/jsonl-9ae412abd68dd439/0.0.0/37fbb85cc714a338bea574ac6c7d0b5be5aff46c1862c1989b20e0771199e93f)

Just hangs here, nothing happens

This is what I see after interrupt:
^CTraceback (most recent call last):
  File "train.py", line 149, in <module>
    train(config)
  File "train.py", line 87, in train
    sort_json_key=config.sort_json_key,
  File "/app/donut/donut/util.py", line 86, in __init__
    for gt_json in gt_jsons  # load json from list of json
  File "/app/donut/donut/util.py", line 86, in <listcomp>
    for gt_json in gt_jsons  # load json from list of json
  File "/app/donut/donut/model.py", line 514, in json2token
    + fr"</s_{k}>"
  File "/app/donut/donut/model.py", line 519, in json2token
    [self.json2token(item, update_special_tokens_for_json_key, sort_json_key) for item in obj]
  File "/app/donut/donut/model.py", line 519, in <listcomp>
    [self.json2token(item, update_special_tokens_for_json_key, sort_json_key) for item in obj]
  File "/app/donut/donut/model.py", line 510, in json2token
    self.decoder.add_special_tokens([fr"<s_{k}>", fr"</s_{k}>"])
  File "/app/donut/donut/model.py", line 205, in add_special_tokens
    newly_added_num = self.tokenizer.add_special_tokens({"additional_special_tokens": sorted(set(list_of_tokens))})
  File "/root/anaconda3/envs/donut_official/lib/python3.7/site-packages/transformers/tokenization_utils_base.py", line 928, in add_special_tokens
    added_tokens += self.add_tokens(value, special_tokens=True)
  File "/root/anaconda3/envs/donut_official/lib/python3.7/site-packages/transformers/tokenization_utils_base.py", line 985, in add_tokens
    return self._add_tokens(new_tokens, special_tokens=special_tokens)
  File "/root/anaconda3/envs/donut_official/lib/python3.7/site-packages/transformers/tokenization_utils.py", line 445, in _add_tokens
    self._create_trie(self.unique_no_split_tokens)
  File "/root/anaconda3/envs/donut_official/lib/python3.7/site-packages/transformers/tokenization_utils.py", line 455, in _create_trie
    trie.add(token)
  File "/root/anaconda3/envs/donut_official/lib/python3.7/site-packages/transformers/tokenization_utils.py", line 86, in add
    ref[char] = char in ref and ref[char] or {}
KeyboardInterrupt

I tried to downgrade to 1.0.8 same issue @gwkrsrch

Another interrupt:
^CTraceback (most recent call last):
  File "train.py", line 149, in <module>
    train(config)
  File "train.py", line 87, in train
    sort_json_key=config.sort_json_key,
  File "/app/donut/donut/util.py", line 86, in __init__
    for gt_json in gt_jsons  # load json from list of json
  File "/app/donut/donut/util.py", line 86, in <listcomp>
    for gt_json in gt_jsons  # load json from list of json
  File "/app/donut/donut/model.py", line 516, in json2token
    + fr"</s_{k}>"
  File "/app/donut/donut/model.py", line 521, in json2token
    [self.json2token(item, update_special_tokens_for_json_key, sort_json_key) for item in obj]
  File "/app/donut/donut/model.py", line 521, in <listcomp>
    [self.json2token(item, update_special_tokens_for_json_key, sort_json_key) for item in obj]
  File "/app/donut/donut/model.py", line 512, in json2token
    self.decoder.add_special_tokens([fr"<s_{k}>", fr"</s_{k}>"])
  File "/app/donut/donut/model.py", line 207, in add_special_tokens
    self.model.resize_token_embeddings(len(self.tokenizer))
  File "/app/donut/venv/lib/python3.7/site-packages/transformers/modeling_utils.py", line 1238, in resize_token_embeddings
    model_embeds = self._resize_token_embeddings(new_num_tokens)
  File "/app/donut/venv/lib/python3.7/site-packages/transformers/modeling_utils.py", line 1253, in _resize_token_embeddings
    new_embeddings = self._get_resized_embeddings(old_embeddings, new_num_tokens)
  File "/app/donut/venv/lib/python3.7/site-packages/transformers/modeling_utils.py", line 1307, in _get_resized_embeddings
    new_embeddings = nn.Embedding(new_num_tokens, old_embedding_dim)
  File "/app/donut/venv/lib/python3.7/site-packages/torch/nn/modules/sparse.py", line 142, in __init__
    self.reset_parameters()
  File "/app/donut/venv/lib/python3.7/site-packages/torch/nn/modules/sparse.py", line 151, in reset_parameters
    init.normal_(self.weight)
  File "/app/donut/venv/lib/python3.7/site-packages/torch/nn/init.py", line 155, in normal_
    return _no_grad_normal_(tensor, mean, std)
  File "/app/donut/venv/lib/python3.7/site-packages/torch/nn/init.py", line 19, in _no_grad_normal_
    return tensor.normal_(mean, std)
KeyboardInterrupt

Looks like getting stuck recursively parsing the tokens?

After running all night:
^CTraceback (most recent call last):
  File "train.py", line 149, in <module>
    train(config)
  File "train.py", line 87, in train
    sort_json_key=config.sort_json_key,
  File "/app/donut/donut/util.py", line 86, in __init__
    for gt_json in gt_jsons  # load json from list of json
  File "/app/donut/donut/util.py", line 86, in <listcomp>
    for gt_json in gt_jsons  # load json from list of json
  File "/app/donut/donut/model.py", line 516, in json2token
    + fr"</s_{k}>"
  File "/app/donut/donut/model.py", line 521, in json2token
    [self.json2token(item, update_special_tokens_for_json_key, sort_json_key) for item in obj]
  File "/app/donut/donut/model.py", line 521, in <listcomp>
    [self.json2token(item, update_special_tokens_for_json_key, sort_json_key) for item in obj]
  File "/app/donut/donut/model.py", line 512, in json2token
    self.decoder.add_special_tokens([fr"<s_{k}>", fr"</s_{k}>"])
  File "/app/donut/donut/model.py", line 205, in add_special_tokens
    newly_added_num = self.tokenizer.add_special_tokens({"additional_special_tokens": sorted(set(list_of_tokens))})
  File "/app/donut/venv/lib/python3.7/site-packages/transformers/tokenization_utils_base.py", line 928, in add_special_tokens
    added_tokens += self.add_tokens(value, special_tokens=True)
  File "/app/donut/venv/lib/python3.7/site-packages/transformers/tokenization_utils_base.py", line 985, in add_tokens
    return self._add_tokens(new_tokens, special_tokens=special_tokens)
  File "/app/donut/venv/lib/python3.7/site-packages/transformers/tokenization_utils.py", line 445, in _add_tokens
    self._create_trie(self.unique_no_split_tokens)
  File "/app/donut/venv/lib/python3.7/site-packages/transformers/tokenization_utils.py", line 455, in _create_trie
    trie.add(token)
  File "/app/donut/venv/lib/python3.7/site-packages/transformers/tokenization_utils.py", line 86, in add
    ref[char] = char in ref and ref[char] or {}
KeyboardInterrupt

Yeah, looks like stop in infinite loop

I think I figured it out: Every json key considered to be a special token. So it spends long time doing the Trie.add in slow python code (probably use HuggingFace's fast tokenizer?). In my case every key is unique so this approach will not work, I think documentation should reflect the limitations of the acceptable json structures. I will restructure my json dataset and try training again.

Yep, after restructuring my json it's training. Tokenization still takes couple minutes though.

Hey @abaybektursun . So are you saying that, we cannot keep many fields in the gt_parses json object? Please help as my training has also hung up.


Rename motion to pundle, use just Pundle cli

This will be way clearer to everyone but us, and should make it much easier to explain and document for beta.

What about create-react-pundle-app?  Then, it could be used by yarn create

@appsforartists That's an excellent idea! Will also allow people to have project-specific pundle versions by default. Going with that

Done!
Pending on a release but the change itself is done


refactor(Client): Separate api and client modules

Description

The client module contains the new Argilla class (old Api)
The api module set up the main argilla functions like load and log.

Even if both modules shares docstring and method signature, I prefer to handle them separately. This will simplify when argilla client instances are exposed for better integrations.
Closes #2194
Type of change
Checklist

[x] I have merged the original branch into my forked branch
[ ] I added relevant documentation
[x] follows the style guidelines of this project
[x] I did a self-review of my code
[ ] I added comments to my code
[x] I made corresponding changes to the documentation
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works

@davidberenstein1957
Could you test locally that changes fix your IDE problems, please?

works like a charm 🪬


Iconlaunch - Cache apps for faster startup

Great - thanks! How much difference does that make?

Scanning 40 apps has gone from 1.5 seconds to under 0.5 seconds when the cache is used.

Great! And I bet removing:
apps.forEach((app) => {
    if (app.icon) app.icon = s.read(app.icon);
  });

and instead loading the icons on demand (like in the launcher change) would probably knock a bit more off that too!

Yes, did not try that yet. Although it could make the scrolling a bit more choppy on first load of each new row as it has to load three icon per row.

Can it be done in two steps maybe?

Load only the first nine icons
Display them
Then immediately when they are displayed load the rest of the apps as before

Yes, that'd work... You could even load them one by one with a setInterval


New performance test case for b2b login

Is your suggestion related to an experience ? Please describe.
$subject
In this test we need to do the following in order to test the b2b login flow.

Create a sub orgs.
Create applications with organization_switch grant and share them with the created sub orgs.
Create business users inside the sub orgs.
Log business user using b2b login.

More detailed task break down will be shared in the future.
Related issues:

https://github.com/wso2/product-is/issues/16517

Task break down
Create a sub orgs.

Create Sub Org Endpoint.

Create applications.

Get SCIM2 Users API API Resources ID.
Add organization_switch grant to the existing app creation API call.
Share SP with Sub Orgs.
Register SCIM2 User API resource with shared SP.

Create business users inside the sub orgs.

Get All Sub Organisations Request.
For each sub org
i. Get Token with Client Credential Grant.
ii. Switch Token to Sub Org
iii. Create n number of users in each sub org.

Log business user using b2b login.

Send authorize request to Parent App Org.
Select Sub Org.
Send authorize request to Sub Org.
Common Auth Login Request to Sub Org.
Post Authentication Redirect call to Sub Org.
Common Auth Redirect call to the Parent Org.
Post Authentication Redirect call to Parent Org.
Send Consent Approve Request to Parent Org.
Get tokens Request to Parent Org.


Leaderboard downloadability

Continue on https://github.com/stanford-crfm/helm/issues/2322:
I have a few questions on the downloadable format of the existing leaderboards:

This zip files only contains all the evaluation results that are not the one shown in the leaderboards. Is there any manner to download the leaderboard data only in json or csv format?
How about HELM (Lite), HELM (Instruct), and HEIM?

With respect to the tables, for now you can copy the tables values into a Google Sheet or Excel document (by dragging across the table). If there is significant demand we can prioritize adding back JSON downloading in the newest leaderboards.
You can also currently download the full JSON for any run/prediction set by going to the predictions page.

With respect to the tables, for now you can copy the tables values into a Google Sheet or Excel document (by dragging across the table, copying and pasting). This also preserves the links to corresponding runs/predictions. If there is significant demand we can prioritize adding back JSON downloading in the newest leaderboards.
You can also currently download the full JSON for any run/prediction set by going to the predictions page.

Thanks, does the prediction JSON download include HEIM, HELM (Instruct), and HELM (Lite)?

Currently, the only supported data downloads are:

Downloading the zip, as discussed in #2322 - this only applies to Classic v0.3.0
Downloading raw data from the GCS bucket (instructions here) - this applies to any version of Classic, Lite, HEIM or Instruct

If your use case does not fit into either of these, you can write a your own script to download the web tables or the JSON files.

Currently, the only supported data downloads are:

Downloading the zip, as discussed in How to download the leaderboards as csv or json format? #2322 - this only applies to Classic v0.3.0
Downloading raw data from the GCS bucket (instructions here) - this applies to any version of Classic, Lite, HEIM or Instruct

If your use case does not fit into either of these, you can write a your own script to download the web tables or the JSON files.

Thanks!


Export Circuits as GIFs

Is your feature request related to a problem? Please describe.
At the moment, we have the option to download the circuits as images ( PNGs, JPEGs, etc ). Some users prefer to have the option to share their circuits as GIFs. This requires an external tool.
Describe the solution you'd like
To help with this we can have an inbuilt GIF exporter making it easy for users to share their circuits with others.
TODO

We already have a menu for Downloading Images in Tools > Download Image. There is also a GIF button which currently downloads PNG.
We have to add the feature to create a GIF.
Add the option to start and stop the recording for the GIF
Add option to Download GIF

Are you working on this? (Yes/No)
No

I might be able to work on this. Can you explain a bit more about "Add the option to start and stop the recording for the GIF" ?
What do we want to animate in the gif, should there be a seek bar or something else, etc?

I might be able to work on this. Can you explain a bit more about "Add the option to start and stop the recording for the GIF" ?
What do we want to animate in the gif, should there be a seek bar or something else, etc?

hello,
I have knowledge of javascript ,nodejs,reactjs,expressjs, Mongodb but I haven't contributed to any open-source project so I'm a beginner.I would like to contribute to this project.
how should I start can anyone suggest to me the way should I start contributing.

hello,
I have knowledge of javascript ,nodejs,reactjs,expressjs, Mongodb but I haven't contributed to any open-source project so I'm a beginner.I would like to contribute to this project.
how should I start can anyone suggest to me the way should I start contributing.

@sal2701
my idea is if any body wants to save the circuit as GIF the animated part would be the input vs output.
so for external tools to save as GIF we can use "gifshot" library.
https://yahoo.github.io/gifshot/
can i help you with this feature ?

@sal2701
my idea is if any body wants to save the circuit as GIF the animated part would be the input vs output.
so for external tools to save as GIF we can use "gifshot" library.
https://yahoo.github.io/gifshot/
can i help you with this feature ?

Since the circuit outputs change based on the inputs & the clock cycle, users might want to record it for multiple cycles or even for given seconds. So I feel what we need is a proper way to facilitate this. Yeah a seek bar might make it easier.
@ishandeveloper interested in this issue?
Hey @arnab15 good you want to contribute here. I suggest that you first setup CircuitVerse and use the simulator, it will give you a better idea of the platform & issues as well.
@ZadeAbhishek I will let you know if no one else is working on this issue. Feel free to try out other issues

Since the circuit outputs change based on the inputs & the clock cycle, users might want to record it for multiple cycles or even for given seconds. So I feel what we need is a proper way to facilitate this. Yeah a seek bar might make it easier.
@ishandeveloper interested in this issue?
Hey @arnab15 good you want to contribute here. I suggest that you first setup CircuitVerse and use the simulator, it will give you a better idea of the platform & issues as well.
@ZadeAbhishek I will let you know if no one else is working on this issue. Feel free to try out other issues

yes sure

yes sure

Thanks @sal2701 . Thanks for offering me the chance to work on this, however something came up and I might be busy for next few weeks. You can move forward and assign this to @ZadeAbhishek , meanwhile I'll be keeping an eye out for other issues, once I'm free : )

Thanks @sal2701 . Thanks for offering me the chance to work on this, however something came up and I might be busy for next few weeks. You can move forward and assign this to @ZadeAbhishek , meanwhile I'll be keeping an eye out for other issues, once I'm free : )

@ishandeveloper no issues. @ZadeAbhishek you can take this up. gifshot sounds good. Let me know if you've any doubts.

@ishandeveloper no issues. @ZadeAbhishek you can take this up. gifshot sounds good. Let me know if you've any doubts.

yes

yes

Hey would you please guide me to setup circuitverses

Hey would you please guide me to setup circuitverses

I want this issue to be fixed but unable to setup the circuitverses

I want this issue to be fixed but unable to setup the circuitverses

Hey would you please guide me to setup circuitverses

Hey would you please guide me to setup circuitverses

Hey would you please guide me to setup circuitverses

read setup.md will help you to setup

Hey would you please guide me to setup circuitverses

read setup.md will help you to setup

https://user-images.githubusercontent.com/66520848/104838764-06cf4700-58e3-11eb-962c-ee9480185f01.mp4
hey @sal2701 gifshot is intergrated as shown in above video now we can save image as GIF in chrome and firefox i have not tested for all but in gifshot docs its is given that it supports all brouser.But problem is as  said  earlier we need seek bar implementation but not able to do  can you give any suggestion i am also finding.

https://user-images.githubusercontent.com/66520848/104838764-06cf4700-58e3-11eb-962c-ee9480185f01.mp4
hey @sal2701 gifshot is intergrated as shown in above video now we can save image as GIF in chrome and firefox i have not tested for all but in gifshot docs its is given that it supports all brouser.But problem is as  said  earlier we need seek bar implementation but not able to do  can you give any suggestion i am also finding.

Hey @ZadeAbhishek could I get your mail Id please.i have some doubts and question that I want to get cleared by you

Hey @ZadeAbhishek could I get your mail Id please.i have some doubts and question that I want to get cleared by you

https://user-images.githubusercontent.com/66520848/104838764-06cf4700-58e3-11eb-962c-ee9480185f01.mp4
hey @sal2701 gifshot is intergrated as shown in above video now we can save image as GIF in chrome and firefox i have not tested for all but in gifshot docs its is given that it supports all brouser.But problem is as  said  earlier we need seek bar implementation but not able to do  can you give any suggestion i am also finding.

Hey, I need some source to contact with you . Just needed help for open source, would you please give your email id

https://user-images.githubusercontent.com/66520848/104838764-06cf4700-58e3-11eb-962c-ee9480185f01.mp4
hey @sal2701 gifshot is intergrated as shown in above video now we can save image as GIF in chrome and firefox i have not tested for all but in gifshot docs its is given that it supports all brouser.But problem is as  said  earlier we need seek bar implementation but not able to do  can you give any suggestion i am also finding.

Hey, I need some source to contact with you . Just needed help for open source, would you please give your email id

GIFSHOT.INTRI.mp4
hey @sal2701 gifshot is intergrated as shown in above video now we can save image as GIF in chrome and firefox i have not tested for all but in gifshot docs its is given that it supports all brouser.But problem is as  said  earlier we need seek bar implementation but not able to do  can you give any suggestion i am also finding.

Hey, I need some source to contact with you . Just needed help for open source, would you please give your email id

<EMAIL_ADDRESS>

GIFSHOT.INTRI.mp4
hey @sal2701 gifshot is intergrated as shown in above video now we can save image as GIF in chrome and firefox i have not tested for all but in gifshot docs its is given that it supports all brouser.But problem is as  said  earlier we need seek bar implementation but not able to do  can you give any suggestion i am also finding.

Hey, I need some source to contact with you . Just needed help for open source, would you please give your email id

<EMAIL_ADDRESS>

GIFSHOT.INTRI.mp4
hey @sal2701 gifshot is intergrated as shown in above video now we can save image as GIF in chrome and firefox i have not tested for all but in gifshot docs its is given that it supports all brouser.But problem is as  said  earlier we need seek bar implementation but not able to do  can you give any suggestion i am also finding.

Hey, I need some source to contact with you . Just needed help for open source, would you please give your email id

<EMAIL_ADDRESS>
Hi @ZadeAbhishek I have sent you so many emails with my mail I'd<EMAIL_ADDRESS>. Please respond to my mail please

GIFSHOT.INTRI.mp4
hey @sal2701 gifshot is intergrated as shown in above video now we can save image as GIF in chrome and firefox i have not tested for all but in gifshot docs its is given that it supports all brouser.But problem is as  said  earlier we need seek bar implementation but not able to do  can you give any suggestion i am also finding.

Hey, I need some source to contact with you . Just needed help for open source, would you please give your email id

<EMAIL_ADDRESS>
Hi @ZadeAbhishek I have sent you so many emails with my mail I'd<EMAIL_ADDRESS>. Please respond to my mail please

GIFSHOT.INTRI.mp4
hey @sal2701 gifshot is intergrated as shown in above video now we can save image as GIF in chrome and firefox i have not tested for all but in gifshot docs its is given that it supports all brouser.But problem is as  said  earlier we need seek bar implementation but not able to do  can you give any suggestion i am also finding.

Hey, I need some source to contact with you . Just needed help for open source, would you please give your email id

<EMAIL_ADDRESS>
Hi @ZadeAbhishek I have sent you so many emails with my mail I'd<EMAIL_ADDRESS>. Please respond to my mail please

Bro I read your mails, thanks for your advice. I wanted to know which js framework should I start learning to start contributing in circuitverses. Pls

GIFSHOT.INTRI.mp4
hey @sal2701 gifshot is intergrated as shown in above video now we can save image as GIF in chrome and firefox i have not tested for all but in gifshot docs its is given that it supports all brouser.But problem is as  said  earlier we need seek bar implementation but not able to do  can you give any suggestion i am also finding.

Hey, I need some source to contact with you . Just needed help for open source, would you please give your email id

<EMAIL_ADDRESS>
Hi @ZadeAbhishek I have sent you so many emails with my mail I'd<EMAIL_ADDRESS>. Please respond to my mail please

Bro I read your mails, thanks for your advice. I wanted to know which js framework should I start learning to start contributing in circuitverses. Pls

@sal2701  hey i success fully add GIF feature here is the video  please check what to do next ?
https://user-images.githubusercontent.com/66520848/106264963-6109c980-624c-11eb-8943-a19cd0c7d3e4.mp4

@sal2701  hey i success fully add GIF feature here is the video  please check what to do next ?
https://user-images.githubusercontent.com/66520848/106264963-6109c980-624c-11eb-8943-a19cd0c7d3e4.mp4

GIFSHOT.INTRI.mp4
hey @sal2701 gifshot is intergrated as shown in above video now we can save image as GIF in chrome and firefox i have not tested for all but in gifshot docs its is given that it supports all brouser.But problem is as  said  earlier we need seek bar implementation but not able to do  can you give any suggestion i am also finding.

Hey, I need some source to contact with you . Just needed help for open source, would you please give your email id

<EMAIL_ADDRESS>
Hi @ZadeAbhishek I have sent you so many emails with my mail I'd<EMAIL_ADDRESS>. Please respond to my mail please

Bro I read your mails, thanks for your advice. I wanted to know which js framework should I start learning to start contributing in circuitverses. Pls

as such i don't know much about javascript  i am not pro but start j query library is will help you to ease work

GIFSHOT.INTRI.mp4
hey @sal2701 gifshot is intergrated as shown in above video now we can save image as GIF in chrome and firefox i have not tested for all but in gifshot docs its is given that it supports all brouser.But problem is as  said  earlier we need seek bar implementation but not able to do  can you give any suggestion i am also finding.

Hey, I need some source to contact with you . Just needed help for open source, would you please give your email id

<EMAIL_ADDRESS>
Hi @ZadeAbhishek I have sent you so many emails with my mail I'd<EMAIL_ADDRESS>. Please respond to my mail please

Bro I read your mails, thanks for your advice. I wanted to know which js framework should I start learning to start contributing in circuitverses. Pls

as such i don't know much about javascript  i am not pro but start j query library is will help you to ease work

@sal2701 can you help me i have created pull request know what to do can you help me

@sal2701 can you help me i have created pull request know what to do can you help me

This issue has been resolved so I'm closing it.


chef-server-ctl doesn't understand shell quoting

chef-server-ctl user-create username First Last<EMAIL_ADDRESS>"failure to deal with shell quotes" --filename first.last.chef.pem
or
chef-server-ctl user-create username First Last<EMAIL_ADDRESS>"'failure to deal with shell quotes'" --filename first.last.chef.pem
lead to:
FATAL: Wrong number of arguments USAGE: knife opc user create USERNAME FIRST_NAME [MIDDLE_NAME] LAST_NAME EMAIL PASSWORD

This needs to be reported in the chef-server repo, this repo is for the client.
http://github.com/chef/chef-server/issues/new


Fix user edit for illegal legacy username

Closes #3250
Should filter out most unchanged keys if it is an update, please check if this breaks any field in account or participant edit.
Also check for create nothing should be changed.
Also check what happens if you edit a user, save, and then edit again.
This PR should also make it possible to save even if a legacy username with empty spaces is left unchanged in the preview. Idk, I couldn't test it

Merging ist @peb-adr s responsibility

Merging into stable/4.1.x.
New workflow for this is described in wiki:
https://github.com/OpenSlides/OpenSlides/wiki/Update-Workflow#hotfixes


Remove MSDN zip xref config from existing .NET repos

Remove MSDN zip xref config from existing .NET repos

Docs Build status updates of commit c73ae3e:
:x: Validation status: errors
Please follow instructions here which may help to resolve issue.

File
Status
Preview URL
Details

:x:Error

Details

Line 136: [Error] Restore nuget package W:\copa-s\.optemp\dependentPackages\Microsoft.OpenPublishing.CommonPlugins\packages.config in folder:W:\copa-s\.optemp\packages failed, possibly due to transient errors from nuget servers. Please retry building your content. If the issue still happens, open a ticket in https://SiteHelp and include the build report and the following error message for our team to troubleshoot: Errors in packages.config projects     Unable to find version '1.0.222' of package 'Microsoft.OpenPublishing.CommonPlugins'.       C:\Users\ContainerAdministrator\.nuget\packages\: Package 'Microsoft.OpenPublishing.CommonPlugins.1.0.222' is not found on source 'C:\Users\ContainerAdministrator\.nuget\packages\'.       https://docfx.pkgs.visualstudio.com/docfx/_packaging/docs-build-v2-prod/nuget/v2: Package 'Microsoft.OpenPublishing.CommonPlugins.1.0.222' is not found on source 'https://docfx.pkgs.visualstudio.com/docfx/_packaging/docs-build-v2-prod/nuget/v2'.
Line 136: [Error] Restore nuget package W:\copa-s\.optemp\dependentPackages\Microsoft.DocAsCode.ECMA2Yaml\packages.config in folder:W:\copa-s\.optemp\packages failed, possibly due to transient errors from nuget servers. Please retry building your content. If the issue still happens, open a ticket in https://SiteHelp and include the build report and the following error message for our team to troubleshoot: Errors in packages.config projects     Unable to find version '1.0.669' of package 'Microsoft.DocAsCode.ECMA2Yaml'.       C:\Users\ContainerAdministrator\.nuget\packages\: Package 'Microsoft.DocAsCode.ECMA2Yaml.1.0.669' is not found on source 'C:\Users\ContainerAdministrator\.nuget\packages\'.       https://docfx.pkgs.visualstudio.com/docfx/_packaging/docs-build-v2-prod/nuget/v2: Package 'Microsoft.DocAsCode.ECMA2Yaml.1.0.669' is not found on source 'https://docfx.pkgs.visualstudio.com/docfx/_packaging/docs-build-v2-prod/nuget/v2'.

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit c73ae3e:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

officedocs-dev-managed-sip/_zip/msdn.4.5.2.zip
:white_check_mark:Succeeded

officedocs-dev-managed-sip/docfx.json
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel


Minor: Remove old/disused CI cruft

- What I did
Removed some legacy cruft
- How I did it
git rm
- How to verify it
Ask if anybody doesn't not use it :smile:
(I used it ages ago, but AFAIK, nobody else even looks at it)

/test all

LGTM, but you shoulda used Cruft-Be-Gone, it's much more efficient.

LGTM


fix: adds custom validator to url tile layers

This PR includes:

Adds custom validator for validating the custom layers url tiles text input.
Fixes styles in custom layers form card.

There are some url tiles that haven't .jpg or .png so I won't add this as required.


the question about compile

Start the project after, is not an error, page rendering submitted to compile errors after a second, there is only one warning information is as follows:
Failed to compile.
./~/css-loader?{"sourceMap":false,"importLoaders":1}!./~/postcss-loader?{"ident":"postcss"}!./~/sass-loader/lib/loader.js?{"sourceMap":false,"precision":8,"includePaths":[]}!./src/styles/bootstrap.scss
autoprefixer: D:\project\mynewProje\seczone-platform-frontend\src\styles\bootstrap.scss:167:3: You should write display: flex by final spec instead of display: box
@ ./src/styles/bootstrap.scss 4:14-201
@ multi ./src/styles/bootstrap.scss ./~/angular2-toaster/toaster.css
What should I do

This is not the right place to ask for help debugging.
Please post a properly formatted question with more details on how to reproduce your bug (ideally with a link to a plunker) to http://stackoverflow.com/ and close this issue.

Hello, we reviewed this issue and determined that it doesn't fall into the bug report or feature request category. This issue tracker is not suitable for support requests, please repost your issue on StackOverflow using tag angular-cli.
If you are wondering why we don't resolve support issues via the issue tracker, please check out this explanation.

Closing as above.


Add documentation

Added a documentation page that describes the process of back-filling existing products into the orchestrator.
This is an approach we followed within GÉANT for importing the existing estate, and worked quite well for us. As we had our usual meeting with the fine folks from HEAnet, we decided it would be good to document this for future reference and to minimise wheel-reinvention.

Perhaps @pboers1988 or @wouter1975 can review this given their experience from the SN7/SN8 migration :)


IGAPP-521: Show Snackbar if Opening Bad Link

This pull request belongs to an issue on our bugtracker.
You can find it there by looking for an issue with the key which is mentioned in the title of this pull request.
It starts with the keyword IGAPP.
As overview what happened:

Removed navigateToDeepLink from top level components, as it was passed down the whole tree  to Page and NativeHtml only.
Introduced a hook useNavigateToDeepLink, which does exactly what it sounds like
Introduce hook useSnackbar and a 'SnackbarError' If you have better ideas on how to make openExternalUrlprettier, feel free to leave a note
Refactored Categories to a functional component
Extracted a single pois page into a separate component. (Was not really part of the task, but as I found out that opening the navigation url needed some fixup, i just split it
and fixed the typing of some promise returning functions

I tested it, but can't get it working.
For a link without a valid city I get:

For valid city but missing language I get:

For valid city and valid language, I get:

Not sure, if I tested what the ticket is about?


PyPI release is empty

🐛 Bug Report

The PyPI release contains only __init__.py and _version.py. Additionally, the changed versioning scheme from .dev to a0 seems not to work as intended since .dev is considered newer than a0. Perhaps a 0.2 release is possible?

Hey @zklaus,
Greay to hear from you :smile:
I've not made a release of geovista yet, although the first minor version 0.1.0 is imminent.
I grabbed the geovista namespace on both PyPI and conda-forge, but both contain empty packages. So this isn't a bug, it's just me securing ownership of the package name before anyone else took it before me :wink:
Apologies for the confusion.
I suggest that you watch the repo and you'll be alerted by GH when I tag a release.
In fact, I'll leave this issue open and ping you here when geovista is lands.
Is that okay for now?

I'll definitely watch :) I did run into this because I was following the stable version of the Iris docs on a question from a colleague and that not working after doing a successful mamba install geovista.

@zklaus
geovista has been tagged and released, and is now available on conda-forge and PyPI :smile:
Try it out:
conda create -n geovista -c conda-forge geovista
conda activate geovista
geovista examples --run all --verbose

Enjoy!
I'm going to close this issue now :+1:
I'm going to be focusing a lot of development effort now on geovista. So things are going to be a wee bit fluid, but I'm keen to work towards a stable core and mature its features and capability.

@all-contributors please add @zklaus for bug


Docker Mounts

I have tried the most recent version of DeepKit and cant get Docker mounts to work. I go to the node where I want to use them, change the settings in mounts to /home/anthony/data:/data, this works locally but using DeepKit this mount does not appear.
I get the error:
run failed Error: (HTTP code 400) unexpected - invalid environment variable:
(HTTP code 400) unexpected - invalid environment variable:

Further, if I then define an env variable, I get the new error:
run failed Error: (HTTP code 500) server error - invalid volume specification: ':undefined'
(HTTP code 500) server error - invalid volume specification: ':undefined'

Which linux and Docker version do you use on the cluster node? Also please post your configuration file, so I can try to replicate.

Sorry, after rebooting the node the error does not persist. I can see the volume now.

Mh, that's weird. The 500 comes from the Docker daemon. I wonder what the issue was. Please ping me when you experience the same issue again so we can hunt it down.


New script explorer [7 Tasks]

Features

[x] Create a new script file on MacOS
[x] Delete script file on MacOS
[ ] Create a new script file on Windows
[ ] Delete script file on Windows
[ ] stable execution (Windows)
[ ] stable packing script data
[ ] stable unpacking script data

Create a new script file on MacOS


Offline device causes issues with other integrations

Description
I have 3 P100 plugs added through Tapo Control integration, one of them is unplugged and offline. But the Tapo integration continuously tries to connect to the last one, and in the process making the communication with WLED API super slow/unstable.
Reproduction Steps

Add a smart plug to HA
Take the plug offline
Look at the Supervisor logs for
Failed to setup Error communication with API: Cannot connect to host <ip:port> ssl:default [Connect call failed ('<ip:port>)] Failed to setup Error communication with API: Cannot connect to host <ip:port> ssl:default [Network unreachable]
Disable smart plug in integration, logs disappear and other integrations work fine again.

Expected behavior
I want the Tapo integration to poll less if the device is not online.
If applicable, add error logs.
update_coordinator.txt
custom_components.tapo_control.init.txt
wled_logs.txt
Device Firmware
1.1.5 Build 230324 Rel.143956
Using stream component
No
Does camera work via official integrations?
N/A
Camera has all attributes filled out in developer tools
No
HASS Environment
N/A
Search for similar issues
Yes
Additional information
Added the logs i got for WLED until i disabled the offline Tapo plug in integration.

Wrong repo. This one is for cameras.


[FR] Input range

It would be nice if this library had support for an input range component. (Which is supported by all browsers, IE9+)
Or maybe just create a new repository with "extra" components and start adding there more advanced components.

you should be able to use a text field with a {type:"Text", dataType:"range"}

I just tried that, but it's not working.

"age": {
"type": "Text",
"fieldAttrs": {
"type": "range"
}
}


npm start error with create-react-app

P.S. We know this message is long but please read the steps above :-) We hope you find them helpful!
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR<EMAIL_ADDRESS>start: react-scripts start
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>start script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.
npm ERR!      C:\Users\hichem\AppData\Roaming\npm-cache_logs\2020-11-24T15_54_35_505Z-debug.log

Delete your package-lock.json file and node_modules folder. Then type this:

npm cache clean --force

then do npm install

I have this same issue, when starting new project
Following @ramilabbaszade instructions got me to this error below
npm ERR! code ERESOLVE
npm ERR! ERESOLVE unable to resolve dependency tree
npm ERR!
npm ERR! Found<EMAIL_ADDRESS>npm ERR! node_modules/typescript
npm ERR<EMAIL_ADDRESS>from the root project
npm ERR!
npm ERR! Could not resolve dependency:
npm ERR! peerOptional<EMAIL_ADDRESS>from<EMAIL_ADDRESS>npm ERR! node_modules/react-scripts
npm ERR<EMAIL_ADDRESS>from the root project
npm ERR!
npm ERR! Fix the upstream dependency conflict, or retry
npm ERR! this command with --force, or --legacy-peer-deps
npm ERR! to accept an incorrect (and potentially broken) dependency resolution.

By running npm install --legacy-peer-deps as instructed I managed to get depencies installed
Unfortunately now running npm start  gives me sh: react-scripts: command not found error.
I then uninstalled/reinstalled node, uninstalled/reinstalled react-scripts globally and then locally in my project folder, but nothing seem to have any affect.
I don't know if these are related, but new version of create-react-app seem to be somewhat broken.

Sweet I'm not the only getting this.  I've done the same as casper. It's weird because I literally made a react app yesterday and it still works. But it's not working with new projects this morning.

I give all possible solutions you can try to fix.
1. solution:

npm cache verify || npm cache clear --force

2. solution: Remove node_modules file.

npm install

3. solution: It is not recommended to use but it had fixed my solution temperary last days.

npm i -g react-scripts

4. solution: I can't see any sign from webpack on your issues but same script problem happened for me and related with webpack, you may try it at the end.

npm uninstall webpack
npm uninstall webpack-dev-server

Mines working now. I noticed mine was trying to run a command from different file in my project folder at times. Luckily those were on github so I deleted everything, restarted computer and used the bash terminal inside vscode.  I am up and running; but I am afraid to try with windows powershell. Lost hours googling this.

I had this problem when using node version 12.x. Using nvm to switch to 10.x, npm install worked.

I had this problem when using node version 12.x. Using nvm to switch to 10.x, npm install worked.

i had this issue. The simple solution is to add latest versions of typescript, react-scripts libs. and then run npm install. it works for me.

i got this error when i tried to create new react project
PS E:\My projects\Git-Start> npx create-react-app responsive-navbar
Creating a new React app in E:\My projects\Git-Start\responsive-navbar.
Installing packages. This might take a couple of minutes.
Installing react, react-dom, and react-scripts with cra-template...
npm ERR! code ERR_OSSL_PEM_NO_START_LINE
npm ERR! error:0909006C:PEM routines:get_name:no start line
npm ERR!      C:\Users\omar\AppData\Roaming\npm-cache_logs\2022-06-30T09_20_27_624Z-debug.log
Aborting installation.
npm install --no-audit --save --save-exact --loglevel error react react-dom react-scripts cra-template has failed.
Deleting generated file... package.json
Deleting responsive-navbar/ from E:\My projects\Git-Start
Done.


Fixing bug where proxy user from flow parameter was not included

Adding a bug fix for including proxy users from flow param, in addition to users from the DAG.

Fixed bug for specific instance where there exist large list of proxy users, are not included in any .flow files or .job files but only in the flow parameters/ run time parameters.
Tested on clusters with above conditions.


Add image ipm

Move mask and image projections from soccer_ipm to own node as discussed in the soccer_ipm PR.

Thanks for this PR @Flova! Looks good overall.
Would be good to name the package ipm_image rather than image_ipm for consistency (and to help tab-completion and ipm_* wildcards)

I think it would be good to name the package ipm_image rather than image_ipm for consistency (and to help tab-completion and ipm_* wildcards)

I renamed it to ipm_image_node.


Reading money from excel sometimes return 0

Hi Gerardo
Do you know why I'm getting 0 returned sometimes while reading money amounts from Excel ?
I'm importing data with PHPSpreadSheet and I use Money class in a function, during a foreach
Cells in spreadsheet doesn't have any format. And some amounts have . as decimal separator and others have ,
function moneda($monto)
{
	$currency = new Gerardojbaez\Money\Currency('ARS');
	$currency->setPrecision(2);
	$currency->setThousandSeparator('.');
	$currency->setDecimalSeparator(',');
	$currency->setSymbolPlacement('before');
	$money = new Gerardojbaez\Money\Money($monto, $currency);
	echo $this->echonew("Monto:".$monto."<br />".$money);
	return $money;
	//echo Money::parse('$1,200.90', 'USD')->toDecimal();
	//return moneyFormat($monto, 'ARS');
}

Thanks

It's probably because "monto" has a $ sign in front of it.


Installed android apk flash back on andriod phone

I tried to run the apk on my andriod phone, but it just flash back. I even tried to run it on a simulator phone on Android Studio, but it also can not work successfully.

I generated the apk following the document https://k2-fsa.github.io/sherpa/ncnn/android/build-sherpa-ncnn.html#download-sherpa-ncnn.
The log is below:
---------------------------- PROCESS STARTED (6623) for package com.k2fsa.sherpa.ncnn ----------------------------
2023-05-25 11:05:52.055  6623-6642  ActivityThread          com.k2fsa.sherpa.ncnn                I  Init compatible state: true
2023-05-25 11:05:52.055  6623-6642  HwFramewor...rtsFactory com.k2fsa.sherpa.ncnn                D  HwFrameworkSecurityPartsFactory in.
2023-05-25 11:05:52.056  6623-6642  HwFramewor...rtsFactory com.k2fsa.sherpa.ncnn                I  add HwFrameworkSecurityPartsFactory to memory.
2023-05-25 11:05:52.056  6623-6642  BehaviorCollectManager  com.k2fsa.sherpa.ncnn                D  hook process for AI virus second
2023-05-25 11:05:52.060  6623-6642  BehaviorCollectManager  com.k2fsa.sherpa.ncnn                I  bindAnalyzerService: huawei.android.security.IAppBehaviorDataAnalyzer$Stub$Proxy@a889c9b pid:6623
2023-05-25 11:05:52.064  6623-6623  ApplicationLoaders      com.k2fsa.sherpa.ncnn                D  createClassLoader zip: /data/app/com.k2fsa.sherpa.ncnn-l8lt1eZBsIvBP3g3tEInbQ==/base.apk librarySearchPath: /data/app/com.k2fsa.sherpa.ncnn-l8lt1eZBsIvBP3g3tEInbQ==/lib/arm64:/data/app/com.k2fsa.sherpa.ncnn-l8lt1eZBsIvBP3g3tEInbQ==/base.apk!/lib/arm64-v8a libraryPermittedPath: /data/user/0/com.k2fsa.sherpa.ncnn parent: java.lang.BootClassLoader@67c1bc4 targetSdkVersion: 32 isBundled: false classLoaderName: null sharedLibraries: null
2023-05-25 11:05:52.210  6623-6623  fsa.sherpa.ncn          com.k2fsa.sherpa.ncnn                I  HwMultiThreadDexLoader location /data/app/com.k2fsa.sherpa.ncnn-l8lt1eZBsIvBP3g3tEInbQ==/base.apk start threadNum=2
2023-05-25 11:05:52.224  6623-6642  HwApiCacheMangerEx      com.k2fsa.sherpa.ncnn                I  apicache path=/storage/emulated/0 state=mounted key=com.k2fsa.sherpa.ncnn#10489#256
2023-05-25 11:05:52.224  6623-6642  HwApiCacheMangerEx      com.k2fsa.sherpa.ncnn                I  need clear apicache,because volumes changed,oldCnt=0 newCnt=1
2023-05-25 11:05:52.225  6623-6642  HwApiCacheMangerEx      com.k2fsa.sherpa.ncnn                I  apicache path=/storage/emulated/0 state=mounted key=com.k2fsa.sherpa.ncnn#10489#0
2023-05-25 11:05:52.225  6623-6642  HwApiCacheMangerEx      com.k2fsa.sherpa.ncnn                I  need clear apicache,because volumes changed,oldCnt=1 newCnt=1
2023-05-25 11:05:52.229  6623-6642  AwareBitmapCacher       com.k2fsa.sherpa.ncnn                I  init processName:com.k2fsa.sherpa.ncnn pid=6623 uid=10489
2023-05-25 11:05:52.229  6623-6660  AwareLog                com.k2fsa.sherpa.ncnn                E  AtomicFileUtils: readFileLines file not exist: android.util.AtomicFile@44bb576
2023-05-25 11:05:52.233  6623-6623  HwTypeface              com.k2fsa.sherpa.ncnn                I  updateFont: scale=1.0
2023-05-25 11:05:52.233  6623-6623  SystemFonts             com.k2fsa.sherpa.ncnn                D  areFontsVariable: script=Hans
2023-05-25 11:05:52.234  6623-6623  ActivityThread          com.k2fsa.sherpa.ncnn                I  finishPreloaded preloadStatus 0
2023-05-25 11:05:52.234  6623-6623  RmeSchedManager         com.k2fsa.sherpa.ncnn                I  init Rme, version is: v1.0
2023-05-25 11:05:52.234  6623-6623  RtgSchedEvent           com.k2fsa.sherpa.ncnn                I  current pid:6623 AppType:-1
2023-05-25 11:05:52.234  6623-6623  RmeSchedManager         com.k2fsa.sherpa.ncnn                I  init Rme, version is: v1.0
2023-05-25 11:05:52.237  6623-6623  OpenGLRenderer          com.k2fsa.sherpa.ncnn                D  disableOutlineDraw is true
2023-05-25 11:05:52.239  6623-6663  OpenGLRenderer          com.k2fsa.sherpa.ncnn                I  RenderThread: progress name = [com.k2fsa.sherpa.ncnn], viewCornerType = 0
2023-05-25 11:05:52.239  6623-6665  iGraphics               com.k2fsa.sherpa.ncnn                I  [0020080c] pn: com.k2fsa.sherpa.ncnn, p: 6623
2023-05-25 11:05:52.239  6623-6665  iGraphics               com.k2fsa.sherpa.ncnn                I  [0030080c] no spt app: com.k2fsa.sherpa.ncnn
2023-05-25 11:05:52.267  6623-6623  ActivityThread          com.k2fsa.sherpa.ncnn                V  callActivityOnCreate
2023-05-25 11:05:52.282  6623-6623  DecorView[]             com.k2fsa.sherpa.ncnn                I  pkgName:com.k2fsa.sherpa.ncnn old windowMode:0 new windoMode:1, isFixedSize:false
2023-05-25 11:05:52.295  6623-6623  OverScroll...timization com.k2fsa.sherpa.ncnn                I  start init SmartSlideOverScroller and get the overscroller config
2023-05-25 11:05:52.295  6623-6623  OverScroll...timization com.k2fsa.sherpa.ncnn                I  get the overscroller config
2023-05-25 11:05:52.316  6623-6623  fsa.sherpa.ncn          com.k2fsa.sherpa.ncnn                W  Accessing hidden method Landroid/view/View;->computeFitSystemWindows(Landroid/graphics/Rect;Landroid/graphics/Rect;)Z (greylist, reflection, allowed)
2023-05-25 11:05:52.317  6623-6623  fsa.sherpa.ncn          com.k2fsa.sherpa.ncnn                W  Accessing hidden method Landroid/view/ViewGroup;->makeOptionalFitsSystemWindows()V (greylist, reflection, allowed)
2023-05-25 11:05:52.370  6623-6623  sherpa-ncnn             com.k2fsa.sherpa.ncnn                I  Start to initialize model
2023-05-25 11:05:52.374  6623-6623  ncnn                    com.k2fsa.sherpa.ncnn                W  ------config------
                                                                                RecognizerConfig(feat_config=FeatureExtractorConfig(sampling_rate=16000, feature_dim=80), model_config=ModelConfig(encoder_param="streaming_models/encoder.param", encoder_bin="streaming_models/encoder.bin", decoder_param="streaming_models/decoder.param", decoder_bin="streaming_models/decoder.bin", joiner_param="streaming_models/joiner.param", joiner_bin="streaming_models/joiner.bin", tokens="streaming_models/tokens.txt", encoder num_threads=1, decoder num_threads=1, joiner num_threads=1), decoder_config=DecoderConfig(method="greedy_search", num_active_paths=4), endpoint_config=EndpointConfig(rule1=EndpointRule(must_contain_nonsilence=False, min_trailing_silence=2, min_utterance_length=0), rule2=EndpointRule(must_contain_nonsilence=True, min_trailing_silence=0.8, min_utterance_length=0), rule3=EndpointRule(must_contain_nonsilence=False, min_trailing_silence=0, min_utterance_length=20)), enable_endpoint=True)
2023-05-25 11:05:52.461  6623-6623  ncnn                    com.k2fsa.sherpa.ncnn                W  You are using a too old version of Zipformer. You can choose one of the following solutions:
                                                                                (1) Re-download the latest model
                                                                                (2) Re-export your model using the latest icefall. Remember to strictly follow the documentation
                                                                                to update the version number to 1.
                                                                                (3) Use sherpa-ncnn < v2.0 (not recommended)

It seems that the problem came from the model initialization. I will try to debug it.

Please redownload the model.

Or re-export the model by following the latest icefall doc with the latest icefall.

Or re-export the model by following the latest icefall doc with the latest icefall.

What i used is the smallest Chinese model. https://k2-fsa.github.io/sherpa/ncnn/pretrained_models/zipformer-transucer-models.html#marcoyang-sherpa-ncnn-streaming-zipformer-zh-14m-2023-02-23-chinese

When did you download it? If not this week, please redownload it.

When did you download it? If not this week, please redownload it.

Now it's okay. However, i also tried to export the model using https://github.com/k2-fsa/icefall/blob/master/egs/librispeech/ASR/pruned_transducer_stateless7_streaming/export-for-ncnn-zh.py. I still get the same error.

Are you following the latest icefall doc to export the model?
If not, please do it now. You need to add a version field to the exported encoder. We have documented it clearly.

Are you following the latest icefall doc to export the model?
If not, please do it now. You need to add a version field to the exported encoder. We have documented it clearly.

Thanks @csukuangfj . I have tried to export the trained model to sherpa ncnn model following the latest icefall. However, the decode output is empty.
Then i tried to decode the audio using the original checkpoint. To my surprised, the model can get a correct result.

Are you using int8?

Are you using int8?

Yes. I am using int8.

Are you using int8?

Do i need to train the model from scratch using the latest icefall code ?

Can you try a non-quantized model?

Can you try a non-quantized model?

Yes. The checkpoint i used is a non-quantized model. I used icefall/egs/librispeech/ASR/pruned_transducer_stateless7_streaming/pretrained.py

I mean, could you try to use a non-quantized model for sherpa-ncnn? That is, replace encoder-xxx.int8.param with encoder-xxx.param

I mean, could you try to use a non-quantized model for sherpa-ncnn? That is, replace encoder-xxx.int8.param with encoder-xxx.param

I tried to use pnnx joiner_jit_trace-pnnx.pt fp16=0 for encoder, decoder and joiner, still got the error :
File "pruned_transducer_stateless7_streaming/streaming-ncnn-decode.py", line 446, in <module>
    main()
  File "pruned_transducer_stateless7_streaming/streaming-ncnn-decode.py", line 378, in main
    model = Model(args)
  File "pruned_transducer_stateless7_streaming/streaming-ncnn-decode.py", line 109, in __init__
    self.init_encoder(args)
  File "pruned_transducer_stateless7_streaming/streaming-ncnn-decode.py", line 210, in init_encoder
    encoder_net.load_model(encoder_model)
  File "/home/icefall/egs/librispeech/ASR/pruned_transducer_stateless7_streaming/ncnn_custom_layer.py", line 223, in load_model
    bias = md.load(self.num_channels, self.upsample, 0)
TypeError: load(): incompatible function arguments. The following argument types are supported:
    1. (self: ncnn.ncnn.ModelBinFromDataReader, w: int, type: int) -> ncnn::Mat

I also tried to use the previous icefall to export model to ncnn, but it still came out of the following error:
layer PoolingModuleNoProj not exists or registered
Segmentation fault

Could you please show the complete commands?

Could you please show the complete commands?

The export one is
python /home/icefall/egs/librispeech/ASR/pruned_transducer_stateless7_streaming/export-for-ncnn-zh.py --lang-dir /home/icefall/egs/aidatatang/ASR/data/lang_char --exp-dir /home/icefall/egs/aidatatang/ASR/pruned_transducer_stateless7_streaming/exp-14M --use-averaged-model True --iter 66000 --avg 5 --decode-chunk-len 32 --num-encoder-layers "2,3,2,2,3" --feedforward-dims "320,320,640,640,320" --nhead "4,4,4,4,4" --encoder-dims "160,160,160,160,160" --attention-dims "96,96,96,96,96" --encoder-unmasked-dims "128,128,128,128,128" --decoder-dim 320 --joiner-dim 320
Then i ran the following:
pnnx encoder_jit_trace-pnnx.pt
pnnx decoder_jit_trace-pnnx.pt
pnnx joiner_jit_trace-pnnx.pt

Finally, i ran the following command to test the exported model.
python  /home/icefall/egs/librispeech/ASR/pruned_transducer_stateless7_streaming/streaming-ncnn-decode.py --tokens /home/icefall/egs/aidatatang_200zh/ASR/data/lang_char/tokens.txt --encoder-param-filename /home/icefall/egs/aidatatang_200zh/ASR/pruned_transducer_stateless7_streaming/exp-14M/encoder_jit_trace-pnnx.ncnn.param --encoder-bin-filename /home/icefall/egs/aidatatang_200zh/ASR/pruned_transducer_stateless7_streaming/exp-14M/encoder_jit_trace-pnnx.ncnn.bin --decoder-param-filename /home/icefall/egs/aidatatang_200zh/ASR/pruned_transducer_stateless7_streaming/exp-14M/decoder_jit_trace-pnnx.ncnn.param --decoder-bin-filename /home/icefall/egs/aidatatang_200zh/ASR/pruned_transducer_stateless7_streaming/exp-14M/decoder_jit_trace-pnnx.ncnn.bin --joiner-param-filename /home/icefall/egs/aidatatang_200zh/ASR/pruned_transducer_stateless7_streaming/exp-14M/joiner_jit_trace-pnnx.ncnn.param --joiner-bin-filename /home/icefall/egs/aidatatang_200zh/ASR/pruned_transducer_stateless7_streaming/exp-14M/joiner_jit_trace-pnnx.ncnn.bin /home/data/aishell/data_aishell/wav/test/S0764/BAC009S0764W0122.wav

@csukuangfj Do i need to use the latest icefall code to re-train my model, so that the exported model can be used in sherpa ncnn ?

@csukuangfj I just followed the document https://icefall.readthedocs.io/en/latest/model-export/export-ncnn-zipformer.html, trying to decode the audio using the exported model, still get the same error:
python pruned_transducer_stateless7_streaming/streaming-ncnn-decode.py \
>   --tokens ./icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/data/lang_bpe_500/tokens.txt \
>   --encoder-param-filename ./icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/encoder_jit_trace-pnnx.ncnn.param \
>   --encoder-bin-filename ./icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/encoder_jit_trace-pnnx.ncnn.bin \
>   --decoder-param-filename ./icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/decoder_jit_trace-pnnx.ncnn.param \
>   --decoder-bin-filename ./icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/decoder_jit_trace-pnnx.ncnn.bin \
>   --joiner-param-filename ./icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/joiner_jit_trace-pnnx.ncnn.param \
>   --joiner-bin-filename ./icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/joiner_jit_trace-pnnx.ncnn.bin \
>   ./icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/test_wavs/1089-134686-0001.wav
2023-05-25 22:48:47,713 INFO [streaming-ncnn-decode.py:376] {'tokens': './icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/data/lang_bpe_500/tokens.txt', 'encoder_param_filename': './icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/encoder_jit_trace-pnnx.ncnn.param', 'encoder_bin_filename': './icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/encoder_jit_trace-pnnx.ncnn.bin', 'decoder_param_filename': './icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/decoder_jit_trace-pnnx.ncnn.param', 'decoder_bin_filename': './icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/decoder_jit_trace-pnnx.ncnn.bin', 'joiner_param_filename': './icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/joiner_jit_trace-pnnx.ncnn.param', 'joiner_bin_filename': './icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/joiner_jit_trace-pnnx.ncnn.bin', 'sound_filename': './icefall-asr-liTraceback (most recent call last):ess7-streaming-2022-12-29/test_wavs/1089-134686-0001.wav'}
  File "pruned_transducer_stateless7_streaming/streaming-ncnn-decode.py", line 446, in <module>
    main()
  File "pruned_transducer_stateless7_streaming/streaming-ncnn-decode.py", line 378, in main
    model = Model(args)
  File "pruned_transducer_stateless7_streaming/streaming-ncnn-decode.py", line 109, in __init__
    self.init_encoder(args)
  File "pruned_transducer_stateless7_streaming/streaming-ncnn-decode.py", line 210, in init_encoder
    encoder_net.load_model(encoder_model)
  File "/home/icefall/egs/librispeech/ASR/pruned_transducer_stateless7_streaming/ncnn_custom_layer.py", line 223, in load_model
    bias = md.load(self.num_channels, self.upsample, 0)
TypeError: load(): incompatible function arguments. The following argument types are supported:
    1. (self: ncnn.ncnn.ModelBinFromDataReader, w: int, type: int) -> ncnn::Mat

Invoked with: <ncnn.ncnn.ModelBinFromDataReader object at 0x7efe9d4fb470>, 384, 2, 0

@csukuangfj I just git clone the latest icefall code and followed the document https://icefall.readthedocs.io/en/latest/model-export/export-ncnn-zipformer.html, trying to decode the audio using the exported model, still get the same error:

python pruned_transducer_stateless7_streaming/streaming-ncnn-decode.py \

>   --tokens ./icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/data/lang_bpe_500/tokens.txt \

>   --encoder-param-filename ./icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/encoder_jit_trace-pnnx.ncnn.param \

>   --encoder-bin-filename ./icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/encoder_jit_trace-pnnx.ncnn.bin \

>   --decoder-param-filename ./icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/decoder_jit_trace-pnnx.ncnn.param \

>   --decoder-bin-filename ./icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/decoder_jit_trace-pnnx.ncnn.bin \

>   --joiner-param-filename ./icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/joiner_jit_trace-pnnx.ncnn.param \

>   --joiner-bin-filename ./icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/joiner_jit_trace-pnnx.ncnn.bin \

>   ./icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/test_wavs/1089-134686-0001.wav

2023-05-25 22:48:47,713 INFO [streaming-ncnn-decode.py:376] {'tokens': './icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/data/lang_bpe_500/tokens.txt', 'encoder_param_filename': './icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/encoder_jit_trace-pnnx.ncnn.param', 'encoder_bin_filename': './icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/encoder_jit_trace-pnnx.ncnn.bin', 'decoder_param_filename': './icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/decoder_jit_trace-pnnx.ncnn.param', 'decoder_bin_filename': './icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/decoder_jit_trace-pnnx.ncnn.bin', 'joiner_param_filename': './icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/joiner_jit_trace-pnnx.ncnn.param', 'joiner_bin_filename': './icefall-asr-librispeech-pruned-transducer-stateless7-streaming-2022-12-29/exp/joiner_jit_trace-pnnx.ncnn.bin', 'sound_filename': './icefall-asr-liTraceback (most recent call last):ess7-streaming-2022-12-29/test_wavs/1089-134686-0001.wav'}

  File "pruned_transducer_stateless7_streaming/streaming-ncnn-decode.py", line 446, in <module>

    main()

  File "pruned_transducer_stateless7_streaming/streaming-ncnn-decode.py", line 378, in main

    model = Model(args)

  File "pruned_transducer_stateless7_streaming/streaming-ncnn-decode.py", line 109, in __init__

    self.init_encoder(args)

  File "pruned_transducer_stateless7_streaming/streaming-ncnn-decode.py", line 210, in init_encoder

    encoder_net.load_model(encoder_model)

  File "/home/icefall/egs/librispeech/ASR/pruned_transducer_stateless7_streaming/ncnn_custom_layer.py", line 223, in load_model

    bias = md.load(self.num_channels, self.upsample, 0)

TypeError: load(): incompatible function arguments. The following argument types are supported:

    1. (self: ncnn.ncnn.ModelBinFromDataReader, w: int, type: int) -> ncnn::Mat

Invoked with: <ncnn.ncnn.ModelBinFromDataReader object at 0x7efe9d4fb470>, 384, 2, 0

Please install my fork of ncnn. You can find the instructions in the doc. Remember to install the latest commit.


Firebase ML Kit has been depreciated. Please update to use ML Kit SDK

This page describes an old version of the Text Recognition API, which was part of ML Kit for Firebase. The functionality of this API has been split into two new APIs (learn more):
On-device text recognition is part of the new standalone ML Kit SDK, which you can use with or without Firebase.
Cloud text recognition is part of Firebase ML, which includes all of Firebase's cloud-based ML features.

I'm working in it. There will be a new release soon. feature/migrate-to-googlemlkit

Updated to ML Kit SDK https://github.com/alon22/cordova-plugin-firebase-mlvision/tree/master


uninstall_post is not substituting %%%NAMESPACE%%%

Describe the bug
When running the uninstall_post task, Salesforce throws an error UNKNOWN_EXCEPTION: Custom metadata type %%%NAMESPACE%%%[CUSTOM_METADATA_TYPE] is not available in this organization.
Presumably, this is because the uninstall_post task is not doing namespace replacements in package.xml or the metadata itself.  Thedeploy_post task in the install_beta flow is successfully completing with the same unpackaged/post contents.
Samples below (brackets are used throughout for substitute text):
package.xml
...
    <types>
        <members>%%%NAMESPACE%%%[CUSTOM_METADATA_TYPE].[CUSTOM_METADATA_NAME]</members>
        <name>CustomMetadata</name>
    </types>
...

___NAMESPACE___[CUSTOM_METADATA_TYPE].[CUSTOM_METADATA_NAME].md
...
    <values>
        <field>%%%NAMESPACE%%%[FIELD_NAME]</field>
        <value xsi:type="xsd:string">[VALUE]</value>
    </values>
...

Reproduction steps

Create an unpackaged/post folder with metadata that requires namespace labels (such as custom metadata).
Run the deploy_post task on a non-namespaced org.
Confirm the uninstall_post task is configured with managed: True and your namespace.
Run the uninstall_post task on a non-namespaced org.

Your CumulusCI and Python versions
CumulusCI version: 3.53.0 (/Users/chandleranderson/.local/bin/cci)
Python version: 3.10.1 (/Users/chandleranderson/.local/pipx/venvs/cumulusci/bin/python)
Operating System
macOS Monterey 12.2
Windows environment
No response
CumulusCI installation method
pipx
Error Gist
https://gist.github.com/Chanmander/15470b7d5fe85d934c50d6dc5931310d
Additional information
No response

Thanks for the report and detailed instructions on how to reproduce the issue.
From initial inspection it looks like the problem is probably that the task is trying to replace NAMESPACE within package.xml instead of %%%NAMESPACE%%%. I've filed a bug W-10774453 in our internal tracker.

No problem! Thank you for the quick response.


feat(api-v2): Specify custom IRIs when creating resources/values

User story: https://dasch.myjetbrains.com/youtrack/issue/DSP-159

[ ] Refactor resource creation so that generating random resource IRIs, and checking new resource IRIs for uniqueness, happens in ResourcesResponderV2, while holding a lock on the new IRI.
[ ] Have CreateResourceRequestV2.fromJsonLD accept:

[x] a custom resource IRI
[x] custom value IRIs
[x] custom value UUIDs
[ ] custom value creation dates

[ ] Have CreateValueRequestV2.fromJsonLD accept:

[x] a custom value IRI
[x] a custom value UUID
[ ] a custom value creation date

[ ] Have ResourcesResponderV2 and ValuesResponderV2 use this information.
[ ] Add tests.
[ ] Update docs.

@benjamingeer looking at the code I see that: when a resource with multiple values is being created, the creationDate of the resource is also assigned to its values. Since a resource can be created with custom creationData, I believe that is enough for the checksum. Then the values will have the correct creationDate anyway. What do you think?
In my opinion, custom creationDate should only be used for creating single values, i.e. CreateValueRequestV2 should accept a custom creationDate for a value.

Yes, good analysis!

The following refactoring step

Refactor resource creation so that generating random resource IRIs, and checking new resource IRIs for uniqueness, happens in ResourcesResponderV2 while holding a lock on the new IRI.

will happen in DSP-355

@benjamingeer eventually the tests passed!

After thinking about this some more, I think we actually need to accept a custom value creation date for each value even when creating a new resource.

In that case, if no custom creation date is provided for the value of a new resource, the creation date of the resource should be assigned to the value, right?

@benjamingeer last commit contains the implementation "create resources with values that have custom creation dates". Can you please tell me your opinion?

In that case, if no custom creation date is provided for the value of a new resource, the creation date of the resource should be assigned to the value, right?

Yes.
I just talked to Ivan about some additional complexity in copying a repository. The result is that there's a new user story for additional functionality (https://dasch.myjetbrains.com/youtrack/issue/DSP-398). This would also require being able to specify:

a custom value creation date when adding a new version of a value
a custom delete date when marking a value as deleted

Do you want to do those in this PR?

Do you want to do those in this PR?

No, I prefer to do it in a separate PR.

I prefer to do it in a separate PR.

OK then I think this one is good to merge! You can approve it yourself. :)


Add lightbulb icon

Added a lightbulb icon for tips and tricks. I went with the solid version to be consistent with our other icons, even though some designs have been using the outlined version.

@TedGoas , can you help me understand the difference between the lightbulb and information icons? Based only on their definitions, I'm not sure it's readily apparent to me.
Information
Communicates the ability to learn more about an item. If set inline within a page, usually a tooltip is paired with it to provide clarifying item.
Lightbulb
Communicates a tip or trick.

How I understand it:
Info: Passive information, if you're interested.
Tip: We're suggesting you do something.

How I understand it:
Info: Passive information, if you're interested.
Tip: We're suggesting you do something.

Gotcha. Do you mind adding that little bit into the description so we can stave off any confusion between the two?