[Bug]: OutOfMemoryError when loading a small model with a huge context length

Your current environment
Collecting environment information...
 While it is correct that technically the model does not fit, such models should still start with reduced context size.
An easily reproducible example is gradientai/Llama-3-8B-Instruct-Gradient-1048k which is 8B with a 1M context. It will fail to start on any single GPU:
python -m vllm.entrypoints.openai.api_server --model gradientai/Llama-3-8B-Instruct-Gradient-1048k

Results in:
INFO 06-26 07:48:15 model_runner.py:160] Loading model weights took 15.2075 GB
[rank0]: Traceback (most recent call last):
[rank0]:   File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
[rank0]:     return _run_code(code, main_globals, None,
[rank0]:   File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
[rank0]:     exec(code, run_globals)
[rank0]:   File "/home/adam/work/vllm-parasail/vllm/entrypoints/openai/api_server.py", line 196, in <module>
[rank0]:     engine = AsyncLLMEngine.from_engine_args(
[rank0]:   File "/home/adam/work/vllm-parasail/vllm/engine/async_llm_engine.py", line 415, in from_engine_args
[rank0]:     engine = cls(
[rank0]:   File "/home/adam/work/vllm-parasail/vllm/engine/async_llm_engine.py", line 355, in __init__
[rank0]:     self.engine = self._init_engine(*args, **kwargs)
[rank0]:   File "/home/adam/work/vllm-parasail/vllm/engine/async_llm_engine.py", line 490, in _init_engine
[rank0]:     return engine_class(*args, **kwargs)
[rank0]:   File "/home/adam/work/vllm-parasail/vllm/engine/llm_engine.py", line 243, in __init__
[rank0]:     self._initialize_kv_caches()
[rank0]:   File "/home/adam/work/vllm-parasail/vllm/engine/llm_engine.py", line 326, in _initialize_kv_caches
[rank0]:     self.model_executor.determine_num_available_blocks())
[rank0]:   File "/home/adam/work/vllm-parasail/vllm/executor/gpu_executor.py", line 75, in determine_num_available_blocks
[rank0]:     return self.driver_worker.determine_num_available_blocks()
[rank0]:   File "/home/adam/venvs/vllm/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
[rank0]:     return func(*args, **kwargs)
[rank0]:   File "/home/adam/work/vllm-parasail/vllm/worker/worker.py", line 163, in determine_num_available_blocks
[rank0]:     self.model_runner.profile_run()
[rank0]:   File "/home/adam/venvs/vllm/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
[rank0]:     return func(*args, **kwargs)
[rank0]:   File "/home/adam/work/vllm-parasail/vllm/worker/model_runner.py", line 844, in profile_run
[rank0]:     self.execute_model(seqs, kv_caches)
[rank0]:   File "/home/adam/venvs/vllm/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
[rank0]:     return func(*args, **kwargs)
[rank0]:   File "/home/adam/work/vllm-parasail/vllm/worker/model_runner.py", line 749, in execute_model
[rank0]:     hidden_states = model_executable(
[rank0]:   File "/home/adam/venvs/vllm/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1532, in _wrapped_call_impl
[rank0]:     return self._call_impl(*args, **kwargs)
[rank0]:   File "/home/adam/venvs/vllm/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1541, in _call_impl
[rank0]:     return forward_call(*args, **kwargs)
[rank0]:   File "/home/adam/work/vllm-parasail/vllm/model_executor/models/llama.py", line 371, in forward
[rank0]:     hidden_states = self.model(input_ids, positions, kv_caches,
[rank0]:   File "/home/adam/venvs/vllm/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1532, in _wrapped_call_impl
[rank0]:     return self._call_impl(*args, **kwargs)
[rank0]:   File "/home/adam/venvs/vllm/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1541, in _call_impl
[rank0]:     return forward_call(*args, **kwargs)
[rank0]:   File "/home/adam/work/vllm-parasail/vllm/model_executor/models/llama.py", line 288, in forward
[rank0]:     hidden_states, residual = layer(
[rank0]:   File "/home/adam/venvs/vllm/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1532, in _wrapped_call_impl
[rank0]:     return self._call_impl(*args, **kwargs)
[rank0]:   File "/home/adam/venvs/vllm/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1541, in _call_impl
[rank0]:     return forward_call(*args, **kwargs)
[rank0]:   File "/home/adam/work/vllm-parasail/vllm/model_executor/models/llama.py", line 237, in forward
[rank0]:     hidden_states = self.mlp(hidden_states)
[rank0]:   File "/home/adam/venvs/vllm/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1532, in _wrapped_call_impl
[rank0]:     return self._call_impl(*args, **kwargs)
[rank0]:   File "/home/adam/venvs/vllm/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1541, in _call_impl
[rank0]:     return forward_call(*args, **kwargs)
[rank0]:   File "/home/adam/work/vllm-parasail/vllm/model_executor/models/llama.py", line 79, in forward
[rank0]:     gate_up, _ = self.gate_up_proj(x)
[rank0]:   File "/home/adam/venvs/vllm/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1532, in _wrapped_call_impl
[rank0]:     return self._call_impl(*args, **kwargs)
[rank0]:   File "/home/adam/venvs/vllm/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1541, in _call_impl
[rank0]:     return forward_call(*args, **kwargs)
[rank0]:   File "/home/adam/work/vllm-parasail/vllm/model_executor/layers/linear.py", line 298, in forward
[rank0]:     output_parallel = self.quant_method.apply(self, input_, bias)
[rank0]:   File "/home/adam/work/vllm-parasail/vllm/model_executor/layers/linear.py", line 111, in apply
[rank0]:     return F.linear(x, weight, bias)
[rank0]: torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 56.00 GiB. GPU

This error is in the profile_run used to determine memory usage. If I patch the code to ignore the error, and a few lines below patch the model length to make raise_if_cache_size_invalid happy, the model starts. Sure it won't reach the full 1M context, but it will work with 200k on an 80GB GPU.
This will be more pressing for users of small GPUs as the popular models increase their context lengths beyond 8k.
I'm happy to submit my monkey patches if there isn't already a plan to support large context models.

You can manually set --max-model-len to reduce the context size.
Not sure whether it's a good idea to automatically limit the context length based on available memory. @simon-mo any thoughts?

You can manually set --max-model-len to reduce the context length.
Not sure whether it's a good idea to automatically limit the context length based on available memory. @simon-mo any thoughts?

Agreed that a purely automatic setting may give folks the wrong impression that they can use the full context of the model even if their hardware won't allow it. One alternative is --max-model-len max that would start the model no matter what and report the actual max context in the logs.
Right now someone must start vllm, see the crash, parse out the max context size from the log, and set that with --max-model-len. But that's only if the profile_run() doesn't OOM with the exception in the OP, in that case the user must guess at the max model len (the log message with the actual max is printed later, and depends on profile_run() succeeding).


Normalize URI before redirect in order to avoid :badarg failure from nil port in URI

Per #327 - URI.merge/2 overwrites port attribute with nil during merge with relative redirect URI.  Since URI.merge/2 correctly follows RFC 3986 5.2 Relative Resolution, a separate normalization step is needed to include RFC 3986 6.2.3 Scheme-Based Normalization.
Note: a test was not included since Bypass runs on a port other than 80 or 443, and we would explicitly need to test to see if the port will be defaulted to 80/443 (depending on the original URI scheme).  However, we were able to confirm a test watching for :badarg exit fails prior to the patch and succeeds after the patch.  This test has been excluded from the PR since it hangs the tests while waiting for a connection timeout in the success case.

Thank you. Could you look into testing it using the :plug feature, without bypass?

I tried to implement a test using the :plug feature via the following:
test "inherit port", c do
  relative_redirect = fn
    %Plug.Conn{host: "redirected", port: nil} ->
      flunk("port cannot be nil")

    %Plug.Conn{host: "redirected", port: 80} = conn ->
      Plug.Conn.send_resp(conn, 200, "ok")

    conn ->
      conn
      |> Plug.Conn.put_resp_header("location", "//redirected")
      |> Plug.Conn.send_resp(301, "")
  end

  assert ExUnit.CaptureLog.capture_log(fn ->
           assert Req.get!(c.url, plug: relative_redirect).status == 200
         end) =~ "[debug] redirecting to //redirected"
end

However, in the underlying Plug.Adapters.Test.Conn.conn/4 port is coalesced into 80 (https://github.com/elixir-plug/plug/blob/2eda50618296b1c0e5fd9d0066e382c34b28ea0a/lib/plug/adapters/test/conn.ex#L39), so it masks the failure case and the above test will always pass.
The above test at least ensures that there's no fatal error with the normalize_redirect_uri/1 code, though I don't think it's entirely useful.  Happy to entertain any other ideas...


Add some non-French characters

Top candidates:

å/Å (Danish, Norwegian, Finnish).
ø/Ø (Danish, Norwegian).
More?

Full list:

(source)

Also, I noticed that the common greek characters that are widely used in many contexts (i.e., pi, delta, omega, mu, sigma) got removed despite their usefulness. Is there a reason for that and can we hope to have them back?

@nisaea the documentation is missing this part and needs to be updated. Did you consider using the dedicated greek dead key that was added as a replacement?

To access this, you need to press Option ⌥g (‶g″ for ‶greek″) and then press the relevant letter for example p for π.

Oh, brilliant! I didn't find the info in the docs so I was confused. This will come in very handy for scientific notations. Thank you!
That, indeed, leaves quite a few free spots for extra characters on the regular AltGr layer. I agree Å and Ø would be nice. Do we have a dead key to type acute accents on arbitrary vowels as is required in many languages? Would that make sense in this layout's philosophy?

We do have a dead key both for the acute accent and the grave accent. You can find them here:

I agree that the documentation is lackluster. I'm still working on improving the keyboard and then I'll work on making the documentation better.
I'm working on a math mode as well, it may interest you :)
https://github.com/qwerty-fr/qwerty-fr/issues/11

You're definitely on your way to make THE perfect layout. Thank you so much!


bevy_ggrs_example errors when run with wasm32-unknown-unknown target

When bevy_ggrs_example is run via cargo run -p bevy_ggrs_example --target wasm32-unknown-unknown, the following error message is produced
Finished dev [unoptimized + debuginfo] target(s) in 24.69s
 Running `target/wasm32-unknown-unknown/debug/bevy_ggrs_example.wasm`
target/wasm32-unknown-unknown/debug/bevy_ggrs_example.wasm: 1: Syntax error: end of file unexpected

Have tried a previous known commit (8ab956136b6db9b09180bc615515eb3fee4e6637) and am seeing the same error...

The command you used also caused an issue for me! But when I cd examples/bevy_ggrs and then cargo run --target wasm32-unknown-unknown, it works just fine.

I'm not sure why that is.

Yeah I have wasm-server-runner set globally on my machine, but it still fails when run from the project root, since it can't find the assets directory. Probably simpler to just say people must run it from the example dir.

Ah, that'll be it then, will make a change to the Readme this evening


state which dvc config option (local/global/system) is default

https://dvc.org/doc/commands-reference/config does not state which of --local , --global, or --system is the default, if none of those options is included.

The default is --local, right? I'm happy to make this change myself.

@gwerbin please, see my comment https://github.com/iterative/dvc.org/pull/628#pullrequestreview-289583585
I think we still can rewrite and clarify it better.


Use my own RGB-D sequence from Kinect 1.0 or 2.0

Hi, thank you very much for your great work first.
There are three questions that confuse me.First, can I use my own RGB-D sequence from Kinect 1.0 or 2.0?Second, if so, can this guide in the Readme still work?https://www.open3d.org/docs/release/tutorial/sensor/azure_kinect.html#install-the-azure-kinect-sdk Third,If this guide doesn't work, then what should I do?
Thank you so much!

Hi, thanks for your interest in our work. I am not very familiar with Kinect 1.0 or 2.0, the specific procedure for getting the RGB-D frames, might be different, but after getting the frames, the rest would be the same with Kinect Azure.


Add user garagatyi to the admin list

Add me<EMAIL_ADDRESS>to the admin list

Can one of the admins verify this patch?


Disable/Enable existing conditional breakpoint

Sometimes a developer may add a conditional breakpoint which needs to be disabled and re-enabled. This can be achieved right now by completely removing the breakpoint. But re-adding it needs the condition to be given again and again.
Is there a way to achieve this by the plugin itself?

I've added a new toggle mapping for the breakpoints buffer, please try the latest commit :grin:

Hi! Thanks for the feature. I tried the toggle, but the toggling seem to take effect only if I restart the debug session. Is that the behavior you intended?
I'd expect it to disable/enable right after I disable or enable it.
If its unclear I'll try to show an example. Btw, I'm trying the feature for c++

That was due to how rendering worked. This should be working as expected now


[BUILD]

Environment
Operating System: (e.g. Windows 2019, macOS-10.15, Linux CentOS 7.4)
Version / Commit SHA: (e.g VDB 7.2, SHA: 1a2b3c4d5e...)
CMake Version: (e.g. 3.18)
Compiler: (e.g. gcc 10, msvc 2019)
Describe the problem
(A clear and concise description of the encountered issue.)
To Reproduce
Steps to reproduce the behavior:

Checkout repo '...'
Run CMake '....'
Build with '....'
See error

Additional context
(Add any other context about the problem here.)

Closing due to no infor


Fix swiss ptrt for remote heating

📚 Documentation preview 📚: https://emiproc--61.org.readthedocs.build/en/61/

Solves #60

@corink21  Following our discussion i changed back 1.c to eipro .
However I changed things to add new categories which come only from point sources, which I need for my project.
If you approve, we can merge this.


VSR Model Training Issues

We are learning the VSR model as it is without any modifications.
The code you proceed with during your study is as follows.
python train.py exp_dir=[exp_dir]
exp_name=[exp_name]
data.modality="video"
data.dataset.root_dir=[root_dir]
data.dataset.train_file="lrs3_train_transcript_lengths_seg24s.csv"
data.dataset.val_file="lrs3_test_transcript_lengths_seg24s.csv"
trainer.num_nodes="1"
trainer.gpus="5"
data.max_frames="1800"
optimizer.lr="0.0002" \
: However, even after training the code several times, the values of "decoder_acc_step" and "decoder_acc_val" do not change when they exceed Epoch 30.
This means that the loss value does not drop.
Is there anything else important to set up when training in particular?
Thank you for your response in advance.

Hi @jeonhuhuhu,
The learning rate 0.0002 is only used when training the subset of lrs3, in that case, I think data.dataset.train_file should be set to lrs3_train_transcript_lengths_seg24s_0to100.csv. It's also worth noting that we've included the vsr_trlrs3_23h_base.pth in model zoo for your convenience. Please feel free to use the provided checkpoint If you wish to skip this step.
After that, for fine-tuning the pre-trained model on the complete LRS3 dataset, please pass the path to pretrained_model_path as an argument and set the learning rate to 0.001. I provide the command lines below:
python train.py exp_dir=[exp_dir]
exp_name=[exp_name]
data.modality="video"
data.dataset.root_dir=[root_dir]
data.dataset.train_file="lrs3_train_transcript_lengths_seg24s.csv"
data.dataset.val_file="lrs3_test_transcript_lengths_seg24s.csv"
trainer.num_nodes="1"
trainer.gpus="5"
data.max_frames="1800"
optimizer.lr="0.001"
pretrained_model_path=[model_path_of_vsr_trlrs3_23h_base]

Hi @jeonhuhuhu,
The learning rate 0.0002 is only used when training the subset of lrs3, in that case, I think data.dataset.train_file should be set to lrs3_train_transcript_lengths_seg24s_0to100.csv. It's also worth noting that we've included the vsr_trlrs3_23h_base.pth in model zoo for your convenience. Please feel free to use the provided checkpoint If you wish to skip this step.
After that, for fine-tuning the pre-trained model on the complete LRS3 dataset, please pass the path to pretrained_model_path as an argument and set the learning rate to 0.001. I provide the command lines below:
python train.py exp_dir=[exp_dir] exp_name=[exp_name] data.modality="video" data.dataset.root_dir=[root_dir] data.dataset.train_file="lrs3_train_transcript_lengths_seg24s.csv" data.dataset.val_file="lrs3_test_transcript_lengths_seg24s.csv" trainer.num_nodes="1" trainer.gpus="5" data.max_frames="1800" optimizer.lr="0.001" pretrained_model_path=[model_path_of_vsr_trlrs3_23h_base]

Thank you for your answer.
We also conducted an experiment by referring to your GitHub questions and experimented as the answer above.
When experiments were conducted using only 100 frames or less of data, using your model as it is resulted in 25% decoder_acc_val.
And, using a pretrained model with 25% accuracy, we are re-training the entire data(LRS3) again and have 27% accuracy(decoder_acc_val) at 17 epoch, so I wonder if the training is going well.
If you can share the results of the process of changing training accuracy when you train?


Add a confirmation input to UIConsole

You can base yourself out of the TerminalConsole's getConfirmation() method that has been added in the dev branch.

Swiftly added in commit 74abbabc45c47e23579b675ac9a962863f5be5e0 : closing this issue as it's already implemented, even abstractly in AbstractUIConsole.


add extract-split closes #625

Description
add extract-split method to cli. closes #625
How was this PR tested?
locally

A better commit comment would be:
Add CLI command to extract split files.

Closes #625


Use aliases for React and React-DOM

This ensures that @oacore/design doesn't use own react copy when using npm link @oacore/design command

Is there no way to make this work so in the @oacore/design?

I couldn't find a solution it came to my mind too.

Merging this. If we find a better solution directly in design then it can be removed.


Elementwise masking

It would be nice to extend the elementwise masking capability of INDArrays for RichNDArrays.
For example def :<=(other : Number) returns the matrix that results from doing an elementwise less than or equal to operation. Indices where the expression is false is 0, otherwise it remains the same as that in the matrix.

Now you can elementwise masking like this.
val ndArray =
      Array(
        Array(1, 2, 3),
        Array(4, 5, 6),
        Array(7, 8, 9)
      ).toNDArray

ndArray.filter(_ > 3)

assert(filtered ==
      Array(
        Array(0, 0, 0),
        Array(4, 5, 6),
        Array(7, 8, 9)
      ).toNDArray)

val filterMasked = ndArray.filterBit(_ % 2 == 0)

assert(filterMasked ==
      Array(
        Array(0, 1, 0),
        Array(1, 0, 1),
        Array(0, 1, 0)
      ).toNDArray)

Since too many custom operators may spoil source code readability, I use filter function name as Scala Collection has similar one :).


Any plans to extend to Vimeo videos too?

Lovely little plugin. Any plans to allow Vimeo links too.

Will not do it myself, but would merge a PR which would enable it!
It's a 12 line program so I think it would not be so hard to add Vimeo support!


Raise internal storage's default quota

Coverage remained the same at 34.801% when pulling 1cd4b1aea53cdd2068df1f76a122c5a54c7d4d1c on zhiyuhe/fix_storage_quota into 721788ccef1cd5cae079a1bc3212d6cf7c7619b7 on master.


rbd: add CreateMirrorPeerBootstrapToken & ImportMirrorPeerBootstrapToken functions

Depends on #494
Resolves #485

Add CreateMirrorPeerBootstrapToken implementing rbd_mirror_peer_bootstrap_create
Add ImportMirrorPeerBootstrapToken implementing rbd_mirror_peer_bootstrap_import

These functions can be used to set up mirroring between pools. Basic tests     included. The tests only verify that functions work, not that they     actually mirror data. That is a job for another day.
Checklist

[x] Added tests for features and functional changes
[x] Public functions and types are documented
[x] Standard formatting is applied to Go code

@mergifyio rebase


OTA Update over zigbee2mqtt (TZ-471)

Answers checklist.

[X] I have read the documentation ESP Zigbee SDK Programming Guide and the issue is not addressed there.
[X] I have updated my IDF branch (master or release) and ESP Zigbee libs (esp-zboss-lib and esp-zigbee-lib) to the latest version and checked that the issue is present there.
[X] I have searched the issue tracker for a similar issue and not found a similar issue.

IDF version.
v5.3-dev-582-gab03c2ea13
esp-zigbee-lib version.
1.0.5
esp-zboss-lib version.
1.0.0
Espressif SoC revision.
ESP32-H2
What is the expected behavior?
I want to upgrade esp32h2 over zigbee2mqtt.
What is the actual behavior?
zigbee2mqtt does not send normal binary. Because file header is not supported.
An example header bytes of OTA file.
0000000 f11e 0bee 0100 0038 0000 128b 0106 0401
Binary file of esp32h2 application
0000000 05e9 1f02 0250 4080 00ee 0000 0010 0000
I think, binary file has to start with 0xf11e.  Then this can be sent to me zigbee2mqtt. But esp32h2 should also accept that.
Steps to reproduce.

Step
Step
Step
...

More Information.

Hi,
This issue is related to my question in https://github.com/espressif/esp-zigbee-sdk/issues/146, which by the way I should have written as a feature request.
I think a there is a need to have a script that can create a standard OTA file from an ESP-IDF binary.
At the moment, I did not have time to investigate the tool that @nomis mentioned into my issue, but for sure, I would prefer that Espressif provides this tool OOTB.

I think, binary file has to start with 0xf11e. Then this can be sent to me zigbee2mqtt. But esp32h2 should also accept that.

What you're asking for is not possible. The format of the application binary running on the ESP32 and the format of the specification for Zigbee OTA files are different and cannot be changed.
You need to identify where the content of the upgrade image sub-element begins in the image and use that with the ESP OTA functions, as I've told you twice in https://github.com/nomis/candle-dribbler/discussions/2.
This is not a bug. A realistic feature request would be wrapper functions that can parse the first upgrade image sub-element from a stream for you (and do transparent zlib decompression, because ESP32 applications are always huge).

Thank you for your prompt response.
I faced challenges with the C++ code, prompting me to seek alternative solutions. Currently, I am in the process of experimenting with the subelement, attempting to introduce a delay in the reception of bytes.


Fixed issue #3196

Fixed issue #3196

Closing as a dupe of #3340

ok

@akre54 sorry, I have even seen that already had a pull request but as it was already closed for three months, so I thought this issue-3196 was waiting pull request yet. Thanks.


Download Docker CE without logging in

Please reconsider your stance on this issue: https://github.com/docker/docker.github.io/issues/6910
Problem description
Docker for Mac and Docker for Windows cannot be downloaded without logging into Docker Store.
This is especially painful when you forget your docker store password and the reset link takes forever to arrive in your inbox.
Problem location
On the following URL: Install Docker for Mac and Install Docker for Windows
Suggestions for a fix
Do not require a login to docker store to download the CE editions.

7 hours later, my docker store password reset email has still not arrived. I tried twice. Boosting the motivation for this issue to be seriously considered. Thank you.

@joaofnfernandes via https://github.com/docker/docker.github.io/issues/6910#issuecomment-398819417

improve the Docker for Mac and Windows experience for users moving forward.

Could you name directly (as a bullet points) how would the user benefit? For sure that was not an empty words, you had to have something in mind to make this move and this statement.
I'd say that the only experience user (who pops in to get the file and forget about your website) would have is a frustration, but I may be wrong.

I'm against the fake limitations to the public projects, but if you really have a true explanation, I'd accept that.
Your move.

This also specifically impacts users. I.e. people who heard of Docker or otherwise need to run software packaged as Docker stacks/images. They don't develop, they use. Now, in addition to getting them to trust "this Docker thing", they've got to register a new account at a third party, agreeing to ToS et al, which have nothing to do with the product they're trying to get running.
We were talking about delivering our (Windows) enterprise on-premises app (1.5k customers, 200k+ daily users) as a Docker virtual appliance, but I will put that project on hold. Because I fear that the insultingly evasive and objectively false responses by Docker to the original issue are just the beginning. The days Docker existed in a vaccum are long gone, and there are a handful of viable alternatives.
But please do prove me and others wrong. Reverse this "feature", post a short mea culpa, and restore a bit of trust in your target market™.

My concern would be that user protests of this action could be considerably costly to the project.
For example, what if everyone with a docker store login were to start sending in 'stop processing' requests under GDPR..  Even if they are not EU citizens.  Firstly just dealing with that volume of mail is going to be a burden.. then you either need multiple policies (expensive) based on where people are citizens, or you save costs there and apply GDPR rights to all your users.   That's a lot of work.
Then to compound that, Nobody really knows how to handle the stop-processing request, how do you retain the data but ensure it is not processed in any way?   and while difficult for you, it's easy for the user to tell if you fail because if they get an email from the project its clear that their data is still being processed, and then let slip the dogs of complaints to the regulatory agencies.
and if you though dealing with user requests was fun, just imagine dealing with multiple EU regulators who want to talk to you about your uses for the data and if the data being used is appropriate to the task or could it have been anonymized, or did you really need the email to provide a better user experience?

The radio silence speaks volumes rather loudly!

Closing this ticket due to its age, and the impending refactor. If you think this is in error, feel free to reopen. Thanks!

from the other thread, the changelog pages have direct links to every version on them, you can use these to download without a user/pass (working as of the posting of this comment):

windows
mac

@ericketts, it has changed since you commented, isn't it?


Now consider starting a new project on the yiisoft/app or yiisoft/yii-demo

Now I'm going to start a new project on yiisoft/app or yiisoft/demo. I don't know if it's suitable at present. I hope you can give me some suggestions

Use yiisoft/app.


Provide error: The import service for DOIs cannot be reached (Crossref or DataCite)

Enhancement
Provide error: The import service for DOIs cannot be reached (Crossref or DataCite)

Connection errors => CrossRef is unreachable (The wire between the Backoffice & Crossref is blocked for whatever technical reason; or the CrossRef API is offline)

For context, see epic #1091
Success criteria
Whenever there are connection issues, and the import service for DOIs can not be reached (Crossref or DataCite):

[ ] a toaster is shown that is only removed by clicking
[ ] for publications (see example)
[ ] and datasets (see example)

Implementation suggestion
Publications
Component: https://biblio-backend-ugent-prototype.vercel.app/styleguide/b-toasts.html#component-02-b-toast-2-lines

Please adapt the route to other import options, this is now just a link:

            DOI import

        <button class="close" type="button" data-dismiss="toast" aria-label="Close">

        </button>

The publication could not be imported.

The import service Crossref could not be reached.

Try again later, or use a different import option.

Datasets

Please adapt the route to manual import, this is now just a link:

            DOI import

        <button class="close" type="button" data-dismiss="toast" aria-label="Close">

        </button>

The dataset could not be imported.

The import service DataCite could not be reached.

Try again later, or manually add your dataset.

@netsensei is this the type of error you expect? Does it still need extra codes for developers?

@mietcls Yes. I think it should be informative enough for users. Maybe replace "The import service CrossRef..." with "The CrossRef database is currently unreachable"? + make CrossRef linkable to crossref.org? Do the same for Datacite?
I don't think codes or request ID's will be helpful here. If these services become unavailable, we'll be notified via the review team anyway. If the problem exists on the side of these services, there isn't anything we can do except wait until they become available again.

@netsensei I'm using language that people that don't use technical language understand, which is why I'm using service instead of database. They key is that we need an other service to complete this, and that one is unavailable.
I also had a design with links to crossref and datacite but it drew a lot of attention, people need to be able focus on the solutions. I'll check if I can make the links subtle.

Do we get error codes here as well, such as 4** or 5**?

Sure, something along the lines of "the publication could not be found with the Crossref service" (404) or "the publication could not be retrieved from the Crossref service at this time." (50x). 50x errors usually are transient, whereas 40x errors may be permanent (e.g. the publication never gets published via the service,... YMMV)


Download Script SSL

From @croemmich on August 25, 2016 5:20
The download script listed in the docs (http://deis.io/deis-cli/install-v2.sh) is currently being served over a non-ssl connection allowing a MITM attack to replace the script and fetch a rogue client binary. That'd be all sorts of bad...
Copied from original issue: deis/workflow-cli#200

From @bacongobbler on August 25, 2016 14:55
The problem right now is that the install script is hosted by Github Pages, which does not support SSL. For the time being, the best way to prevent MITM attacks and to use SSL for installing the client is to either

verify that the script downloaded with curl matches https://github.com/deis/deis.io/blob/gh-pages/deis-cli/install-v2.sh
manually download the client via curl -o deis https://storage.googleapis.com/workflow-cli/v2.3.0/deis-v2.3.0-linux-amd64
Use curl https://raw.githubusercontent.com/deis/deis.io/gh-pages/deis-cli/install-v2.sh | bash instead.

Hope this helps :)

From @Joshua-Anderson on August 25, 2016 15:25
@slack Would it be possible to move this script to deis.com? I guess that would close source the script, but we could also move it to a subdomain like what we do for helm classic and get.helm.sh.

From @croemmich on August 25, 2016 18:12
Could you move the source to the documentation repository? If I'm not mistaken, that gets built and hosted on deis.com which has ssl. The script doesn't really do that much and is only every referenced from the documentation.

From @bacongobbler on August 25, 2016 19:4
I think that'd be reasonable since deis.com is a private repo due to licensing issues with the blog posts. It would allow contributors to continue providing updates and enhancements to the script and we get it backed by SSL. Problem is that the URL would then be https://deis.com/docs/workflow/deis-cli/install-v2.sh which would be a little too long to type out. Optimally if it were hosted by deis.com it would be preferred to have it at something like https://deis.com/install-v2.sh

From @croemmich on August 27, 2016 0:16
Personally, I'll probably always copy and paste it so length doesn't matter much to me. As far as your deis.com brand goes, https://deis.com/install-v2.sh would definitely be optimal.

From @bacongobbler on September 19, 2016 20:54
We're planning on a site-wide migration over to deis.com so this will eventually happen. The ticket for doing this is behind closed doors (so to speak) so there's no public announcement on when that'll happen, but there is a migration plan for deis.io content to move to deis.com.
This isn't something we can implement within this release though, so I'll remove the milestone. I'm also removing the priority as there is a workaround for users who are concerned about MITM attacks:
curl https://raw.githubusercontent.com/deis/deis.io/gh-pages/deis-cli/install-v2.sh | bash

From @rvadim on December 21, 2016 4:1
Download of 2.3.0 works fine, but latest versions not actually works
$ curl -o deis https://storage.googleapis.com/workflow-cli/v2.9.1/deis-v2.9.1-linux-amd64
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   127  100   127    0     0    224      0 --:--:-- --:--:-- --:--:--   225
/ $ cat deis
<?xml version='1.0' encoding='UTF-8'?><Error>NoSuchKey<Message>The specified key does not exist.</Message></Error>/ #
/ $ curl https://storage.googleapis.com/workflow-cli/v2.9.1/deis-v2.9.1-linux-amd64
<?xml version='1.0' encoding='UTF-8'?><Error>NoSuchKey<Message>The specified key does not exist.</Message></Error>/ #
/ $
/ $ curl https://storage.googleapis.com/workflow-cli/v2.9.0/deis-v2.9.0-linux-amd64
<?xml version='1.0' encoding='UTF-8'?><Error>NoSuchKey<Message>The specified key does not exist.</Message></Error>/ #
/ $
/ $ curl https://storage.googleapis.com/workflow-cli/v2.8.0/deis-v2.8.0-linux-amd64
<?xml version='1.0' encoding='UTF-8'?><Error>NoSuchKey<Message>The specified key does not exist.</Message></Error>/ #

From @mboersma on December 21, 2016 15:58
@rvadim that URL isn't correct, it should be in the "workflow-cli-release" directory. Try this one:
$ curl -o deis https://storage.googleapis.com/workflow-cli-release/v2.9.1/deis-v2.9.1-linux-amd64
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 9021k  100 9021k    0     0  14.1M      0 --:--:-- --:--:-- --:--:-- 14.1M

From @rvadim on December 22, 2016 4:15
@mboersma Thank you.

We moved this cli download script to this Github home repo and using Google Storage to host the cli binaries so this issue is closed via https://github.com/teamhephy/workflow-cli/pull/34


Better bot name

Lets try to list ideas for a bot name here and decide on a better name.

since this is West World night my first choice is...
Dolores
alternate choice
Campy

I approve Campy 👍

+1 Campy

:+1: Dolores myself. Campy is too campy :P

Also remember that you can have the name be anything you want in the server. So we could name the bot DoloresBot and campy on the discord.

Yeah I agree but I don't want too much confusion if their is seperate names between the GitHub and actual name

bitterButterBattleBot

Seems like it is going to be called campy. @campDevs/discordbot Any more suggestions?

maybe one more blind vote in #general chat with some decent names peppered into the mix?


Refactor sql-mapper

:warning: Please install the  to ensure uploads and comments are reliably processed by Codecov.
Codecov Report
Attention: Patch coverage is 0% with 40 lines in your changes missing coverage. Please review.

Project coverage is 15.44%. Comparing base (9860f19) to head (d592cd6).

Files with missing lines
Patch %
Lines

pkg/mapper/sql-mapper/mapper.go
0.00%
40 Missing :warning:

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@           Coverage Diff           @@
##             main       #2   +/-   ##
=======================================
  Coverage   15.44%   15.44%
=======================================
  Files          19       20    +1
  Lines         764      764
=======================================
  Hits          118      118
  Misses        640      640
  Partials        6        6

Flag
Coverage Δ

15.44% <0.00%> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Write a Kotlin program to check palindrome string

Description
Write a Kotlin program to check palindrome string
Palindrome string is a string that is same when read from left to right and right to left. For example, "aba" is a palindrome string, "abc" is not.
Input  : abba
Output : Palindrome String

How to contribute

Save the solution in CheckPalindromeString.kt file
Add CheckPalindromeString.kt file in check-palindrome-string folder

!assign


minor refactor

SSIA

Codecov Report
Attention: Patch coverage is 50.00000% with 2 lines in your changes missing coverage. Please review.

Project coverage is 78.04%. Comparing base (1b53f7e) to head (e6beebf).

Files
Patch %
Lines

src/rules/compare_table_suffix_with_subquery.rs
0.00%
2 Missing :warning:

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@            Coverage Diff             @@
##             main      #23      +/-   ##
==========================================
+ Coverage   77.10%   78.04%   +0.94%
==========================================
  Files           5        5
  Lines         498      492       -6
==========================================
  Hits          384      384
+ Misses        114      108       -6

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Swagger 3 upgrade

It all seems to compile just fine, but i'm getting some NPEs that i'm trying to track down when running:
I also seem to be getting the same when running "hello-world-example/test"
Caused by: java.lang.NullPointerException
at com.jakehschwartz.finatra.swagger.FinatraOperation.pathParam(FinatraOperation.scala:23)
Caused by: java.lang.NullPointerException
at com.jakehschwartz.finatra.swagger.FinatraOperation.respondsWith(FinatraOperation.scala:110)

@mgd43b Got rid of all the NPEs but now theres nothing in the json file that gets generated hahaha. Will continue trying

@mgd43b Getting closer, the only problem I am seeing is with the AddressModel ref

@mgd43b I think I got it working. If you could try it locally to make sure I didnt break anything, that would be a big help.
Otherwise I just may merge it and deal with the bugs later :)

@jakehschwartz  - this is working for me locally, thanks!


fides push should push custom taxonomy first

When you do a fides push, it doesn't seem like there is a preferred order in which resources are pushed. This can lead to failures if a system or dataset is pushed before custom taxonomy extensions, and relies on a custom taxonomy element.
I think it would be better if fides push looked for any taxonomy extensions and always pushed those first, then pushed systems, datasets, etc.

@mfbrown  is this still an issue?

Yes. Anytime using Fides push to push a large manifest file of multiple types of Fides resources, there's no guarantee that taxonomy is pushed first.

What's the impact?

Whenever systems or datasets that reference custom taxonomy elements are pushed first, the whole push fails, since you can't reference taxonomy elements that don't exist.


Incorrect parsing of .src files on case sensitive file systems

Parsing of additional .src files fails on case sensitive systems, if the content of parent .src file doesn't match the case of the file.

should be working now as of a77a437d88dc80c760ed85c50447960855ea8e0f

Now works without any issues.


pj-rehearse: add information about the new 'reject' and 'refresh' commands

self-explanatory.
/cc @droslean @openshift/test-platform

/retest

/lgtm


vdk-dag: improve DAGs docs and example

What:
Improve DAGs user-facing documentation and example based on the feedback and discussions with users.
The feedback we got from users is:

The Requirements section in the example links VDK DAGs to the VEP, it should rather link to the README. > Addressed.
Would it be possible to run the example with a DB of choice or am I required to use Trino? > Addressed.
The team name has to be added on several occasions and this could lead to some consistency issues. > Addressed.
The configuration variables are not very visible in the README. > Addressed.

Signed-off-by: Yoan Salambashev<EMAIL_ADDRESS>

Reading the PR description:

Improve DAGs user-facing documentation and example based on the feedback and discussions with users

I don't understand what the user feedback was

It was not properly described. Changed the description to address this.


Add a combine batch_matmul pass

Contrary what you might expect, this doesn't share as much code with the combine dense pass as it does with the combine 2d conv pass. This is because it concatenates the "output feature" dimensions just like the 2d conv pass concatenates output channels, whereas combine dense stacks the various matmul arguments.
I'm not sure if there is a deeper reason not to concatenate for dense, too, but maybe there is.

This might be off the topic. I think it's possible to use the pattern language to replace all "combine parallel XX op" passes. Maybe we could create an issue to check it.
cc @mbrookhart @tqchen

@t-vi Interesting PR! Thank you for submitting it! I presume the use case for this is in  Transformer-like models? Do you see a perf benefit from the rewrite?

This might be off the topic. I think it's possible to use the pattern language to replace all "combine parallel XX op" passes. Maybe we could create an issue to check it.
cc @mbrookhart @tqchen

I would imagine yes, it would be pretty easy to implement this as a pattern and a rewrite.  A pattern solution might have some complication though, I don't think we currently have a way to match something with 2 or 3 or 4 branches in the same pattern, it would require a number of patterns. I'll think about that.

@mbrookhart Yes, my use-case is transformers. The PyTorch frontend translates the matmul used in HuggingFace transformer's BERT into batch_matmul. The speedup is 1.5x-2x-ish on ROCm (gfx906) and also some on a GTX1080Ti even though it currently hits a reshape right after batch_matmul. I don't quite reach the speed of ONNXRuntime yet.
I'm currently preparing a detailed writeup (and that's the pattern of my recent PRs - tuneable BMM, this, support for integers and other non-float32 PyTorch frontend).
I imagine that it would be cool to move the pass to a pattern-matching. I would expect that it would replace the code shared by the combine passes of batch_matmul and conv2d (and to some extend the dense combiner rather than the part that's separate. I have been wondering about the efficiency of dense btw. - it mentions BERT as a use-case in the code comments but it is unclear to me whether the dense -> batch_matmul with "duplicated" (possibly stride 0) input is better than dense -> dense with non-contiguous results (though the columns would still be and only the rows would be interleaved between the ops). But then I haven't looked a lot at how TVM deals with strides (which is relatively significant because the self-attention typically has some reshapes that would be nice to fuse).

cc @vinx13 please also help to take a look


Check stripping

This needs discussion. What this branch does beside removing outputs from Jupyter notebooks, it also does this retroactively. I can remove the retroactive part. It happened by chance (during experiments), but maybe it's worth keeping.

This branch is now destined to  become a single commit on a new branch (90% commits already commited to develop_better on close branch)


feat: adding limited space mirror factory

Description
This document describes a possible design for a new Factory predeploy capable of deploying Mirror contracts for OptimismMintableERC20Tokens.
Additional Context
The space for this design is limited to only OptimismMintableERC20Tokens.

Closing this in favor of https://github.com/ethereum-optimism/design-docs/pull/50


Postdoctoral Research Associate @Princeton

There is an opening at Princeton University (New Jersey, USA) for a Postdoctoral Research Associate in High-Resolution Modeling of Coupled Air-Sea Interactions
Deadline: 10/31/2023

The Atmospheric and Oceanic Sciences Program at Princeton University, in association with NOAA's Geophysical Fluid Dynamics Laboratory (GFDL), seeks a postdoctoral or more senior research scientist for research focused on coupled high-resolution atmosphere-wave-ocean models and their implementation for simulating coastal storm events and impacts.
The scientist will collaborate with GFDL researchers to enhance and analyze a high-resolution regional coupled model system that utilizes NOAA's state-of-the-art SHiELD atmospheric model, MOM6 ocean model, and WAVEWATCH III wave model.  This project will emphasize research that targets understanding the role of small-scale (<10km) coupled air-sea interactions and boundary layer processes in the development of coastal weather systems and storm events.  The project will also emphasize understanding the societal risks associated with coastal storm events including the ability to simulate precipitation patterns and coastal plains flooding events.  The selected candidate will join a vigorous research group at Princeton University, working in close collaboration with Drs. Brandon Reichl and Lucas Harris at NOAA/GFDL.  The individual will have access to state-of-the-art numerical models and high-performance computing systems at Princeton and NOAA, working alongside GFDL model developers to advance capabilities for high-resolution coupled regional modeling.
Candidates must have a Ph.D. in atmospheric science, physical oceanography, applied math, the physical sciences, or a closely related field.  The following attributes are desirable: (a) a background in coupled air-sea interactions and atmosphere/ocean boundary layer processes; (b) experience in using advanced coupled atmosphere-ocean models; (c) experience in developing numerical models in collaborative environments; (d) excellent written, oral, and visual communication skills, demonstrated through prior peer-reviewed publications and presentations at major conferences; and (e) experience with software development and analysis tools, such as Git, SVN, Linux, Bash/Csh, Python, Fortran, NetCDF, Pangeo, Jupyter, and/or Matlab.  Prior experience with the MOM6 and/or SHiELD models is desirable but not required.  Initial appointments are for one year, with renewal for up to two additional years based on satisfactory performance and available funding.
Princeton is interested in candidates who, through their research, will contribute to the diversity and excellence of the academic community.  Applicants should apply online athttps://www.princeton.edu/acad-positions/position/32003.  Complete applications will include a CV, cover letter, publication and presentation list, 3 letters of recommendation, and a one-to-two page research statement. Review of applications will begin October 31, 2023, and continue until the position is filled. For additional information, contact Brandon Reichl<EMAIL_ADDRESS>or Lucas Harris<EMAIL_ADDRESS>This position is subject to the University's background check policy.  Princeton University is an equal opportunity/affirmative action employer, and all qualified applicants will receive consideration for employment without regard to age, race, color, religion, sex, sexual orientation, gender identity or expression, national origin, disability status, protected veteran status, or any other characteristic protected by law.


[BUG][Android] Clarity Library causing OOM exceptions on Android

Describe the Bug
We are getting Out Of Memory exceptions while users interacts with our product listing and product items. It started appearing right away when we added clarity library to app. We were forced to remove library from app for now.
Repro Steps
we were not able to reproduce it ourselves, but our Crashlytics reports shown fast peaking OOM exceptions.
Expected Behavior
Adding clarity library does not cause any exceptions.
Screenshots

Project Info
E-commerce application
Platform/Framework Info

Device: mostly Samsung Galaxy, but various devices like Pixel, Xiaomi, Poco, etc.
OS: Android, versions 12-14
Application Framework Android
Clarity Version 2.5.2

Hi @Davaeth,
Thanks for reporting this issue. Could u please share the full stack trace of the issue? Also, what's the frequency of the crashes? Finally, is your project imagery-heavy or uses large custom fonts?

Is this the same stack trace for all crashes? Would u also please send your project id to<EMAIL_ADDRESS>

The stack trace isnt the same for each variant, and we have quite a few of those.
I have sent the project id on the email provided.


Nomic logos

PRs should be made to the upstream repository: https://github.com/cosmos/chain-registry


Update installation instructions when sklearn 0.18 is released

Once sklearn 0.18 has been released we should be able to have a one line install command pip install scikit-optimize. Potential show stopper for that is that sklearn doesn't install its dependencies (??)

The day has finally come! http://scikit-learn.org/stable/whats_new.html#version-0-18

For skopt-0.1 people will still have to do the complicated step though no? setup.py says it requires scikit-learn>=0.18dev. Or is 0.18>=0.18dev??


Palindromic pyramid

Feature ✅
Description
The palindromic number are the number whose reverse is equal to the original number. Given number of rows print a valid palindromic pyramid.
Example
Input: Enter number of row:  5
Output:
1
121
12321
1234321
123454321
Contributors are supposed to mention their coding language while asking for assignment

Hey! can I work on this in Python.

Hi, I can work on this in Java.

Hey! can I work on this in C++ also.

Hey, can i work on it using C++/C

@Harshalszz No you can't buddy. @Isha2208 Limit is surpassed.

Hi, Can i try this one with C#

@pratik-choudhari can you assign this to me? I can code in c++


[BUG] Lombok crashes with OpenJ9

Describe the bug
Lombok annotation processor crashes when trying to build a project with OpenJ9, version 13.
To Reproduce
Compile any project, and process will crash.
Expected behavior
Everything should work as expected
Version info (please complete the following information):

Lombok version: 1.18.12
javac 13.0.2
daemon-1420.out.log
javacore.20200405.151557.5760.0002.txt

lombok-mre.zip

I can reproduce consistently without Gradle. Command below:
"C:\Program Files\Java\jdk-13.0.2+8-openj9\bin\javac.exe" -cp lombok.jar lombok-mre\src\main\java\Test.java
It looks like a general protection fault in the OpenJ9 library j9jit29.dll. I'm little a fuzzy on this topic but if remember right that usually means that j9jit29.dll tried to access memory space it wasn't allowed to access. Windows raised a fault and the JVM couldn't recover.
This works ok when I compile with JDK 13.0.2 and without OpenJ9. I don't think there is anything the Lombok project can do to fix this. It looks like a bug in OpenJ9. I'm linking the OpenJ9 issue that is investigating this. As a workaround, I suspect you can compile without OpenJ9 and then use OpenJ9 for runtime.
https://github.com/eclipse/openj9/issues/6933

Can someone confirm the fix in the edge release?

confirms edge release works on my local machine
root@holed1:~/tmp/gpf/edge$ mvn compile
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by com.google.inject.internal.cglib.core.$ReflectUtils$1 (file:/usr/share/maven/lib/guice.jar) to method java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)
WARNING: Please consider reporting this to the maintainers of com.google.inject.internal.cglib.core.$ReflectUtils$1
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building app 0.0.1-SNAPSHOT
[INFO] ------------------------------------------------------------------------
Downloading: https://projectlombok.org/edge-releases/org/projectlombok/lombok/edge-SNAPSHOT/maven-metadata.xml
Downloaded: https://projectlombok.org/edge-releases/org/projectlombok/lombok/edge-SNAPSHOT/maven-metadata.xml (2 KB at 1.0 KB/sec)
Downloading: https://projectlombok.org/edge-releases/org/projectlombok/lombok/edge-SNAPSHOT/lombok-edge-20200528.222155-1.pom
Downloaded: https://projectlombok.org/edge-releases/org/projectlombok/lombok/edge-SNAPSHOT/lombok-edge-20200528.222155-1.pom (2 KB at 25.5 KB/sec)
Downloading: https://projectlombok.org/edge-releases/org/projectlombok/lombok/edge-SNAPSHOT/lombok-edge-20200528.222155-1.jar
Downloaded: https://projectlombok.org/edge-releases/org/projectlombok/lombok/edge-SNAPSHOT/lombok-edge-20200528.222155-1.jar (1790 KB at 5157.7 KB/sec)
[INFO]
[INFO] --- maven-resources-plugin:3.1.0:resources (default-resources) @ app ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 0 resource
[INFO] Copying 0 resource
[INFO]
[INFO] --- maven-compiler-plugin:3.8.1:compile (default-compile) @ app ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 1 source file to /root/tmp/gpf/edge/target/classes
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 5.846 s
[INFO] Finished at: 2020-06-01T10:59:02-07:00
[INFO] Final Memory: 26M/45M
[INFO] ------------------------------------------------------------------------

Thanks for the verification


Deprecated superagent module

Hi, our project is looking to use rascal for the amqp communication, but we noticed the superagent module used by this project is still 6.1.0. The module was published two years ago and it's now deprecated. Do you have a plan to upgrade the superagent module in rascal? Thanks.

Hi @wenshen35105,
Looking at the release log, Superagent v7.0.0 was only released in January 2022, so even though v6.1.0 was released in August 2020, it's still a recent version. The latest version v7.1.2 is the one that was deprecated, so I could updated to v7.1.1, but would rather wait a little longer on the assumption that v7.1.3 will soon be published.
FWIW Rascal only uses Superagent for some vhost operations, but it's unlikely you'll ever use them in production.

@cressie176 Thanks a lot for your clarification.


Snabb pflua integration

Continuation of https://github.com/andywingo/snabbswitch/pull/3 .

Branch rebased to current master.
vpws
src $ sudo ./snabb snsh -pflua -t apps.vpn.vpws
link report
100 sent on from_uplink.output -> vpntp.uplink (loss rate: 0%))
100 sent on vpntp.uplink -> to_uplink.input (loss rate: 0%))
100 sent on vpntp.customer -> to_customer.input (loss rate: 0%))
100 sent on from_customer.output -> vpntp.customer (loss rate: 0%))

ns_responder
src $ sudo ./snabb snsh -pflua -t apps.ipv6.ns_responder
link report
161 sent on source1.output -> packet_filter.input (loss rate: 0%))
9 sent on packet_filter.output -> sink1.input (loss rate: 0%))
selftest passed

nd_light
src $ sudo ./snabb snsh -pflua -t apps.ipv6.nd_light
link report
161 sent on source1.output -> packet_filter.input (loss rate: 0%))
18 sent on packet_filter.output -> sink1.input (loss rate: 0%))
selftest passed

There's a little issue I don't know what's the best way how to solve it.
Snabbswitch's file syscall/linux/ffi.lua is inclusing the C datatype time_t via ffi. This datatype is also included by pflua. This makes the struct to be included twice, which causes an error. Unfortunately, LuaJIT doesn't support #ifdef.
I solved a similar issue by defining a global "pflua" flag in Snabbswitch. This allowed me to avoid including C datatypes common between Snabbswitch and pflua. The problem here is that syscall/linux/ffi.lua is not a file tracked by the git repo.
What I did was to modified pflua's source code to avoid including this C datatype. This is not a feasible solution, as pflua will only work inside Snabbswitch. We could include a guard in pflua, a variable called snabb for instance,  to avoid including that C datatype twice, but that seems to me like a deliberately change. I don't like it much.
A possible solution could be to include this commit as a patch and the user should apply it locally. We could even make make update-pflua to apply this patch automatically. The file that needs to be patched is pflua/src/pf/utils.lua, which is a very stable file. WDYT?

@andywingo @lukego please, could you take a look? I think at this point the integration between snabbswitch and pflua is completed, the only thing pending is how to avoid the double inclusion of certain data structures. See comment last comment.

An automatically-applied patch sounds fine to me.


New version: MLJModels v0.9.2

Registering package: MLJModels
Repository: https://github.com/alan-turing-institute/MLJModels.jl
Created by: @ablaom
Version: v0.9.2
Commit: 6de5f22db53fd149faa7bc29315c1c0a94c78821
Git reference: master

Do not merge

[noblock] Okay to merge again

@DilumAluthge Any chance you could merge this, at your convenience. It seems stuck because of my failed first attempt.  But now it is ready to go.


Er diagram improvements

screenshot as png (server side)
navigate/zoom with the mouse
on click link to table editor

@mermaid-js/mermaid-cli depends on puppeteer which installs Chrome. Is this acceptable in docker container (or on server at all)?


NeoVim config page not found

Hi @nikitavoloboev
The link you have to your neo vim config it's broken
https://github.com/nikitavoloboev/my-mac-os/blob/master/nvim/init.vim
Cya

Fixed now. Thank you.


Improve instructions for MacOS and demo

I just want to say thanks!
It's my tiny contrib'.
— JBX

i've updated lots of docs, and this this PR no longer applies, so i'm closing it.
did you get plan9port itself working on macos?


Project dependency fix

Codecov Report

Merging #29 (a9de14c) into main (71337b1) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main      #29   +/-   ##
=======================================
  Coverage   90.92%   90.92%
=======================================
  Files         139      139
  Lines        5342     5342
=======================================
  Hits         4857     4857
  Misses        485      485

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


qucs-s: 0.0.22->1.0.1, Qt 4->6

Description of changes
For changelog see Releases for 0.0.23 .. 1.0.1.
Qt has been bumped from 4 to 6 as 5 is approaching EOL.
Checked the program opens, a simple circuit can be drown and ngspice integration works.
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
23.05 Release Notes (or backporting 22.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

For reference, I did something similar in https://github.com/NixOS/nixpkgs/pull/174634/commits/c2abb8638a3a22619fd63c29e0418f8697c09d2a. This PR probably makes that commit obsolete.

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/prs-ready-for-review/3032/2045

Works for me.
(I used ngspice 37 for testing, as ngspice 38 is still in progress, https://github.com/NixOS/nixpkgs/pull/199545 )

Bumped to 1.0.2. @Luz can you please check it still finds the ngspice by default for you? For some reason mine does not find ngspice command, which should be on the PATH as ensured by the wrapper... Judging by strace, it does not try the PATH:
$ strace ./result/bin/qucs-s 2> strace.txt
# run a simulation
$ cat strace.txt | grep ngspice
openat(AT_FDCWD, "/nix/store/6l00n6isj6b70yfg02vki4676i7xg15f-qucs-s-1.0.2/share/qucs-s/library//ngspice.blacklist", O_RDONLY|O_CLOEXEC) = 12
openat(AT_FDCWD, "/nix/store/6l00n6isj6b70yfg02vki4676i7xg15f-qucs-s-1.0.2/share/qucs-s/library//ngspice.blacklist", O_RDONLY|O_CLOEXEC) = 12
access("/nix/store/6l00n6isj6b70yfg02vki4676i7xg15f-qucs-s-1.0.2/bin/ngspice", F_OK) = -1 ENOENT (No such file or directory)
access("/nix/store/6l00n6isj6b70yfg02vki4676i7xg15f-qucs-s-1.0.2/bin/ngspice", F_OK) = -1 ENOENT (No such file or directory)
access("/nix/store/6l00n6isj6b70yfg02vki4676i7xg15f-qucs-s-1.0.2/share/qucs-s/xspice_cmlib/include/ngspice_mathfunc.inc", F_OK) = 0
openat(AT_FDCWD, "/home/maverick/Desktop/test-qucs.dat.ngspice", O_WRONLY|O_CREAT|O_TRUNC|O_CLOEXEC, 0666) = 19
access("/nix/store/6l00n6isj6b70yfg02vki4676i7xg15f-qucs-s-1.0.2/share/qucs-s/xspice_cmlib/include/ngspice_mathfunc.inc", F_OK) = 0
openat(AT_FDCWD, "/home/maverick/Desktop/test-qucs.dat.ngspice", O_WRONLY|O_CREAT|O_TRUNC|O_CLOEXEC, 0666) = 19

For me it works!
What I did:

Install ngspice (edit my configuration.nix, then nixos-rebuild switch)
Verify that it is available by typing "ngspice" in the console
nix-build -A qucs-s
Execute binary: /nix/store/7zj3dla8nqggfgk98viiy0wvlc0sx8pm-qucs-s-1.0.2/bin/qucs-s
Copied the example "/nix/store/7zj3dla8nqggfgk98viiy0wvlc0sx8pm-qucs-s-1.0.2/share/qucs-s/examples/ngspice/audio_amp.sch" to my workspace. (It was important to use the official example, as my selfmade simple example failed to run... The tool said something like "ngspice can not be executed", which is probably a misleading error message from qucs-s.)
Opened it and ran by "F2"
Also When I look at "Simulation -> Select default simulator" I see that "ngspice" is selected as "default simulator" and "ngspice" is the text in the field about the "ngspice executable location".

Thanks for your work!


Aggregator and Indicator define

Aggregator and indicator framework definition.

Coverage increased (+0.004%) to 24.365% when pulling 827f4e7ca4818cb3fa334c0fc53a3bd5795a649d on peng-yongsheng:feature/oap/operator into 58b83e86c973d09ca321f8de291af4446b116eb0 on apache:6.0.


[Callout quote] v2 Epic

### Design
- [ ] [ ] Callout quote v2 design specs
- [ ] Website
- [ ] [ ] Figma

### Dev
- [ ] https://github.com/carbon-design-system/carbon-for-ibm-dotcom/issues/9621
- [ ] https://github.com/carbon-design-system/carbon-for-ibm-dotcom/issues/9615
- [ ] https://github.com/carbon-design-system/carbon-for-ibm-dotcom/issues/10050
- [ ] [ ] v2 WC
- [ ] [ ] QA

Closing epic in favor of new organization tactic


Example configuration to run longranger via LSF

This PR is to allow running Lonranger in LSF mode and on Singularity, without the need to install longranger beforehand.
Nextflow will use our container image from GitLab, and pass on the necessary Singularity options to enable LSF.
All it needs is a couple of extra options in the pipeline's configuration file.
I'm also fixing some minor things such as MD5 checksums, the command line to get the version, etc

Confirmation the test works. In this environment, I don't have any module loaded, and longranger is not available directly.
$ env TMPDIR=~/nfs/scratch123/nextflow PROFILE=singularity pytest --symlink --git-aware --keep-workflow-wd-on-fail --tag longranger/align
====================================================================== test session starts ======================================================================
platform linux -- Python 3.9.5, pytest-7.0.1, pluggy-1.0.0
rootdir: /nfs/users/nfs_m/mm49/workspace/tol-it/nextflow/modules, configfile: pytest.ini
plugins: workflow-1.6.0
collecting ...
collected 829 items

longranger align:
        command:   nextflow run ./tests/modules/longranger/align -entry test_longranger_align -c ./tests/config/nextflow.config -c ./tests/modules/longranger/align/nextflow.config
        directory: /nfs/users/nfs_m/mm49/nfs/scratch123/nextflow/pytest_workflow_ppe4i8tu/longranger_align
        stdout:    /nfs/users/nfs_m/mm49/nfs/scratch123/nextflow/pytest_workflow_ppe4i8tu/longranger_align/log.out
        stderr:    /nfs/users/nfs_m/mm49/nfs/scratch123/nextflow/pytest_workflow_ppe4i8tu/longranger_align/log.err
'longranger align' done.

tests/test_versions_yml.py ssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss [ 15%]
sssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss [ 33%]
sssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss [ 52%]
sssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss [ 70%]
sssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss [ 89%]
sssssssssssssssssssssssssssssssssssssssssssssssssss.ssssssssssssssssssssssssssssssss                                                                      [ 99%]
tests/modules/longranger/align/test.yml .......                                                                                [100%]All tests succeeded. Removing temporary directories and logs. Use '--kwd' or '--keep-workflow-wd' to disable this behaviour.

========================================================== 8 passed, 821 skipped in 292.84s (0:04:52) ===========================================================


Subscription Update via SDK is missing

In razorpay unable to find how to update a subscription using SDK

Please add update subscription method in node-sdk

@vivekghanchi @prasad8mhatre sorry for the long delay. edit subscription has already added in sdk.
Subscription Doc

Closing this issue for now, due to not getting any response also this feature is already added. Update to the most recent version to resolve this issue. please let us know if you need any help


Can't generate keys

I am using NopeCHA for personal occasional use. Sometimes I create a key and use a few credits--but almost never the full amount of 200 credits.
Over the last few days, I get the error message: "You have generated a maximum number of free keys." I did not know there is any maximum--it is not disclosed. The only thing disclosed is that you can only generate a free key once every 24 hours, and you get 200 credits. If I knew there was some mysterious "maximum number" I would not have generated hardly any keys!
Please advise what this "maximum" number is and reset it for my account/other users' accounts. Thank you.

The limit was removed.


CSIP15 and CSIP16 - cardinality

Both CSIP15 and CSIP16 states that attributes are mandatory - but their cardinalities are 0..1
https://dilcisboard.github.io/E-ARK-CSIP/specification/implementation/metadata/#532-use-of-the-mets-header-element-metshdr

That solves itself with the updated profile which describes the agent with more elements.

Handled


Online Payment (Etisalat) not showing in wordpress chekout page

Online Payment (Etisalat) not showing in wordpress chekout page

Hi. Did you enable the payment method through Woocommerce?


Reduce Metrics/AbcSize Max to 20

Several method extractions and some minor cleanup.

Before submitting the PR make sure the following are checked:

[x] Wrote good commit messages.
[x] Commit message starts with [Fix #issue-number] (if the related issue exists).
[x] Used the same coding conventions as the rest of the project.
[x] Feature branch is up-to-date with master (if not - rebase it).
[x] Squashed related commits together.
[x] Added an entry to the Changelog if the new code introduces user-observable changes. See changelog entry format.
[x] All tests are passing.
[x] The new code doesn't generate RuboCop offenses.
[x] The PR relates to only one subject with a clear title
and description in grammatically correct, complete sentences.

Nice work. :grinning:

Apart from the presence of some methods that seem generic and should probably be shared between cops, the changes look good to me.

Updated.

👍


Please log action name / type for the thaliPeerPoolOneAtATime.js, branch master_1274_trivial

Logs provide the following information now
3 - Peer Action Started
3 - Peer Action Stopped

It would be better having more detailed information about action, i.e. action name / type, e.g.
3 - Peer Replication Action Started
3 - Peer Replication Action Stopped

This has been added but I haven't submitted the PR yet


Docs and manifests changes for host-local IPAM

Description

Documents: https://github.com/projectcalico/libcalico-go/pull/1077

Deploy preview for calico ready!
Built with commit 7abbf104bf659e7a183316a0425e19c7608747e7
https://deploy-preview-2565--calico.netlify.com


Make sure glob on cassandra use cache

Current implementation for Cassandra didn't use the metadata cache because glob metrics was already getting metadata without cache. This commit re-enable it by calling only glob_metric_names.

Coverage decreased (-0.02%) to 82.22% when pulling 5bb5f65f1e39a395b1b46006b0ab15cdf3575c1e on geobeau:fix-graphite-metadata-cache into 750f57c69980c546c905df711daab9ecf870f961 on criteo:master.


scoped does not work with SCSS

Describe the bug
<style scoped> adds a suffix to all levels (parent/child) of selectors for scss
This causes the error Could not compile style sass.Exception [Error]: Selector "[data-v-somehash]" can't have a suffix
To Reproduce
have a scoped style with a parent/child selector such as
.foo {
    &__bar {
         cursor: pointer; // any style
    }
}

Then run compileString from the npm library sass on the argument string to addStyle
it will break because the output style will be
.foo[data-v-somehash] {
    &__bar[data-v-somehash] {
         cursor: pointer; // any style
    }
}

Expected behavior
scoped causes the suffix to only be added to the most parent level of the scss rules so that the styles can be compiled
Versions

Browser (name & version): any
vue3-sfc-loader: 0.9.5

Was also mentioned in https://github.com/FranckFreiburger/vue3-sfc-loader/issues/149#issuecomment-1879559584 but not addressed at the time

Hello aibolit,
I tried your example with v0.9.5 and the transformed CSS seems correct

Please ensure you have properly setup the SCSS preprocessor, see https://github.com/FranckFreiburger/vue3-sfc-loader/discussions/181


Build error

Linux Mint
C++
version: master
Server support (HTTP)
Randomly (specify approximate percentage)
reproduce: All the time

I have some error when try to build example:
`#include <uWS/uWS.h>
int main() {
uWS::Hub h;
h.onHttpRequest([](uWS::HttpResponse *res, uWS::HttpRequest req, char *data, size_t length, size_t remainingBytes) {
    res->end("Hello world", 13);
});

if (h.listen(3000)) {
    h.run();
}

return 0;

}`
Stack of exceptions:
CMakeFiles/uwsserver.dir/main.cpp.o: In function main':
/home/alex/CLionProjects/uwsserver/main.cpp:8: undefined reference to uWS::Group<true>::onHttpRequest(std::function<void (uWS::HttpResponse*, uWS::HttpRequest, char*, unsigned long, unsigned long)>)' /home/alex/CLionProjects/uwsserver/main.cpp:10: undefined reference to uWS::Hub::listen(int, uS::TLS::Context, int, uWS::Group)'
/home/alex/CLionProjects/uwsserver/main.cpp:10: undefined reference to uS::TLS::Context::~Context()' /home/alex/CLionProjects/uwsserver/main.cpp:11: undefined reference to uS::Node::run()'
/home/alex/CLionProjects/uwsserver/main.cpp:10: undefined reference to uS::TLS::Context::~Context()' CMakeFiles/uwsserver.dir/main.cpp.o: In function uS::Socket::write(uS::Socket::Queue::Message, bool&)':
/usr/include/uWS/Socket.h:309: undefined reference to SSL_write' /usr/include/uWS/Socket.h:314: undefined reference to SSL_get_error'
CMakeFiles/uwsserver.dir/main.cpp.o: In function uWS::Hub::Hub(int, bool, unsigned int)': /usr/include/uWS/Hub.h:47: undefined reference to uS::Node::Node(int, int, int, bool)'
/usr/include/uWS/Hub.h:47: undefined reference to uWS::Group<true>::Group(int, unsigned int, uWS::Hub*, uS::NodeData*)' /usr/include/uWS/Hub.h:47: undefined reference to uWS::Group::Group(int, unsigned int, uWS::Hub*, uS::NodeData*)'
/usr/include/uWS/Hub.h:48: undefined reference to inflateInit2_' /usr/include/uWS/Hub.h:47: undefined reference to uS::Node::~Node()'
CMakeFiles/uwsserver.dir/main.cpp.o: In function uWS::Hub::~Hub()': /usr/include/uWS/Hub.h:65: undefined reference to inflateEnd'
/usr/include/uWS/Hub.h:64: undefined reference to uS::Node::~Node()' collect2: error: ld returned 1 exit status CMakeFiles/uwsserver.dir/build.make:94: recipe for target 'uwsserver' failed make[3]: *** [uwsserver] Error 1 CMakeFiles/Makefile2:67: recipe for target 'CMakeFiles/uwsserver.dir/all' failed make[2]: *** [CMakeFiles/uwsserver.dir/all] Error 2 CMakeFiles/Makefile2:79: recipe for target 'CMakeFiles/uwsserver.dir/rule' failed make[1]: *** [CMakeFiles/uwsserver.dir/rule] Error 2 Makefile:118: recipe for target 'uwsserver' failed make: *** [uwsserver] Error 2

Do not report you own incompetence as bugs!!


localFile does not appear in graphiQL

Hello, I want to get the images from my aws S3 cloud and I'm using this plugin from gatsby. But I can't query them because the localFile doesn't exist.
Here is the configuration from gtabsy-config.js
{
      resolve: `@robinmetral/gatsby-source-s3`,
      options: {
        aws: {
          accessKeyId: 'my accessKeyId',
          secretAccessKey: 'my secretAccessKey',
          region: 'eu-central-1',
        },
        buckets: ['my bucket (only one bucket)'],
      },
    },

I have the following s3 configuration:
-S3 bucket is private
-only read acces based on IAM user
-region is 'eu-central-1'

Hi @ciprian97, thanks for reporting!
In theory this should work, but I haven't tested this plugin with private buckets yet. I'm guessing that this is the issue here.
From the README:

Currently, your buckets will need to be configured for public access with this access policy: (add your bucket name under Statement.Resource)
{
  "Version": "2008-10-17",
  "Statement": [
    {
      "Sid": "AllowPublicRead",
      "Effect": "Allow",
      "Principal": {
        "AWS": "*"
      },
      "Action": "s3:GetObject",
      "Resource": "arn:aws:s3:::my-bucket/*"
    }
  ]
}

For now, you should be able to make this work by making your bucket public, as described above ☝
Sourcing from private buckets is definitely an important feature, so I'll try it out on my end, and see if there's anything I need to add to the plugin in order to handle them.
You can expect an update from me sometime this week. And of course if you're up for it, feel free to open a PR yourself!

Thank you @robinmetral, I will change the bucket to be public.

Great, let me know if you still run into issues! I'll look into supporting private buckets on my end 🙂

After I changed the bucket from private to public, the localFile is still not there.

Ah, it's something else then, thanks for trying! A few more questions to try to debug:

are you getting any console output during gatsby develop, any info or errors besides the one telling you that localFile is undefined?
is there at least one object in the bucket, like a jpg or png image? (I'm guessing there is, just checking 🙂). localFile will only exist if the image is transformed successfully (after it's been pulled)
Related to the point above ☝: can you query the objects in GraphiQL?

If I could look into your code, it would make things much simpler to debug. Could you maybe make a reproduction repo, making sure not to disclose your AWS credentials (i.e. use env vars)? We can also have a quick pairing session sometime this week if it helps.
It might also help to look into robinmetral/eaudepoisson.com, I'm using the plugin successfully over there.

I created a repo https://github.com/ciprian97/reproduction with what configuration I have. Also I checked your repo robinmetral/eaudepoisson.com and it seems to be the same configuration for gatsby-source-s3

@ciprian97 I just cloned your repo and added my own AWS config with a test bucket, and it works fine. This tells me your issue is probably on the AWS side of things.
Can you check a couple more things:

Does your bucket contain non-image files? localFile will only be defined for images - it's for the files transformed by sharp. For the record, this happens in Gatsby's onCreateNode method:
https://github.com/robinmetral/gatsby-source-s3/blob/ec9fc17b4a99c96d4008a79d8bdafa6f61afc80b/src/gatsby-node.ts#L124
For non-image files, it will be null, so you need to check it's defined before rendering. Something like this:
// let's say `objects` contains all your S3Object nodes and you want to loop through all images
objects.map(object => {
  if (object.localFile) { // without this condition you'll get an error for non-image files
    return (
      <Img fluid={object.localFile.childImageSharp.fluid} />
    )
  }
}

Check your S3 bucket and IAM role policies. For my test account, I have:
S3 bucket policy (public)
{
  "Version": "2008-10-17",
  "Statement": [
    {
      "Sid": "AllowPublicRead",
      "Effect": "Allow",
      "Principal": {
        "AWS": "*"
      },
      "Action": "s3:GetObject",
      "Resource": "arn:aws:s3:::MY_BUCKET_NAME/*"
    }
  ]
}

IAM role access policy (get and list access to multiple buckets)
{
  "Version": "2012-10-17",
  "Statement": [
    {
      "Sid": "VisualEditor0",
      "Effect": "Allow",
      "Action": [
        "s3:Get*",
        "s3:List*"
      ],
      "Resource": [
        "arn:aws:s3:::MY_BUCKET_NAME",
        "arn:aws:s3:::ANOTHER_BUCKET_NAME"
      ]
    }
  ]
}

I hope this helps! Let me know if you manage to fix your issue 🙂

Hi Robin
I have the same issue as Ciprian has, but on my side, the bucket is private.
In my s3 configurations, I have the following:

Block all public access is set ON
And bucket policy is not set. (empty body)

Could you please tell me if this plugin is working also with a private bucket, and access to it is based on the AWS credentials ?
Thank you

@robinmetral you are right, the problem was in my s3 configuration, now the localFile appear and I can query the images.
Thank you!

Happy to hear! Feel free to open a new issue if something else comes up 🙂


[BUG] Event.html navbar doesn't work on mobile

https://github.com/akshitagupta15june/Moksh/assets/121447227/5423ab08-af3d-42be-89da-e47c86acf99c

@akshitagupta15june  please assign me this issue under Gssoc'23

@akshitagupta15june can you check this?

some contributor is working on it.

@akshitagupta15june I don't see anyone working on navbar explicitly. Can you once check

They are working on positioning of the pages

oh yes they are working on responsiveness

Go for it

Thank you @akshitagupta15june


Add new vars to Garry's Mod Egg

Add a variable for the gamemode and tickrate, these are common options and used by most servers
Description

Checklist for all submissions

[x] Have you followed the guidelines in our Contributing document?
[x] Have you checked to ensure there aren't other open Pull Requests for the same update/change?
[x] Have you tested and reviewed your changes with confidence that everything works?
[x] Did you branch your changes and PR from that branch and not from your master branch?

[x] You verify that the start command applied does not use a shell script

[ ] If some script is needed then it is part of a current yolk or a PR to add one

[x] The egg was exported from the panel

better cl.osiong insteed add changes to the egg. I love vacations

I don't know what that message should tell me. I just don't have the time rn to do it, that's why I'm closing it before letting it go stale.


HTML/CSS/JS (buildArea.html) - Create slideshows

Create click events

We should consider paired programming to get this integrated with the JS Objects that represent the computer and components.

app.js has been wired-in to the "slideshows" using js events.


Update README.md

Hi Aryan, it may not be much, but I update your README.md to make it meaningful.

Thank you!


Pivot table updates

As discussed in #487

@jhoneill Is it worth adding tests for GroupNumericColumn and GroupDateColumn?

@jhoneill Is it worth adding tests for GroupNumericColumn and GroupDateColumn?

Not sure of the value, but strictly speak, yes, its a bit of functionality, so it should be tested. We can probably take the row tests and change them to column tests.


Check for apostrophe instead of prime

Hi,
Working on the following issue in Apache Jena: https://issues.apache.org/jira/browse/JENA-1072
For a bit of context, the following query:
ASK {
<http://en.wikipedia.org/wiki/Good_Love_(Meli'sa_Morgan_album)> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://xmlns.com/foaf/0.1/Document> .
}

Is marked as invalid, as in the following screen shot.

I believe the cause for this issue is that the regular expression in used in YASQE is using a prime (single quote) instead of an apostrophe, as in https://www.w3.org/TR/sparql11-query/#rIRIREF
i.e., while the SPARQL 1.1 specification has iriref as '<' ([^<>"{}|^`]-[#x00-#x20])* '>', YASQE is converting that into the following regex '<[^<>"'|{}^\\x00-\x20]*>'.
This pull request addresses just the prime vs. apostrophe, and seems to fix the issue in the editor with the same query. However, I think there may be other differences in the regex and the spec value.

It was super easy to check out and play with YASQE in development mode, thanks for such a super library and for making it easier for other developers to play with it :-)
Thanks
Bruno

that's a pretty complete PR, thanks! Merged, and published as new version (2.11.3)

Thanks @LaurensRietveld! Confirmed that with the new version the issue is fixed in Jena.

@kinow It turns out that a bug (https://github.com/OpenTriply/YASGUI/issues/84, infinite loop crashing your browser) was introduced in 2.11.0. The latest version (2.11.4) contains the fix (#90). Considering you just updated Jena with a 2.11.x version, it's probably best if you upgrade to the latest version

Thank you very very much for letting me know about the bug @LaurensRietveld
Will bump up Jena to 2.11.4 this weekend.


Popover from Header Counter Unreadable

Hovering the counter in the header (great idea, btw!) leads to an unreadable popover, since it is displayed above the counter and cut off there (tested in default theme)

I think displaying the popover below the counter could fix this? 🤔

Yes I have seen this as well a few times, so thank you for reporting it. was this on desktop or mobile?
I just pushed out a 1.0.6 update where I change the positioning strategy. I think it will fix this problem and in fact positions the popup better.
Its still a bit flaky on mobile, but I will tweak that at a future time.

Was on desktop. Die not occur anymore, thanks!


sync timestamp

Hi,
I am new to gopro. I wonder how to sync the timestamp of camera and IMU in HERO7.

The data is effectively frame rate in HERO7, no timestamps are needed for most applications.  We added µs timestamps in HERO8 for some sub-frame precision. You can get a little more precision using the sample code call  GetGPMFSampleRate().  This will return the sample rate for any stream and a high precision in and out sample time, the is relative to video.

Thanks for your reply! I want to use kalibr for joint calibration of IMU and camera. Thus I try to get the timestamp of each frame and each IMU data.  Does gopro HERO7 record the collection time of each IMU data?  Can I only calculate the timestamp based on the return value of the function GetGPMFSampleRate()?

Besides, I use the function GPMF_ScaledData() to read data in every payload(does one payload mean the data in one second?) as shown below, but i only read nonzero data from the first payload. All data of all stream from the second payload to the last one is zero. Any mistake in my code?
for  (payloadpos = teststart;  payloadpos <= testend;  payloadpos++){         payload = GetPayload(handle, payload, payloadpos); // second last payload         ret = GPMF_Init(ms, payload, payloadsize);         if (ret != GPMF_OK) 		goto cleanup; 	if (GPMF_OK == GPMF_FindNext(ms, fourcc, GPMF_RECURSE_LEVELS)) 	{ 		GPMF_stream find_stream2; 		GPMF_CopyState(ms, &find_stream2); 		payloadcount++; 		if (GPMF_OK == GPMF_FindNext(&find_stream2, fourcc, GPMF_CURRENT_LEVEL)) // Count the instances, not the repeats 		{ 			if (repeatarray) 			{ 			        double in, out; 			        do 				{ 					samples++; 				} while (GPMF_OK == GPMF_FindNext(ms, fourcc, GPMF_CURRENT_LEVEL)); 				repeatarray[payloadpos] = samples; 				meanY += (double)samples; 				if (GPMF_OK == GetPayloadTime(handle, payloadpos, &in, &out)) 					meanX += out; 			} 		} 		else 		{ 			uint32_t repeat = GPMF_PayloadSampleCount(ms); 			samples += repeat; 			printf("repeat: %d\n", repeat); 			if (repeatarray) 			{ 				double in, out; 				repeatarray[payloadpos] = samples; 				meanY += (double)samples; 				if (GPMF_OK == GetPayloadTime(handle, payloadpos, &in, &out)) 					meanX += out; 				//add for test 				uint32_t key = GPMF_Key(ms); 				// GPMF_stream find_stream1; 				uint32_t i,j; 				uint32_t unit_samples = 1; 				uint32_t elements = GPMF_ElementsInStruct(ms); 				uint32_t buffersize = samples * elements * sizeof(double); 				char units[10][6] = { "" }; 				double *ptr, *tmpbuffer = (double *)malloc(buffersize); 				// GPMF_CopyState(ms, &find_stream2); 				if (GPMF_OK == GPMF_FindPrev(&find_stream2, GPMF_KEY_SI_UNITS, GPMF_CURRENT_LEVEL) || 					GPMF_OK == GPMF_FindPrev(&find_stream2, GPMF_KEY_UNITS, GPMF_CURRENT_LEVEL)) 				{ 					char *data = (char *)GPMF_RawData(&find_stream2); 					int ssize = GPMF_StructSize(&find_stream2); 					unit_samples = GPMF_Repeat(&find_stream2); 					// printf("unit_samples: %d\n", unit_samples); 					for (i = 0; i < unit_samples; i++) 					{ 						memcpy(units[i], data, ssize); 						units[i][ssize] = 0; 						data += ssize; 					} 				} 				GPMF_ScaledData(ms, tmpbuffer, buffersize, 0, samples, GPMF_TYPE_DOUBLE);  //Output scaled data as floats 				ptr = tmpbuffer;// data ptr 				for ( i = 0; i < samples; i++) 				{ 					printf("%c%c%c%c ", PRINTF_4CC(key)); 					for (uint32_t j = 0; j < elements; j++) 						printf("%.3f%s, ", *ptr++, units[j%unit_samples]); 					printf("\n"); 				} 				free(tmpbuffer); 				//end 			} 		} 	} 	else 	{ 		repeatarray[payloadpos] = 0; 	} }

None of our cameras record the time of every IMU sample, as that would double the payload size.  Also there is the question of the validity of timestamps and their precision.  Instead you can compute, more accurately in many designs, the relative timing of all samples after capture.  GetGPMFSampleRate() is a demo of how this can be done.  In HERO8 we did get hardware timestamps that are precise enough, so we include one timestamp per payload.  GetGPMFSampleRate() will use timestamps if available, or compute them if not.

Hi, I have developed a ros node to read GOPRO5 mp4 files and publish imu and images with timestamp headers in topics.
My formula was, for each payload (duration = 1040ms) : imu_ts = index * duration / nb_samples.
I tried to calibrate with kalibr (followed all the steps, camera calibration, imu calibration, camera / imu calibration) but with no good results (openvins or vins-mono slam were not working correctly).
Just today after reading this issues comments (thanks @dnewman-gpsw ), I've improved my code to use GetGPMFSampleRate start/end/rate informations.
Now I do the following :

calling GetGPMFSampleRate with precise flag to get average sample rate, start and end timestamp
interpolating the imu data with global index, using the calculated rate and adding the start timestamp (imu_ts = global_imu_index * rate + start_ts)
publish video and imu to distinct topics with correct header in the right order
(I use the video timestamp found in the mp4 data).

Because on gopro 5 the gyro is 400hz and accl 200hz, I use 400hz and publish 2 times the same accl.
Kalibr is currently still running to calibrate the camera/imu. It is very long and I'm not sure that my dataset has enough quality.
When finished (it no error, the last time I had to increase the time shift tolerance), I will try again using a visual/inertial slam algorithm, but I'm not very confident.
I used this project to calibrate the noise model of imu with 1 hour video : https://github.com/gaowenliang/imu_utils

You are doing the correct timestamp extraction, however this IMU data wasn't intended for this type of post processing.  The latest cameras run the IMU at much higher frequencies to compute the Hypersmooth™ stabilization in camera, and only uses the low frequency IMU data within the mobile editing software to automatically find the good bits.  However, Reelsteady Go (https://www.reelsteady.com/) uses this data with excellent results, so good GoPro bought the company.  So it is possible.

My calibration ran fine (after updating the noise model because my first was too optimistic), but I don't get good results with the visual / inertial slam. Sometimes it works for a few seconds, but if I move a little faster, in a location with not so much keypoints (I stay indoor), it diverges.
The best would be able to do it in realtime, so I could better understand the way it works. But the gopro is not made for this.
By the way I learned a lot of stuff doing theses experiments, and that's was the main goal of these.
Thank you for your support.

@rlamarche You really did a good job. I am also new to gopro. When I tried to calibrate my gopro HERO8 with kalibr, I found it really difficult to create an IMU rosbag  through this gpmf-parser.
@rlamarche Would you please teach me how to do it or provide your code on your github?
Thank you very much!

hi @treenewbee213 , thank you. What do you plan to do with the gopro & kalibr ? Post stabilization ?
Yes I can post the code on github, I will do it in the coming days. It's a ROS node so if not you should get familiar with ROS before.
Regards,
Romain.

I plan to run a VIO project with my handheld gopro, so it's crucial to calibrate it first.
@rlamarche I'm looking forward to your excellent work!

@dnewman-gpsw I am trying to use STMP from gpmf data to synchronize video. Is the microsecond timestamp with respect track start?

This is a microsecond timestamp, but for the GPMF streams relative to each other, not directly capture start.  The first timestamp in CORI (HERO8 & 9) or SHUT (HERO7) is the timestamp for the first video frame.   So the timestamp on any stream, can be converted to capture start timestamps by substracting the first TS in the CORI or SHUT streams.

@dnewman-gpsw  I will be doing something like this.
stmp_accl = get_stamp(STR2FOURCC("ACCL")) //for all payload
stmp_cori = get_stamp(STR2FOURCC("CORI")) // for the first payload only
stamp_accl_sync = unix_start_time + stmp_accl - stmp_cori  // unix time for  absolute reference

No idea why you are adding unix time, but it might be what you need.

@dnewman-gpsw it's because I am using ROS and it requires epoch time. If the relative time is correct, it should not matter yeah. or I can just use video creation time.

I don't if you can used video create time, it is not intended to be precise (not at video precision.)  Your needs are application specific, but you should have all the info on the timestamps necessary.

@dnewman-gpsw thanks to you I was able to run visual-inertial odometry using GoPro IMU data.
https://youtu.be/iNbRslYIQnA

@joshi-bharat nice! I did try the same thing as you with vins mono, but did not succeed. I was using a gopro 5 and the imu seemed to not be synchronized enough with the images. Well that was a good excuse to stop.
But you did it with a gopro 9, contrats! It is very interesting to know that it is possible.
In what the specs are different from a gopro 5, 6,7 or 8.
Or maybe I did something wrong.
The next step would be to do it in real time, I don't know if the gopro is able so send the imu data with the video stream at the same time, but that would be awesome.
A technology like webrtc would allow this, using datachannels for transmitting the video data.
Keep the good work, and that reminds me that I have to publish my source code experiments before it is erased from my disk !

@treenewbee213 finally, here my source code : https://github.com/rlamarche/gopro_ros
Sorry for the delay, but now I have plenty of time in France, due to the lockdown ...

@rlamarche I was not able to do with GoPro5 as well. There is a start stamp for each payload in the new GoPros (GoPro 8 and 9). I used that to synchronize IMU data with images. I will also soon publish the code later. It needs some refactoring.
Please check the previous conversation on how to use that information.

Thanks for the information, indeed I might have missed the relevant informations in this topic. So I have to find a GoPro 8 at least if I want to continue/restart my experiments.
I was reviewing my code, it might need some refactoring as well.

@rlamarche Thank you very much! Actually I tried to solve the problem by ffmpeg and an offline rosbag creator, it works but still influenced by temporal misalignment. Your code really inspired me in some way, a nice jab!

Hello @joshi-bharat
How to set the IMU noise parameters? (Bias random walk, accelerometer and gyroscope noise density)
Could you please explain the calibration process? (Did you use Kalibr? If so, did you use the rolling shutter camera calibration method?)

Hello @joshi-bharat
How to set the IMU noise parameters? (Bias random walk, accelerometer and gyroscope noise density)
Could you please explain the calibration process? (Did you use Kalibr? If so, did you use the rolling shutter camera calibration method?)

@vislero I calculated the noise parameters using https://github.com/rpng/kalibr_allan.

I just the default camera-imu calibration from Kalibr.

Hi, I just saw the thread.
Do not know if this is still of interest for you guys but I got VI ORB-SLAM3 running with a GoPro9 quite smoothly. Even with 25fps which should lead to relatively high rolling shutter distortions (which ORB-SLAM3 can not compensate for):
https://github.com/urbste/ORB_SLAM3/tree/feature/gopro_slam
https://www.youtube.com/watch?v=0wIqkUEjhiw


Issue template not set for this repo

Will do this in 1811.

Already completed. @sushilraje will add link and close.

Fixed: https://github.com/Azure/remote-monitoring-services-java/pull/66


Reduce number of t5x tests

@hmonishN Just an FYI that this PR will reduce one of the FMHA tests you added. Please review since we wish to reduce t5x's test suite

LGTM!


Remove Application Insights ingestion IP addresses

We no longer maintain the list of IP addresses used by Application Insights ingestion services on this page. Customers are already instructed to use service tags and download the IP addresses if needed.

@olegsych : Thanks for your contribution! The author(s) have been notified to review your proposed change.

Thanks Oleg for updating the docs. Next time can you contributor to the private repo, azure-docs-pr, that way you can sign off on your own changes when you are done and they can merge faster.
https://review.docs.microsoft.com/en-us/help/contribute/contribute-get-started-checklist?branch=master
#sign-off


Disabled radio buttons do not indicate selection

A disabled radio button group does not indicate the (pre)selcted value as other form fields do. I am not sure if this is intended behavior, but native radio buttons do show their state when disabled.

Operating system: Arch Linux
Browser and version: Firefox 63.0.3, Chromium 71
Reduced test case: https://codepen.io/anon/pen/OrVLOV

x-ref: #23544

@ysds as far as I understand, the referenced PR was to fix a problem where the active state could be triggered on an inactive button. In my issue the button should indicate its preset state also when disabled analogous to native radio buttons.

OK, I understand. Probably, that is a styling issue of buttons.

Demo: https://codepen.io/anon/pen/BvKaqz
@kleinph I recommend you to change the issue title for clarification.

I'm wondering if disabled elements should just have a reduced opacity for simplicity in styling?

@ysds sure, how should I name it?
BTW your demo makes it pretty clear what my issue is. Thanks!

Maybe active+disabled should just be mentioned as incompatible/not-supported for button mode?

Well, .active:disabled seems logical and useful—a button is selected and it's processing/loading, for example. :active:disabled isn't useful though because disabled shouldn't be interactive. Perhaps the problem is coming from us conflating those two vs separating the .active from :active?

In the above examples it would really be :checked:disabled, rather than active:disabled (button style checkboxes)

I agree separating those two state:

Pressed (:active)
Selected (:checked, aria-pressed, aria-selected, aria-current) - .active class

Well, .active:disabled seems logical and useful—a button is selected and it's processing/loading, for example. :active:disabled isn't useful though because disabled shouldn't be interactive. Perhaps the problem is coming from us conflating those two vs separating the .active from :active?

Closing as stale for v4. We'll be moving onto focus entirely on v5 and v4 will only see critical updates.