Add instruction for code coverage

https://github.com/alexandrudima/vscode-extension-coverage-sample

Adding my 2c here as I recently added coverage reporting to my extension (available in both Azure Pipelines and CodeCov.io).
I was thinking of extracting the code that is used to instrument the code coverage out into a npm package probably to wrap around runTests with a function runTestsWithCoverage that will check for the --coverage cli flag.
The package would also contain the boilerplate for the suite/index.ts file, so rather than you having to write the wire up code like the docs describe you just import run from 'test-with-coverage-package' and provide it with a Mocha config and paths to glob.
This does mean it is back to being a hard dependency on Mocha, which was changed between vscode and vscode-test, but I'm not quite sure of the best way to handle it otherwise (maybe the run function the package exposes takes a Promise which you'd pass in the code like the docs describes and just adds the coverage step at the end).

I have successfully used @connor4312's testRunner.ts to get code coverage out of unit tests.

Any update for an official instruction?

The next release of the test CLI has a --coverage flag that allows you to collect test coverage for an extension with no additional configuration.


Revert "Move TimeBudget to vespajlib and use Clock"

Reverts vespa-engine/vespa#6256
3 system tests fail, one with java.lang.NoClassDefFoundError: com/yahoo/time/TimeBudget
And: are you sure you can move this class, jdisc_core/src/main/java/com/yahoo/jdisc/package-info.java says this is a public API?

And: are you sure you can move this class, jdisc_core/src/main/java/com/yahoo/jdisc/package-info.java says this is a public API?

This is a class that was just added. Discussed with Bratseth and the best location for it is vespajlib.

I see


added '+' as a list marker for markdown

Related Issue
Fixed #4117
Description
added '+' as a markdown list marker
How Verified

Added new unit tests
Ran all existing unit tests.

Microsoft Reviewers: Open in CodeFlow

@matthidinger looks like CommonMark does support '+' as a valid list syntax (thanks to @jwoo-msft for digging it up) - https://spec.commonmark.org/0.29/#lists

@jwoo-msft could you ensure the .NET renderers also support all 3 syntax forms? Thanks

@jwoo-msft could you ensure the .NET renderers also support all 3 syntax forms? Thanks

I verified that .NET supports all 3 list markers.


Incorrect links to blog pages after translating

Problem pages samples:

https://www.yegor256.com/ru/2014/11/24/principles-of-bug-tracking.html
https://www.yegor256.com/ru/2015/01/08/morning-standup-meetings.html

Step to repro:

Open translated page
Find link to another blog page

Expected behavior:
Link has href to another blog page
Actual behavior:
LInk has href to itself
Additional info:
Links to wiki and other external resources are correct.

More details:
Source: https://www.yegor256.com/2014/11/24/principles-of-bug-tracking.html
"discourage" has link to  https://www.yegor256.com/2014/10/07/stop-chatting-start-coding.html
Translated: https://www.yegor256.com/ru/2014/11/24/principles-of-bug-tracking.html
"отговариваемся " has link to https://www.yegor256.com/ru/2014/11/24/principles-of-bug-tracking.html (page itself)
"электронная почта" also has link to page itself

@rultor release, tag is 0.0.31

@rultor release, tag is 0.0.31

@yegor256 OK, I will release it now. Please check the progress here

@rultor release, tag is 0.0.31

@yegor256 Done! FYI, the full log is here (took me 2min)


Does not recognize Manifest.mbdb from old IOS backups (2014-2015)

Hi, thanks for the great tool, I just need to figure out how to use it :-)
It seems this does not accept the Manifest.mbdb file. I tried changing the file extension but that doesn't help. Also, the cargo executable doesn't work (for me).
Any help/insight would be greatly appreciated! :-)
What I did:
I installed rustup via brew;
Then I followed your install instructions:
Build Locally
To build this locally, a nightly toolchain is required. You can install it using rustup:
rustup toolchain install nightly
Then, you can build the executable:
cargo +nightly build --release_
That last step (cargo ~) does not work. It throws this error:
_PS /Users/Nunyabiz/workspace/iosarchive> cargo +nightly build --release
error: no such command: +nightly
Cargo does not handle `+toolchain` directives.
Did you mean to invoke `cargo` through `rustup` instead?_

Then, I realized you said "For Mac users, you can download the pre-built binaries directly from releases page.", So I downloaded the binary into the local directory and ran this:
"local_iMac:~/workspace/iosarchive $ sudo ./ibackupextractor -l ~/Library/Application Support/MobileSync/Backup/bc5e093456f0a03b79551f5487ba063"
Got this output:
error: failed to open the manifest database
Caused by:
file not exists: "/Users/Nunyabiz/Library/Application Support/MobileSync/Backup/bc5e093456f0a03b79551f5487ba063/Manifest.db"
The backup directory has this in it:
Manifest.mbdb
Manifest.plist
Info.plist
Status.plist
<and LOTS of backup archives, named with typical hex-strings>
This was on a 2017 iMac28 running Ventura (13.7.1) on a i7-7700 with 64GB RAM.

Note to others using macos (at least the Ventura version), when you copy dir paths and paste them into your shell ... they do not past the back\ slash to break the  between "/Application Support/" (needs to be "/Application\ Support/"

The tool currently cannot parse Manifest.mbdb file, since it's a very old format and I don't have the environment to test it.


Add Quick Sort Algorithm

Algorithm:
Quick Sort
DS:
Sorting
Languages Supported:

C [ Assigned to @Dhairya3124 ]
C++
Java [ Assigned to @SRILEKHA-V19 ]
Javascript
Python [ Assigned to @SRILEKHA-V19 ]

@HarshCasper , could you please assign this issue to me? I'm willing to take up this task for languages: C, C++, Java, Python. After i'm done with these, i can work on Javascript too.

@HarshCasper Could you assign this issue to me? I want to work in C++.

@HarshCasper  Could you assign me this issue? I am willing to work on this issue in C++.

I have assigned the Issue for Java and Python to @SRILEKHA-V19
You can start working on it. Please follow the general guidelines:

Make a Branch off your Master and work on that.
Make a proper README of how your Script works and what all libraries and modules you have used.
Add Proper Comments and focus on Clean Code, in practice.
Also reference this Issue in your PR so that it becomes easy for us to review.

@Dhairya3124 and @asaxena012 There is a conflict here. Probably I can assign you the Issue in C and C++ respectively or if you want to work in some other language, you can do that part as well and I will promptly assign it to you.

@HarshCasper I'm fine to work upon C language.

You can start working on it now @Dhairya3124

@asaxena012 , you can submit the C++ implementation to it.


Undocumented special [PAD] token in tokenizer.

https://github.com/microsoft/analysing_pii_leakage/blob/04ce67b4adf5141f99beab7471688d6d6e18a77a/src/pii_leakage/models/language_model.py#L101
Hi. Here an special token has been added, which is not documented in the paper. Is this necessary for replication?

This is needed to pad inputs to GPT-2 for generation because the tokenizer doesn't define a padding token. It follows advise in the Transformers library.
https://github.com/huggingface/transformers/blob/main/src/transformers/tokenization_utils_base.py#L2709
You can likely set it to any other existing token rather than adding a new special token, but makes padded sequences easier to read.


Calling make_array() on struct literal causes panic

Describe the bug
Attempting to create a literal value which is an array of structs causes a panic.
To Reproduce
DataFusion CLI v34.0.0
❯ set datafusion.execution.parquet.allow_single_file_parallelism=false;
0 rows in set. Query took 0.001 seconds.

❯ copy (values (make_array(struct('foo',1)))) to '/tmp/test.parquet';
thread 'main' panicked at /home/dev/.cargo/registry/src/index.crates.io-6f17d22bba15001f/datafusion-common-34.0.0/src/scalar.rs:524:74:
called `Result::unwrap()` on an `Err` value: Internal("Unsupported data type in hasher: Struct([Field { name: \"c0\", data_type: Utf8, nullable: true, dict_id: 0, dict_is_ordered: false, metadata: {} }, Field { name: \"c1\", data_type: Int64, nullable: true, dict_id: 0, dict_is_ordered: false, metadata: {} }])")
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

Expected behavior
Should not result in panic. If there is some issue with how I have attempted to construct the array of struct, we could add a more descriptive error message.
Additional context
I came across this while writing tests related to #8551, but this issue does not appear related to parallel parquet writing specifically.
The line of code generating the error implies an internal constraint is violated if we reach it.
https://github.com/apache/arrow-datafusion/blob/1dcdcd431187178d736cdd3a6c004204aa2faa14/datafusion/common/src/hash_utils.rs#L369-L374

I run on main branch and does not reproduce the panic
statement ok
set datafusion.execution.parquet.allow_single_file_parallelism=false;

query ?
copy (values (make_array(struct('foo',1)))) to '/tmp/test.parquet';
----
1

Perhaps it was fixed by https://github.com/apache/arrow-datafusion/pull/8552

Thanks @jayzhan211 you are right. After merging main into my dev branch, the issue is fixed.
I did also notice #8873 which is why I tried make_array, so thanks for filing that.


Bugfix/Seed Value

Issue #59 points out that the web demo does not produce the expected image for a given prompt, seed, etc. I noticed that the seed value used to render is not the seed value when clicking generate.
This PR uses session_state to persist the seed value so that the subsequent generation will use it. It still maintains the existing behavior of selecting a new random seed value per generation, unless the user manually enters a specific seed value, in which case the same manually entered seed value will continue to be used.

@bes-dev please take a look! :)


FY2020Q1 Refresh

Updated instructions for Ex 1
Updated project files for all exercises
Refreshed screen captures in slide decks

manually merged


Refactor blog.css for Improved Readability and Styling Consistency

This PR refactors the blog.css file to enhance readability, maintainability, and consistency across styling without changing the existing color scheme or layout structure.
Changes Made:
Combined similar styles (e.g., .submit1 button, .submit2 button) to reduce redundancy.
Standardized padding, margin, and border values for consistency across elements.
Removed unused and redundant properties.
Grouped repetitive styles and organized code logically for better readability.
Benefits:
Improves code readability and maintainability in blog.css.
Enhances performance by reducing the file size and eliminating redundant code.
Ensures consistent styling throughout the blog component.

could consider this pr under gssoc,24 extended level 1.
@tushargupta1504

issue #669

assign this also
Otherwise i wont count
@tushargupta1504

**it will not be counted if not ASSINED THIS


[chore] clippy warnings

use https://crates.io/crates/pretty-assertions

gets rid of "bool_assert_comparison" clippy warnings
add prettier assertions

enhanced "check.sh" to also cover tests for clippy warnings

Not using the PR template, as this is a cleanup

Codecov Report

Merging #230 (417fdb5) into main (24183f6) will decrease coverage by 0.02%.
The diff coverage is 0.00%.

@@            Coverage Diff             @@
##             main     #230      +/-   ##
==========================================
- Coverage   46.10%   46.07%   -0.03%
==========================================
  Files          69       69
  Lines        2180     2179       -1
==========================================
- Hits         1005     1004       -1
  Misses       1175     1175

Impacted Files
Coverage Δ

lib/src/actions/package/providers/dnf.rs
58.02% <ø> (-0.52%)
:arrow_down:

lib/src/actions/user/providers/mod.rs
0.00% <0.00%> (ø)

lib/src/atoms/command/exec.rs
48.48% <ø> (ø)

lib/src/atoms/directory/create.rs
82.60% <ø> (ø)

lib/src/atoms/file/chmod.rs
73.07% <ø> (ø)

lib/src/atoms/file/chown.rs
64.15% <ø> (ø)

lib/src/atoms/file/contents.rs
67.85% <ø> (ø)

lib/src/atoms/file/copy.rs
78.04% <ø> (ø)

lib/src/atoms/file/create.rs
75.00% <ø> (ø)

lib/src/atoms/file/decrypt.rs
87.09% <ø> (ø)

... and 9 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 24183f6...417fdb5. Read the comment docs.


Eval script fails on CPU on model generated by ExecuTorch

🐛 Describe the bug
I am using ET and generating the quantized version of the model as shown in the README.
python torchchat.py export llama3.1 --quantize config/data/mobile.json --output-pte-path llama3.1.pte

Then we when I tried to evaluate the model using the python runtime on Desktop , it fails
python torchchat.py eval llama3.1 --pte-path llama3.1.pte --limit 5
NumExpr defaulting to 16 threads.
PyTorch version 2.5.0.dev20240716+cpu available.
Warning: checkpoint path ignored because an exported DSO or PTE path specified
Using device=cpu
Loading model...
Time to load model: 0.05 seconds
Loading custom ops library: /home/ubuntu/anaconda3/envs/torchchat/lib/python3.10/site-packages/executorch/examples/models/llama2/custom_ops/libcustom_ops_aot_lib.so
I 00:00:00.004209 executorch:program.cpp:133] InternalConsistency verification requested but not available
-----------------------------------------------------------
Using device 'cpu'
/home/ubuntu/anaconda3/envs/torchchat/lib/python3.10/site-packages/huggingface_hub/file_download.py:1150: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
  warnings.warn(
[Task: wikitext] metric word_perplexity is defined, but aggregation is not. using default aggregation=weighted_perplexity
[Task: wikitext] metric word_perplexity is defined, but higher_is_better is not. using default higher_is_better=False
[Task: wikitext] metric byte_perplexity is defined, but aggregation is not. using default aggregation=weighted_perplexity
[Task: wikitext] metric byte_perplexity is defined, but higher_is_better is not. using default higher_is_better=False
[Task: wikitext] metric bits_per_byte is defined, but aggregation is not. using default aggregation=bits_per_byte
[Task: wikitext] metric bits_per_byte is defined, but higher_is_better is not. using default higher_is_better=False
Downloading builder script: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 10.7k/10.7k [00:00<00:00, 46.8MB/s]
Downloading readme: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 7.78k/7.78k [00:00<00:00, 39.3MB/s]
Repo card metadata block was not found. Setting CardData to empty.
Repo card metadata block was not found. Setting CardData to empty.
Downloading data: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 4.72M/4.72M [00:00<00:00, 64.4MB/s]
Generating test split: 62 examples [00:00, 1903.53 examples/s]
Generating train split: 629 examples [00:00, 5131.04 examples/s]
Generating validation split: 60 examples [00:00, 7172.82 examples/s]
Building contexts for wikitext on rank 0...
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 5/5 [00:00<00:00, 796.73it/s]
Running loglikelihood_rolling requests
  0%|                                                                                | 0/5 [00:00<?, ?it/s]E 00:00:31.679303 executorch:tensor_impl.cpp:86] Attempted to resize a static tensor to a new shape at dimension 1 old_size: 1 new_size: 1263
E 00:00:31.679320 executorch:method.cpp:824] Error setting input 0: 0x10
  0%|                                                                                | 0/5 [00:00<?, ?it/s]
Time to run eval: 6.75s.
Traceback (most recent call last):
  File "/home/ubuntu/torchchat/torchchat.py", line 92, in <module>
    eval_main(args)
  File "/home/ubuntu/torchchat/eval.py", line 252, in main
    result = eval(
  File "/home/ubuntu/anaconda3/envs/torchchat/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 116, in decorate_context
    return func(*args, **kwargs)
  File "/home/ubuntu/torchchat/eval.py", line 198, in eval
    eval_results = evaluate(
  File "/home/ubuntu/anaconda3/envs/torchchat/lib/python3.10/site-packages/lm_eval/utils.py", line 288, in _wrapper
    return fn(*args, **kwargs)
  File "/home/ubuntu/anaconda3/envs/torchchat/lib/python3.10/site-packages/lm_eval/evaluator.py", line 373, in evaluate
    resps = getattr(lm, reqtype)(cloned_reqs)
  File "/home/ubuntu/anaconda3/envs/torchchat/lib/python3.10/site-packages/lm_eval/models/huggingface.py", line 840, in loglikelihood_rolling
    string_nll = self._loglikelihood_tokens(
  File "/home/ubuntu/anaconda3/envs/torchchat/lib/python3.10/site-packages/lm_eval/models/huggingface.py", line 1033, in _loglikelihood_tokens
    self._model_call(batched_inps, **call_kwargs), dim=-1
  File "/home/ubuntu/torchchat/eval.py", line 146, in _model_call
    logits = self._model_forward(x, input_pos)
  File "/home/ubuntu/torchchat/eval.py", line 240, in <lambda>
    model_forward = lambda x, input_pos: model(x, input_pos)  # noqa
  File "/home/ubuntu/anaconda3/envs/torchchat/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1716, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/home/ubuntu/anaconda3/envs/torchchat/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1727, in _call_impl
    return forward_call(*args, **kwargs)
  File "/home/ubuntu/torchchat/build/model_et.py", line 23, in forward
    logits = self.model_.forward(forward_inputs)
RuntimeError: method->set_inputs() for method 'forward' failed with error 0x12

Versions
Collecting environment information...
PyTorch version: 2.5.0.dev20240716+cpu
Is debug build: False
CUDA used to build PyTorch: None
ROCM used to build PyTorch: N/A

OS: Ubuntu 22.04.4 LTS (x86_64)
GCC version: (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0
Clang version: Could not collect
CMake version: version 3.30.2
Libc version: glibc-2.35

Python version: 3.10.14 (main, May  6 2024, 19:42:50) [GCC 11.2.0] (64-bit runtime)
Python platform: Linux-6.5.0-1014-aws-x86_64-with-glibc2.35
Is CUDA available: False
CUDA runtime version: No CUDA
CUDA_MODULE_LOADING set to: N/A
GPU models and configuration: No CUDA
Nvidia driver version: No CUDA
cuDNN version: No CUDA
HIP runtime version: N/A
MIOpen runtime version: N/A
Is XNNPACK available: True

CPU:
Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      46 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             16
On-line CPU(s) list:                0-15
Vendor ID:                          GenuineIntel
Model name:                         Intel(R) Xeon(R) Platinum 8375C CPU @ 2.90GHz
CPU family:                         6
Model:                              106
Thread(s) per core:                 2
Core(s) per socket:                 8
Socket(s):                          1
Stepping:                           6
BogoMIPS:                           5799.93
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single ssbd ibrs ibpb stibp ibrs_enhanced fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid avx512f avx512dq rdseed adx smap avx512ifma clflushopt clwb avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves wbnoinvd ida arat avx512vbmi pku ospke avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg tme avx512_vpopcntdq rdpid md_clear flush_l1d arch_capabilities
Hypervisor vendor:                  KVM
Virtualization type:                full
L1d cache:                          384 KiB (8 instances)
L1i cache:                          256 KiB (8 instances)
L2 cache:                           10 MiB (8 instances)
L3 cache:                           54 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-15
Vulnerability Gather data sampling: Unknown: Dependent on hypervisor status
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass:    Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Enhanced / Automatic IBRS, IBPB conditional, RSB filling, PBRSB-eIBRS SW sequence
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected

Versions of relevant libraries:
[pip3] executorch==0.4.0a0+c757499
[pip3] numpy==1.26.4
[pip3] torch==2.5.0.dev20240716+cpu
[pip3] torchao==0.3.1
[pip3] torchaudio==2.4.0.dev20240716+cpu
[pip3] torchsr==1.0.4
[pip3] torchvision==0.20.0.dev20240716+cpu
[conda] executorch                0.4.0a0+c757499          pypi_0    pypi
[conda] numpy                     1.26.4                   pypi_0    pypi
[conda] torch                     2.5.0.dev20240716+cpu          pypi_0    pypi
[conda] torchao                   0.3.1                    pypi_0    pypi
[conda] torchaudio                2.4.0.dev20240716+cpu          pypi_0    pypi
[conda] torchsr                   1.0.4                    pypi_0    pypi
[conda] torchvision               0.20.0.dev20240716+cpu          pypi_0    pypi
(torchchat) ubuntu@ip-172-31-7-68:~/torchchat$

Thanks for flagging @agunapal
This is a known issue that we'll be looking at https://github.com/pytorch/torchchat/issues/938
Since eval is using the same concept as generate for evaluation, most likely there's a wiring bug

Interestingly, generate works for me
 python torchchat.py generate llama3.1 --device cpu --pte-path llama3.1.pte --prompt "Hello my name is"
NumExpr defaulting to 16 threads.
PyTorch version 2.5.0.dev20240716+cpu available.
Warning: checkpoint path ignored because an exported DSO or PTE path specified
Warning: checkpoint path ignored because an exported DSO or PTE path specified
Using device=cpu Intel(R) Xeon(R) Platinum 8375C CPU @ 2.90GHz
Loading model...
Time to load model: 0.05 seconds
Loading custom ops library: /home/ubuntu/anaconda3/envs/torchchat/lib/python3.10/site-packages/executorch/examples/models/llama2/custom_ops/libcustom_ops_aot_lib.so
I 00:00:00.006447 executorch:program.cpp:133] InternalConsistency verification requested but not available
-----------------------------------------------------------
Hello my name is Mark, I am a retired U.S. Marine, live in Ocean City, Maryland. I am a Licensed Real Estate Salesperson. My specialty is assisting buyers, sellers, and investors of residential, commercial and waterfront properties. My goal is to provide you with exceptional service, expertise, and understanding of local and state real estate market trends.
The beauty of the Delaware Coast, Ocean City, Maryland and surrounding areas offer a variety of properties and opportunities for investors, buyers, and real estate professionals. If you are searching for your dream home, wish to invest in a rental property, or seek assistance with buying, selling, or renting a property, I am here to help.
My commitment is to treat each client with professionalism, honesty, integrity, and respect. I promise to be available at your convenience, work diligently on your behalf, and continually inform you regarding market conditions, and information that may be beneficial in making informed decisions.
My business hours are Monday through Friday, from 8:00
Time for inference 1: 118.21 sec total, time to first token 2.92 sec with sequential prefill, 199 tokens, 1.68 tokens/sec, 594.00 ms/token
Bandwidth achieved: 0.00 GB/s
*** This first iteration will include cold start effects for dynamic import, hardware caches. ***

========================================

Average tokens/sec: 1.68
Memory used: 0.00 GB

Thanks again for flagging. We have @vmpuri looking at this
Tracking in umbrella issue


ci: add test selector flag in jenkins script

Additional flag to selectively filter e2e tests for ease of testing on jenkins. The default behavior to run all e2e tests remains the same.
/cc @hongchaodeng @xiang90

Need to set the default value in hack/ci/run as well.

lgtm after nits


fix!: mn_rr features only for v21+

Issue being fixed or feature implemented
Should not be 2 forks in one version
What was done?

Asset Unlock transactions (withdrawals) should be available only in MN_RR fork
MN_RR should not be auto-activated on Main net without intentional release of code (and not by spork), but they are need on test net to test platform.

How Has This Been Tested?
Run unit/functional tests
Breaking Changes
Yes (see "what was done")
Checklist:

[x] I have performed a self-review of my own code
[x] I have commented my code, particularly in hard-to-understand areas
[ ] I have added or updated relevant unit/integration/functional/e2e tests
[ ] I have made corresponding changes to the documentation
[x] I have assigned this pull request to a milestone

MN_RR should not be auto-activated on Main net without intentional release of code (and not by spork), but they are need on test net to test platform

so is SPORK_24_EHF not longer need or is it a non-mainnet only spork now?

MN_RR should not be auto-activated on Main net without intentional release of code (and not by spork), but they are need on test net to test platform

so is SPORK_24_EHF not longer need or is it a non-mainnet only spork now?

Basically non-main net only, a value could still be set; but it doesn't (shouldn't) affect anything on mainnet

so is SPORK_24_EHF not longer need or is it a non-mainnet only spork now?

This spork has been introduced to prevent activation of mn_rr before platform is ready.
As discussed today:

Asset Unlock transaction is not tested properly on testnet yet; not tested properly feature should not be potentially active on mainnet; also it may require consensus rules to chage
2 forks are confusing for dash users. Let's keep the rule "1 major version = 1 hard-fork"
activation of a hard fork by spork is it bad idea; because it should relay on user's update, not DCG command to do anything.

So, mn_rr requires a new release v21 or v20.1; the spork maybe even dropped then.
For testnet it is needed for platform's need + to test EHF mechanism.


Invalid entries are causing the daily update job to fail

Using cached entry, and https://github.com/streamsets/datacollector has issues with stats fetching: 404 - {"message":"Not Found","documentation_url":"https://docs.github.com/rest/reference/repos#get-a

No cached entry, and https://github.com/Robinsystems/robin has issues with stats fetching: 404 - {"message":"Not Found","documentation_url":"https://docs.github.com/rest/reference/repos#get-a

no headquarter addresses for snyk at https://www.crunchbase.com/organization/snyk

No cached entry, and Valve Software (member) has issues with twitter: https://twitter.com/valveoficial, 404 - {"errors":[{"code":34,"message":"Sorry, that page does not exist."}]}

No cached entry, and Sosivio (member) has issues with twitter: https://twitter.com/SosivioLtd, 404 - {"errors":[{"code":34,"message":"Sorry, that page does not exist."}]}

Empty twitter for Rancher Federal (member): https://twitter.com/rancherfederal

No cached entry, and Kingsoft (member) has issues with twitter: https://twitter.com/KingsoftC, 401 - {"request":"/1.1/statuses/user_timeline","error":"Not authorized."}

No cached entry, and Kingsoft Cloud (KCSP) has issues with twitter: https://twitter.com/KingsoftC, 401 - {"request":"/1.1/statuses/user_timeline","error":"Not authorized."}

Empty twitter for Standard Library: https://twitter.com/AutocodeHQ

No cached entry, and Kingsoft Container Engine has issues with twitter: https://twitter.com/KingsoftC, 401 - {"request":"/1.1/statuses/user_timeline","error":"Not authorized."}

Empty twitter for StackStorm: https://twitter.com/Stack_Storm

This seems resolved. Closing

Happening again:
Build failed because of:
No cached entry, and can not fetch: caddy-3b18. Request failed with status code 404
Empty twitter for Mail.Ru Cloud Solutions (member): https://twitter.com/mailru
Empty twitter for China Telecom (member): https://twitter.com/chinatelecom1
Empty twitter for Mail.Ru Cloud Containers: https://twitter.com/mailru
Empty twitter for Scalyr: https://twitter.com/scalyr
Empty twitter for Spotinst Functions: https://twitter.com/spot_hq
No cached entry, and Sangfor CNAD has issues with twitter: https://twitter.com/SangforUSA, Request failed with status code 404
No cached entry, and Sangfor EDS has issues with twitter: https://twitter.com/SangforUSA, Request failed with status code 404
Empty twitter for Karmada: https://twitter.com/karmada_io
Caddy either has no crunchbase entry or it is invalid


⚠ Bofrost.fr has degraded performance

In f699763, Bofrost.fr (https://www.bofrost.fr) experienced degraded performance:

HTTP code: 200
Response time: 1441 ms

Resolved: Bofrost.fr performance has improved in 3c647b3.


Support logging to file

Need to add functionality to logging all service to file (location to file should be configurable)
File with logs should store on device not in docker container

Logs files should be grouped by day

For logging to file using rolling appender need add this props to application.yaml or .properties
logging:
  logback:
    rollingpolicy:
      max-history: 30
  file:
    path: /web_service_logs

logging.file.path depends on service
More info about logging here in spring docs


Add an initial version of aquarat dataset

One of the datasets I mentioned in #77.
So there's an issue I've come across, the way the actual dataset is described is as follows:

A large-scale dataset consisting of approximately 100,000 algebraic word problems.
The solution to each question is explained step-by-step using natural language.
This data is used to train a program generation model that learns to generate the explanation,
while generating the program that solves the question.

But I'm not sure that entirely fits the use-case that we trying to test, the actual dataset gives the questions, options and expects the correct answer with the rationale, for now I have only implemented the correct option part.
Adding the rationale part would require modification of the few-shot description and also evaluation through BLEU scores.

greedy_until is now implemented on master so it should be possible to generate justification and compare BLEU score. In particular, we probably need to figure out how we want to integrate that in. There's a few sane options I can think of:

do one greedy_until that only generates the justification and one loglikelihood only for the multiple choice
do one greedy_until that only generates the justification and one loglikelihood only for the multiple choice, but give the multiple choice the correct justification sans the last line
do one greedy_until that only generates the justification and then feed that as context into one loglikelihood the multiple choice (this one seems the most optimal to me but would also require a bit of implementation legwork on my part to make work)

Mathqa obsoletes the need for this task


Azurite emulator for local Azure Storage development : Unable to retreive child resource in Microsoft Azure Storage Explorer

Preflight Checklist

[X] I have installed the latest version of Storage Explorer.
[X] I have checked existing resources, including the troubleshooting guide and the release notes.
[X] I have searched for similar issues.

Storage Explorer Version
1.31.1
Regression From
No response
Architecture
x64
Storage Explorer Build Number
No response
Platform
All
OS Version
No response
Bug Description
Azurite emulator for local Azure Storage development : Unable to retreive child resource
Error Message : Unable to retrieve child resources
Detail : "HTTP/1.1 404 , Not Found"
"url": "http://<IP_ADDRESS>:10000/devstoreaccount1?comp=list&include=metadata",
"method": "GET"

Steps to Reproduce

docker pull mcr.microsoft.com/azure-storage/azurite
docker run -p 10000:10000 mcr.microsoft.com/azure-storage/azurite azurite-blob --blobHost <IP_ADDRESS> --blobPort 10000
Open Microsoft Azure Storage Explorer connect to "Blob Containers"

Actual Experience
I try to create an azure blob storage emulator in my local machine by the following step:

docker pull mcr.microsoft.com/azure-storage/azurite
docker run -p 10000:10000 mcr.microsoft.com/azure-storage/azurite azurite-blob --blobHost <IP_ADDRESS> --blobPort 10000
Open Microsoft Azure Storage Explorer connect to "Blob Containers"

But got the below error when I connect it with the Microsoft Azure Storage Explorer.
Error Message : Unable to retrieve child resources
Detail : "HTTP/1.1 404 , Not Found"
"url": "http://<IP_ADDRESS>:10000/devstoreaccount1?comp=list&include=metadata",
"method": "GET"

Expected Experience
No response
Additional Context
No response

Hello:

What version of azurite are you using?
Are you able to share the stdout/terminal/log output of Azurite?

@ninoissac Your issue is different from the original author's. Please open a new issue and follow the template to describe it.

Closing due to lack of response from original author. This issue will no longer be monitored. If you still require help, we recommend opening an Azure support ticket via the Azure portal.


[enhancement] Add missing bower.json.

Hey, maintainer(s) of js-coder/cookie.js!
We at VersionEye are working hard to keep up the quality of the bower's registry.
We just finished our initial analysis of the quality of the Bower.io registry:
7530 - registered packages, 224 of them doesnt exists anymore;
We analysed 7306  existing packages and  1070 of them don't have bower.json on the master branch ( that's where a Bower client pulls a data ).
Sadly, your library js-coder/cookie.js is one of them.
Can you spare 15 minutes to help us to make Bower better?
Just add a new file bower.json and  change attributes.
{
  "name": "js-coder/cookie.js",
  "version": "1.0.0",
  "main": "path/to/main.css",
  "description": "please add it",
  "license": "Eclipse",
  "ignore": [
    ".jshintrc",
    "**/*.txt"
  ],
  "dependencies": {
    "<dependency_name>": "<semantic_version>",
    "<dependency_name>": "<Local_folder>",
    "<dependency_name>": "<package>"
  },
  "devDependencies": {
    "<test-framework-name>": "<version>"
  }
}

Read more about bower.json on the official spefication and nodejs semver library has great examples of proper versioning.
NB! Please validate your bower.json with jsonlint before commiting your updates.
Thank you!
Timo,
twitter: @versioneye
email<EMAIL_ADDRESS>VersionEye - no more legacy software!

+1.  This makes this library incompatible with gulp plugins like https://github.com/ck86/main-bower-files

Sorry for the way too late reaction, I added it now.


Profile Info. end point is not working

when we provide session cookie to it, it shows invalid details

Discussed offline with the logger, not a code related issue
Debug findings:
APW page is not filled for the user causing the element find conflicts
Works for other IDS
will check if this can be handled better
Closing for now, feel free to reopen if the issue recurs


op-tee os mbedtls

0001-scripts-update-scripts-to-use-python3.patch missing from the bbappend?

good point I just updared the pull request


[WIP] add offline Docker container serving docs

This change is

Online preview: http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/2eb671463478ed4346270bc47f3e8c5bbb816777/


bug(python): PanicException: attempt to divide by zero when creating index

LanceDB version
v0.6.6
What happened?
PanicException: attempt to divide by zero when creating index with:
tbl.create_index(metric='cosine')

or
tbl.create_index()

the table has ~6000 doc and full scan search works well.
Are there known steps to reproduce?
New to lancedb and followed steps similar to readme.md on https://github.com/lancedb/lancedb.
The full scan search works well, but a little bit slow, so tried to add an index.

what kind of latency are you seeing? Full scan should still be very fast at that scale.
If you inserted one row at a time instead of in one batch, you'll get much better performance from doing a compaction (lancedb_table.to_lance().optimize.compact_files())

the divide by zero error is probably from the default parameters which has too many partitions for your dataset. At 6k vectors, num_partitions should be like 2 or 4. But again, if you're seeing bad latency at such low scale, it's more likely compaction than indexing that will help


Interactive Ability between Python Script and Unity

I would like to be able to interact back and forth with a python script through my Unity game. I know there's Python for Unity, but that seems to just run a single Python script from start to finish.
I was wondering, is there a way to run a Python script in Unity and have information go back and forth between the script and Unity in real time so that it's interactive? A basic example would be to have a button in Unity that causes a change in the Python script every time it's clicked.
I wasn't sure how to label this request/question so I labeled it as a feature request. Please let me know if this is possible to do in Unity?

Hi @AbhiG7
Thank you for your issue. Microsoft Mixed Reality Toolkit version 2 (MRTK2) is currently in limited support. This means that Microsoft is only fixing high priority security issues.  Unfortunately, this issue does not meet the necessary priority and will be closed.  If you have any concerns or questions, please reply to this issue.
Microsoft recommends that all new HoloLens 2 Unity applications use MRTK3 instead of MRTK2.
Please note that MRTK3 was released in August 2023. It features an all-new architecture for developing rich mixed reality experiences and has a minimum requirement of Unity 2021.3 LTS. For more information about MRTK3, please visit https://www.mixedrealitytoolkit.org.
Thank you for your continued support of the Mixed Reality Toolkit!


[AMORO-2296] Add cache for loading tables in core and trino

Why are the changes needed?
Close #2296.
Brief change log

Add a cache for loading tables.
Implement caching catalog in BasicMixedIcebergCatalog.

How was this patch tested?

[ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

[ ] Add screenshots for manual tests if appropriate

[ ] Run test locally before making a pull request

Documentation

Does this pull request introduce a new feature? (no)
If yes, how is the feature documented? (not applicable)

LGTM

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


crazymartin.com uses an invalid security certificate.

crazymartin.com uses an invalid security certificate. The certificate expired on July 19, 2021 at 4:37 AM. The current time is August 23, 2021 at 6:59 PM. Error code: SEC_ERROR_EXPIRED_CERTIFICATE

Hey, the domain I use is crazymarvin.com.
Did I put crazymartin.com somewhere by mistake? Thanks for your help.

Sorry about that. I managed to mistype it 5 times. It's surprising that I managed to make it here. Bleah.


WIP: v0.13.x plugin: upgrade helper - more fixes and features

Codecov Report

Merging #1682 into v0.13.x will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           v0.13.x   #1682   +/-   ##
=======================================
  Coverage     25.4%   25.4%
=======================================
  Files           98      98
  Lines         5065    5065
=======================================
  Hits          1287    1287
  Misses        3635    3635
  Partials       143     143

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6bf0e67...70dbd4c. Read the comment docs.

Yes, it should be disabled by default in cluster.yaml template (which it does appear to be)
Do not merge please, more testing required. ;)


Multi-part challenges pagination

This PR implements issue #420, adding pagination for the multiple videos of multi-part coding challenges, with minimal change to the code and without affecting any of the existing challenge configurations.
I'm open to any feeback regarding the way I implemented it and the graphic design :smiley:
A demo can be seen on challenge 54 : https://deploy-preview-428--codingtrain.netlify.app/challenges/54-islamic-star-patterns

Ok, here we go!!!!! @kfahn22 this will affect some of the multi-part challenges you are working on FYI.


Backoff attempts to label node

--wait-ready is not enough to guarantee node is ready in Kubernetes' world.  We need to try again if it fails, or cleanup gets broken.

Would like to see the formatting checks fixed.  Why wasn't that fixed before merging #6?


[Disco] Pass entrypoint to disco session after upstream changes

This is needed if we use the rebased branch https://github.com/vinx13/tvm/tree/for-mlc-serve-jan9

cc @sunggg


node.h: No such file or directory

CXX(target) Release/obj.target/node_sqlite3/src/database.o
../src/database.cc:2:18: fatal error: node.h: No such file or directory
I have this problem trying to install sqlite3 on Debian Wheezy on a Beaglebone Black rev C.
I installed others packages without a problem.

Closing; stale - reopen if you can confirm on current node-sqlite3 and Debian.


Make Page.Resources into a method

See https://discourse.gohugo.io/t/a-page-in-site-sections/11690/16
But check the error handling before doing so.

This is fixed.


Ability to solve for a varaible

Maybe I missed this, but I don't see a way to solve for a variable. Is there a way to do that? I'd like to be able to do something like this:
double x = new ExpressionBuilder("(4*x)+2=2*(x+6)").build().solveFor("x");
Assert.assertEquals(5, x, 0.0);

Hey @tburch,
Sorry but exp4j is just an expression evaluator not a function solver. It's not only out of scope for the project, but also the algorithm used (Shunting Yard) is not able to solve general functions.

Thanks @fasseg!

@fasseg I was thinking about this a little more. Isn't this really just the same as expression evaluation? Essentially, this is just rearranging the equation and then doing the expression evaluation, no?

@tburch: In Simple cases this migth be true. So e.g. solving 1-x=0 might be trivial, but solving something more intricate like x(1-4)=3 or some higher order polynomial is much harder and involves a lot of logic which is not trivial at all.


Fix stock events triggers

I want to merge this change because it fixes PRODUCT_VARIANT_OUT_OF_STOCK and PRODUCT_VARIANT_BACK_IN_STOCK webhooks triggers to also handle stock allocations.
It fixes #11637

Impact

[ ] New migrations
[ ] New/Updated API fields or mutations
[ ] Deprecated API fields or mutations
[ ] Removed API types, fields, or mutations
[ ] Documentation needs to be updated

Pull Request Checklist

[ ] Privileged queries and mutations are guarded by proper permission checks
[ ] Database queries are optimized and the number of queries is constant
[ ] Database migration files are up to date
[ ] The changes are tested
[ ] GraphQL schema and type definitions are up to date
[ ] Changes are mentioned in the changelog

@jakubkuc The main issue works as expected.
But something you mention in the comment:

still sending back_in_stock event, is this something that will be fixed in this PR?

@szczecha We discussed it. And creating a stock should not triggerOUT_OF_STOCK event. OUT_OF_STOCK should be triggered only when there were stocks and they turned 0 (either 0 in stock or by allocations) and BACK_IN_STOCK only when the stock amount was changed from 0 to above 0.


NAT64 Support

Hello,
I've just discovered fck-nat and I am thrilled that something like this exists because those AWS Managed NAT Gateways are pricey (especially with a Multi-AZ implementation).
However, I am wondering if there are any plans to implement support for NAT64 in fck-nat? I've been experimenting with IPv6-only private subnets ever since AWS announced that there will be charges for Public IPv4 addresses starting in 2024 and NAT64 seems like a requirement.
Thank you.

I asked the same thing last week and got this reply.
I have a proof of concept NAT64 Linux box running on AWS, and it works as expected (thankfully, AWS VPC supports DNS64 out of the box and for free!). I hope to take a look at integrating this with fck-nat over the next 1-2 weeks.

@LazerGrieves @apparentorder I just want to make sure you're aware of Egress Only Internet Gateways which provide NAT64 in VPCs for free. If you're already aware of that feature, is there a reason it doesn't work for your use case?

I'm still pre-first-coffee right now, but I'm pretty sure that EO-IGW does not provide NAT64; the link above does not contradict that, and the DNS64/NAT64 docs support that (the NAT64 route 64::ff9b::/96 is supposed to point to a NAT Gateway). NAT64 is a feature of Managed NAT Gateway. Do you have additional resources, or have you tried yourself?

Unless I am mistaken, one of the core features of NAT64 is allowing communication from IPv6 (our instance), to IPv4 (remote server). Egress-Only IGW seem to be able to communicate only from IPv6 to IPv6 addresses, hence requiring NAT64 to offer translation when one wishes to have an IPv6 <> IPv4 communication.

Ah, yep, you're both correct. Had it in my head that EO-IGWs did NAT64 but I was mistaken. @apparentorder was pre-first-coffee and I was post-time-for-bed

@LazerGrieves @apparentorder I fully implemented this feature into fck-nat, this really wasn't a piece of cake. I implemented this using Tayga which comes with it's lot of constraints (therefore probably not expected to be a on-by-default feature) that I will elaborate on in the PR.
Have been able to make this work with both IPs as well as domain names, even for those not supporting AAAA fields, leveraging AWS' integrated DNS. To note, AWS DNS64 is very slow for some reason with requests taking up to 3 seconds.
I will make a PR for this feature either sometime today or tomorrow.

Very cool! My proof of concept was with Jool, which is a kernel module, hence more performant – and it seems to be "more maintained" than tayga. But I really wasn't sure how to best combine building a kmod from source with fck-nat's current packer infrastructure, so I'm really glad that you went ahead :-)
Regarding this:

AWS DNS64 is very slow for some reason with requests taking up to 3 seconds

I have seen EC2 IPv6-only VMs that were deployed with a broken resolver config. The resolv.conf actually had an IPv4 resolver listed first. I have observed the same DNS lookup delay and assumed it's because the VM tries to query the IPv4 resolver first, and only proceeds to query the IPv6 resolver address after a 3s timeout. I didn't dig into the issue, so I cannot say if this theory is correct, and if it only affects AL2023, or "all" AWS-provided AMIs. But the DNS64 support in itself was not slow for me. It worked great once I removed the IPv4 resolver.

Thanks @apparentorder for sharing! Jool is indeed a much better alternative than TAYGA. In addition to not having the various constraints TAYGA is riddled with, it also runs as a kernel module which indeed is more yields better results.
As for the slow DNS issue you are right as well, the resolv.conf had the IPv4 resolver listed first which caused the issue in the first place. Removing it entirely fixed the problem. This issue is therefore also happening on AL2 and is probably worth looking into further.

@apparentorder wondering if you tried making ipv4 take precedence over ipv6 by adding a precedence value in the getaddrinfo config (/etc/gai.conf)? I've run into a similar situation before and this solved it for me. It has to be the very first thing your script does.
echo 'precedence ::ffff:0:0/96 100' >> /etc/gai.conf

I've created a fck-nat-1.4 branch which I'll use to build a pre-release AMI off of which those who are interested can use to test NAT64 support. I don't have the bandwidth at the moment to do extensive NAT64 testing personally so my primary testing focus will be ensuring this feature doesn't cause any regressions for regular NAT use cases.
I expect to have the pre-release AMI out some time next week and I'll announce here when it is ready. In the meantime, if you are interested in testing and have a particular region you'd like the pre-release AMI deployed to, please comment below.

@AndrewGuenther Glad to hear it! If you could include the us-east-2 region, I would be happy to perform some testing.
Thank you for all the work you've done so far.

I tested again and it still works on my end. Tried in both a IPv6 and a dual-stack setup. I will update my nat64 branch on the Terraform module to make it easy to test for those who'd like to easily try.
Regarding your request for me to have a look at @nickpetrovic post:
Unfortunately I haven't been able to reproduce the slow DNS for IPv4, could have been because I was using AL2 back then, unsure. Nevertheless, this potential issue should be considered out of scope for this project as it affects the machine that needs to be NATted rather than the NAT instance itself, therefore, up to the users to configure themselves.

Ah I didn't realize that issue was not impacting NAT. Nevermind then!

I'm planning to deploy the AMI to the following regions and can add as necessary:

us-west-2
us-east-1
us-east-2

Quick update here: I've hit quotas on number of public AMIs allowed. I'm waiting on AWS support to grant increases in these regions and will follow-up asking for increases in other regions since this will block future releases...

It's as if AWS support heard my cries. Pre-release AMIS with NAT64 are now available!
ARM AMIs:
us-east-1: ami-0c2e470170d2a48e3
us-east-2: ami-068b53093f22a6584
us-west-2: ami-0e7c2bc7b3fd2ccaa
x86 AMIs:
us-east-1: ami-0328a21a503f457f0
us-east-2: ami-03d634862884cb475
us-west-2: ami-09ef1da1160df1bdf

Just updated the Terraform module to have a functional NAT64 support with the latest fck-nat version. You can easily experiment using the nat64 branch of the repo, start, which would allow one to quickly setup a full env to test.
Make sure to set the ami_id to one of the values from the post above before applying, then start an EC2 in the fck-nat-example-public6 subnet. If you have configured SSM by setting the appropriate role you should be able to SSM into the instance (service which only supports IPv4, and therefore means NAT64 is working).

How is this working for everyone? Any issues?

How do you guys achieve the DNS64 stuff with this NAT64? On our IPv6 instance if we ping github.com which is an IPv4 only website, we don't get a response.
ubuntu@ipv6:~$ ping google.com
PING google.com(sea30s10-in-x0e.1e100.net (2607:f8b0:400a:807::200e)) 56 data bytes
64 bytes from sea30s10-in-x0e.1e100.net (2607:f8b0:400a:807::200e): icmp_seq=1 ttl=58 time=7.67 ms
64 bytes from sea30s10-in-x0e.1e100.net (2607:f8b0:400a:807::200e): icmp_seq=2 ttl=58 time=7.74 ms
64 bytes from sea30s10-in-x0e.1e100.net (2607:f8b0:400a:807::200e): icmp_seq=3 ttl=58 time=7.79 ms
^C
--- google.com ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2002ms
rtt min/avg/max/mdev = 7.666/7.733/7.793/0.052 ms
ubuntu@ipv6:~$ ping github.com
PING github.com(lb-140-82-116-4-sea.github.com (64:ff9b::8c52:7404)) 56 data bytes
^C
--- github.com ping statistics ---
7 packets transmitted, 0 received, 100% packet loss, time 6129ms

@faizan-planview If you are using the Terraform module did you make sure to use one of the AMI version published above? I just updated the branch to include a default AMI pointing to us-east-1 by default to avoid confusion.
Once Terraform applied, you will have three subnets:

fck-nat-example-public: IPv4/IPv6, where fck-nat resides
fck-nat-example-private: IPv4/IPv6, uses IPv4 or IPv6 depending on target (DNS64 disabled and not needed)
fck-nat-example-public6: IPv6 only, connects to IPv6 targets normally through the instance's own IPv6; connects to IPv4 via NAT64 by mapping the IPv4 into 64:ff9b::/96 subnet (DNS64 enabled)

If you want to test NAT64 feature, you should deploy your instance within the fck-nat-example-public6 subnet. Following the commands you used within the above setup:
# ping google.com -c 3
PING google.com(bl-in-f101.1e100.net (2607:f8b0:4004:c17::65)) 56 data bytes
64 bytes from bl-in-f101.1e100.net (2607:f8b0:4004:c17::65): icmp_seq=1 ttl=58 time=1.14 ms
64 bytes from bl-in-f101.1e100.net (2607:f8b0:4004:c17::65): icmp_seq=2 ttl=58 time=1.14 ms
64 bytes from bl-in-f101.1e100.net (2607:f8b0:4004:c17::65): icmp_seq=3 ttl=58 time=1.16 ms

--- google.com ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 1.141/1.148/1.162/0.009 ms
[root@i-0b6903729637332b6 bin]# ping github.com -c 3
PING github.com(lb-140-82-113-4-iad.github.com (64:ff9b::8c52:7104)) 56 data bytes
64 bytes from lb-140-82-113-4-iad.github.com (64:ff9b::8c52:7104): icmp_seq=1 ttl=52 time=1.35 ms
64 bytes from lb-140-82-113-4-iad.github.com (64:ff9b::8c52:7104): icmp_seq=2 ttl=52 time=1.41 ms
64 bytes from lb-140-82-113-4-iad.github.com (64:ff9b::8c52:7104): icmp_seq=3 ttl=52 time=1.48 ms

--- github.com ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.346/1.409/1.476/0.053 ms

I have been testing this both with AL2023 and Ubuntu.

I've created a fck-nat-1.4 branch which I'll use to build a pre-release AMI off of which those who are interested can use to test NAT64 support. I don't have the bandwidth at the moment to do extensive NAT64 testing personally so my primary testing focus will be ensuring this feature doesn't cause any regressions for regular NAT use cases.
I expect to have the pre-release AMI out some time next week and I'll announce here when it is ready. In the meantime, if you are interested in testing and have a particular region you'd like the pre-release AMI deployed to, please comment below.

Is it possible to deploy the pre-release to eu-west-1? We want to do some testing to see if this can resolve our extreme NAT64 costs after transitioning to an IPv6-only Kubernetes cluster.

I actually want to do the same as @guuse, ipv6 only with EKS, but in eu-central-1. What is the current state?


Rebase Add-intelcpu branch

I believe this would fix the deployment test issues

Is this ok @captn3m0 ? Just doing this to be able to test https://github.com/endoflife-date/endoflife.date/pull/1397 properly

I think it's just one commit that's needed: https://github.com/endoflife-date/endoflife.date/commit/6392f896652ef2cad42aa7382003b8a8f0de2d11
Let me just push that to #1397 instead.

Closing this as #1397 is now building correctly.


Document CIDR blocks

The Network Policy below allow access to all, exept internal networks (<IP_ADDRESS>/16 and <IP_ADDRESS>/24)
kind: NetworkPolicy
apiVersion: networking.k8s.io/v1
metadata:
  name: allow-external
  namespace: dmz
spec:
  podSelector: {}
  policyTypes:
  - Egress
  - Ingress
  egress:
  - to:
    - ipBlock:
        cidr: <IP_ADDRESS>/0
        except:
        - <IP_ADDRESS>/16
        - <IP_ADDRESS>/24
    - namespaceSelector:
        matchLabels:
          name: dmz

how to write network policy, deny to all, except few internal network ip?

Can namespaceSelector and ipBlock really be combined ? According to https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.25/#networkpolicypeer-v1-networking-k8s-io

ipBlock -- IPBlock defines policy on a particular IPBlock. If this field is set then neither of the other fields can be.

I don't think anyone claimed they can be combined.

@rhuss that documentation refers to NetworkPolicyPeer. The example above is NetworkPolicy

@boredabdel NetworkPolicyPeer is a subtype that is used for the to: and from: field for egress and ingress rules (so it's the type of the to: field in this example). The documentation actually refers exactly to this example.
@ahmetb aren't both used at the same time in the example in https://github.com/ahmetb/kubernetes-network-policy-recipes/issues/6#issuecomment-404137084 ? 🤔

No, they're separate independent "to" targets in an array that's additive?

gotcha. sorry for the noise.


edcas-client: init at 0.2.6

Description of changes
edcas-client is an information dashboard for the game Elite Dangerous

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
24.05 Release Notes (or backporting 23.05 and 23.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

You'd want to amend to the older init commit instead of creating a new one. Please see the commit guidelines

You'd want to amend to the older init commit instead of creating a new one. Please see the commit guidelines

If I understand this correctly, the commit tagged with fixup should be squashed automatically so this should be okay.
I am still fixing the substitution paths because the missing icons now cause it to crash...

BTW, you didn't remove the Cargo.lock file from the commit (since you removed the import)

BTW, you didn't remove the Cargo.lock file from the commit (since you removed the import)

Yes, I was able to remove the explicit Cargo.lock import and have it still fetch it.
However the CI here fails without the file so I added it back. If you have a better idea to make this work, please tell me.
Also thank a lot for looking over this PR!

If you have a better idea to make this work, please tell me.

Sorry, but I don't. I haven't worked around Rust packaging a lot and whatever I reviewed was based on the docs. I think I'll leave this here for another reviewer to pick up :)

will open another PR when upstream fixes the path handling


Feature: for framework to receive and upload files to aws s3 buckets so user can view pdf for their case, Bugfix: for database and fastapi

The changes you made looks good, but please pull from the main branch before you make changes.


Hosts documentation for the cargo packages.

🎉 New feature
Related to #57
Summary
Host documentation on github.io
Checklist

[x] Signed all commits for DCO
[ ] Added tests
[ ] Added example and/or tutorial
[ ] Updated documentation (as needed)
[ ] Updated migration guide (as needed)
[ ] Consider updating Python bindings (if it affects the public API)

Reminder to myself

[ ] Once it is done testing remove francocipollone/gh-pages branch from github-pages environment

This is the deployed github pages: https://maliput.github.io/maliput-rs/


3d pre-train model request

Hello,
I found your model is very useful for our starmap data ！ thanks for developing method!
However,I am currently experiencing an issue with accessing the smfish_3d and synth_3d models using the Spotiflow.from_pretrained method. When I attempt to load these models,could your provide the download url for your pretrained 3d model? It would be very useful for me to try your method!
Chen

Hi Chen,
Happy it works well :) The models should be downloadable in the latest versions of the software. Could you try to update in case you don't have the latest version (pip install -U spotiflow) and try again?
If after updating you still get the error, could you paste it here to try to figure out what's going on?


Improvement in ReadMe.md file and contributing guidline.

Under this issue you have to descride what you will do.
Issue will be assigned to best one.

@Yash-Parsana I would like to work on this issue.

Under this issue you have to descride what you will do. Issue will be assigned to best one.

The changes I want to implement in the ReadMe.md file:

Introducing a section " TECHNOLOGY STACK" showing the badges of the different technologies and programming
languages used with a brief description of each.
Instead of displaying the repository status at the beginning a new section "REPO STATUS" can be introduced.
Adding README badges for the section "Supported Platforms".
Adding a "CONTRIBUTORS" section if there are any or a project admin section.
Adding various social media platform links to connect to the project admin.
Adding images of the website after the introduction section.
Regarding the Contributing Guideline section, along with the steps the command can also be provided for performing it.
For example: For cloning or making a branch, the associated command can be provided so that it becomes easy for the user to do so.

I would like to do it. Please assign it to me @Yash-Parsana under GSSOC'23.

@Yash-Parsana Assign this issue to me as you mentioned on Issue #45

This issue is assigned to @Anikinee under GssoC'23.

This issue is assigned to @Anikinee under GssoC'23.

Thank you for assigning!

This is not just fair @Yash-Parsana


Execute eval() in global scope with external vars injected

There are currently various problems with use of eval():

Edge cases bugs.
Causes complications around variable naming, and the need to freeze variable names where they're accessible to eval().
Complications with use of this in eval() where eval() is inside an arrow function.
Code in eval() can assign to const external scope vars, where should throw an error.
Entire hierarchy of blocks/scopes which contains a single eval() statement has to be wrapped in (0, eval)(...) to prevent access to other vars, which prevents source maps working within any of those functions.
Makes code-splitting of those blocks more difficult.
All helper functions need to be inlined as cannot create temp vars in upper scope to hold the helpers, as these vars would be visible to eval(). This is inefficient.
If code is transformed to ES5, this will create various temp vars (e.g. const [x, y] = f(); becomes var _temp = f(), x = _temp[0], y = _temp[1];). These temp vars will be accessible from within the eval(), where they shouldn't be.

Could solve all these problems by running all eval() code in global scope and explicitly passing in variables the eval expression can access.
Input:
const x = 1;
let y = 2;
export default z => eval(z);

Current output (even with mangle option enabled):
export default (0, eval)("\"use strict\";(x, y) => z => eval(z);")(1, 2);

Could instead output:
function _eval(code, localEval, isStrict, ...varMappings) {
  // Get unused var name
  let usedPostfix = 0;
  for (const [, aliasName] of varMappings) {
    const match = aliasName.match(/^_(\d+)$/);
    if (match) {
      const postfix = match[1] * 1;
      if (postfix > usedPostfix) usedPostfix = postfix;
    }
  }
  const safeVarName = `_${usedPostfix + 1}`;

  // Create object to use in `with() {}` to allow access to external vars
  const withObj = Object.create(null);
  let thisValue;
  for (const [varName, aliasName, isConst] of varMappings) {
    const get = () => localEval(aliasName);
    if (varName === 'this') {
      thisValue = get();
    } else {
      const set = isConst
        ? _constViolation
        : localEval(`${safeVarName} => ${aliasName} = ${safeVarName}`)
      Object.defineProperty(withObj, varName, {get, set});
    }
  }

  // Execute code in global scope, with access to local vars via `with () {}` object getters/setters
  if (isStrict) code = `'"use strict";'+${code}`;
  const firstVarName = varMappings[0][0];
  return new Function(
    firstVarName,
    `with (${firstVarName}) { return eval(${code}) }`
  ).call(thisValue, withObj);
}

function _constViolation() {
  const c = 0;
  c = 1;
}

export default (
  (a, b) => c => _eval( 'z', d => eval(d), true, ['x', 'a', true], ['y', 'b'] , ['z', 'c'] )
)( 1, 2 );

Note that:

Vars in scope functions can be renamed.
Const violations in the eval() code throw errors as they should.
Use of this is properly supported.
The variable holding the with object is named same as one of the vars that the with object provides, so it remains inaccessible.

This output is much more verbose, but more correct, and the _eval() helper would only need to be included in output once even if multiple eval()s in the application.

Above implemented as a runtime helper in eval-helper branch.
These is one problem with this approach:
The function created by new Function(...) is sloppy mode. This is required for usage of with() {}. However, sloppy mode functions treat this in an annoying way - calling a sloppy mode function with f.call(undefined) or f.call(null) results in this inside the function being the global object. If called with f.call(123) (or any other primitive value), the value of this inside the function is boxed (i.e. Number(123)).
This can be fixed by changing the above to:
return new Function(
  firstVarName,
  `with (${firstVarName}) {
    return function() {
      "use strict";
      return eval(${code})
    };
  }`
 )(withObj).call(thisValue);

However, this prevents access to arguments if provided by the with() {} object.

I also considered using with () {} to prevent access to external vars and re-route accesses to the global object as if the var didn't exist. i.e.:
const _hiddenVar = 1;

const withObj = Object.create(null);
Object.defineProperty( withObj, '_hiddenVar', {
  get() {
    if (!(_hiddenVar in global)) throw new ReferenceError('_hiddenVar is not defined');
    return global._hiddenVar;
  },
  set(v) {
    if (!(_hiddenVar in global)) throw new ReferenceError('_hiddenVar is not defined');
    global._hiddenVar = v;
  }
} );

with (withObj) {
  eval('_hiddenVar');
}

Unfortunately, this doesn't work due to differences in behavior with non-existent globals between strict and sloppy mode.
In strict mode, assigning to a non-existent global throws an error (as above). But in sloppy mode assignment succeeds.
Which is the correct behavior depends on whether it's strict or sloppy where the assignment is made. As this is happening inside eval(), and the code being evaluated is unknown until runtime, it's impossible to determine whether an error should be thrown in this case or not without parsing and examining the code being eval()-ed at runtime.
Obviously shipping a parser in compiled code to deal with these cases is impractical.

Going to have exactly the same problem with arguments if output is compiled to ES5 (no arrow functions).
Babel converts this:
function f() {
  return () => [ this, arguments, eval('[this, arguments]') ];
}

to:
function f() {
  var _arguments = arguments, _this = this;
  return function () {
    return [_this, _arguments, eval("[this, arguments]")];
  };
}

We can do a bit better with:
function f() {
  return Function.prototype.bind.apply(
    function () {
      return [ this, arguments, eval("[this, arguments]") ];
    },
    [this].concat( Array.prototype.slice.call(arguments) )
  );
}

But still we have the same problem with arguments inside and outside the inner function not being same object, and therefore changes to one not being reflected in the other.
So this problem is not entirely solvable in ES5.

Another problem: How to deal with super in eval? e.g.:
const obj = {
  foo() {
    return () => eval('super.foo()');
  }
};
Object.setPrototypeOf( obj, {
  foo() { return 1; }
} );
export default obj.foo();

eval() wrapper would need to populate value of super.
Could replace new Function(...) in implementation above with something like:
const objWrapper = (0, eval)(`
  ({
    _(${firstVarName}) {
      with (${firstVarName}) {
        return eval(${code})
      }
    }
  })
`);
Object.setPrototypeOf( objWrapper, Object.getPrototypeOf( superValue ) );
return objWrapper._.call(thisValue, withObj);

However, this assumes the prototype of original obj is not changed within the eval(). e.g. this input would defeat it:
const obj = {
  foo() {
    return () => eval(`
      Object.setPrototypeOf( obj, { foo: () => 2 } );
      super.foo()
    `);
  }
};
Object.setPrototypeOf( obj, {
  foo() { return 1; }
} );
export default obj.foo();

Only ways to capture the change of prototype would be:

Pass in a Proxy to obj with a trap to catch a change in prototype.
Shim Object.setPrototypeOf() and Object.prototype.__proto__ setter to catch change in prototype.

Option (1) is not workable in browsers which don't support Proxy, so out of the question (unless all browsers which support super also support Proxy?)
Option (2) is pretty nasty.
Would need to apply the shim globally to catch obj.__proto__ = ....
Shim would look something like:
const watchCallbacks = [];
function protoBeingSet(obj, proto) {
  watchCallbacks.forEach( cb => cb(obj, proto) );
}

const protoPropDescriptor = Object.getOwnPropertyDescriptor(Object.prototype, '__proto__'),
  protoPropSetter = protoPropDescriptor.set;
Object.defineProperty(Object.prototype, '__proto__', { // eslint-disable-line no-extend-native
  ...protoPropDescriptor,
  set(proto) {
    protoBeingSet(this, proto);
    return protoPropSetter.apply(this, arguments);
  }
});

const {setPrototypeOf} = Object;
Object.setPrototypeOf = function(obj, proto) {
  protoBeingSet(obj, proto);
  return setPrototypeOf.apply(this, arguments);
};

Eval shim would add a callback to watchCallbacks:
watchCallbacks.push( (alteredObject, newProto) => {
  if (alteredObject === superValue) {
    Object.setPrototypeOf(objWrapper, newProto);
  }
} );

Problem is that need to remove watch callback from the array once eval() is done to avoid a memory leak. eval()-ed code may contain async code (e.g. setTimeout()) so can't assume watcher can be removed immediately after executing eval().
Could use a WeakMap keyed by the tracked object instead of an array to partly solve this, but only if WeakMap is available in all browsers which support super(). I don't know if this is the case. And it doesn't fully solve it anyway, since tracked object may still be referenced elsewhere and so the watcher function would be retained even after it's no longer needed.
A lot of problems!
NB The machinery to handle this could be omitted if eval() is never used in an a method where super is available (i.e. object method or class method where that class has a super class). So would only bloat output code where it's possible it would be used.
Or could opt just not to support this edge case.

Actually, maybe this would do the trick:
const objWrapper = (0, eval)(`
  ({
    _(${firstVarName}) {
      with (${firstVarName}) {
        return eval(${code})
      }
    }
  })
`);
Object.setPrototypeOf( objWrapper, superValue );
return objWrapper._.call(thisValue, withObj);

i.e. Set prototype of the wrapper object to the super object, instead of super object's prototype.
This would not work if there's delete super.foo in the eval()-ed code. But I don't think that's valid JS anyway.
Maybe this could work!


Doesn't use full context properly

Not sure if maybe there's a setting I need to change somewhere, but for example, I'm trying to write a story and what the add-in outputs doesn't make sense. I think you said in the add-in's description that it should take into account the full context of the document, but so far, that hasn't been my experience.
I've been trying another add-in (called "GPT for Excel Word") and this one outputs more coherent responses. The only downside with it is that I need to keep "Connected Experiences" turned on.

That sounds very interesting! Do you mind sharing the word count of your story? I believe the issue might be due to the model's capability to handle long context windows. I believe "GPT for Excel Word" uses OpenAI's models like GPT-4o which are much more capable of handling long context windows (correct me if I'm wrong). You could try changing the system prompt for the "Generate" feature and optimize it for story writing by changing a user environment variable TEXTCRAFT_GENERATE_PROMPT. Just make sure to restart Word after you change the system prompt. The default system prompt for "Generate" looks like this:
Generate content for a document, knowing you are an AI embedded within a word processor. Understand and respond to the user's prompt with specificity and a captivating emotional range.

Assess the provided document contents carefully, ensuring your response is cohesive with the document's style and meets the user's emotional expectations. Use additional RAG context only if it is relevant to the task. Prioritize satisfying the user's requirements fully, including incorporating specified emotions such as joy, curiosity, empathy, and surprise to engage the reader.

# Steps

1. Recognize your role as an AI within a word processor.
2. Analyze the document contents to understand the style and emotional tone.
3. Identify user query specifics and requirements.
4. Integrate context and RAG information only if highly relevant.
5. Craft a response that emulates a human touch, accounting for style and emotion while incorporating a joyful tone to engage the reader.
6. Ensure the response aligns with the overarching theme of the document.

# Output Format

- Responses should be structured in compact Markdown without unnecessary newlines.
- Prioritize cohesive and emotionally resonant language.
- Responses must be relevant to the document content and user query, incorporating varied emotions, especially joy, curiosity, empathy, and surprise.

# Notes

- Use sarcasm and emotional cues sensitively and where fitting.
- Ensure the style and voice are consistent throughout the document.
- Aim for maximal alignment with user expectations and context specifics, particularly regarding emotional engagement.

That sounds very interesting! Do you mind sharing the word count of your story? I believe the issue might be due to the model's capability to handle long context windows. I believe "GPT for Excel Word" uses OpenAI's models like GPT-4o which are much more capable of handling long context windows (correct me if I'm wrong). You could try changing the system prompt for the "Generate" feature and optimize it for story writing by creating a user environment variable TEXTCRAFT_GENERATE_PROMPT. Just make sure to restart Word after you change the system prompt. The default system prompt for "Generate" looks like this:
Generate content for a document, knowing you are an AI embedded within a word processor. Understand and respond to the user's prompt with specificity and a captivating emotional range.

Assess the provided document contents carefully, ensuring your response is cohesive with the document's style and meets the user's emotional expectations. Use additional RAG context only if it is relevant to the task. Prioritize satisfying the user's requirements fully, including incorporating specified emotions such as joy, curiosity, empathy, and surprise to engage the reader.

# Steps

1. Recognize your role as an AI within a word processor.
2. Analyze the document contents to understand the style and emotional tone.
3. Identify user query specifics and requirements.
4. Integrate context and RAG information only if highly relevant.
5. Craft a response that emulates a human touch, accounting for style and emotion while incorporating a joyful tone to engage the reader.
6. Ensure the response aligns with the overarching theme of the document.

# Output Format

- Responses should be structured in compact Markdown without unnecessary newlines.
- Prioritize cohesive and emotionally resonant language.
- Responses must be relevant to the document content and user query, incorporating varied emotions, especially joy, curiosity, empathy, and surprise.

# Notes

- Use sarcasm and emotional cues sensitively and where fitting.
- Ensure the style and voice are consistent throughout the document.
- Aim for maximal alignment with user expectations and context specifics, particularly regarding emotional engagement.

Ah okay, so it does work better now after setting up an environment variable for text generation, but I still need to do further testing to make sure that it grasps the context as well as it should. I'm using the same model as before. On TextGen WebUI, LM Studio, and Koboldcpp the next generated text adheres to the context well. I'm not sure if I have to specifically change the context length in Ollama or if it's changed by default by the add-in.
The other add-in I was talking about does allow the user to set up their Ollama endpoint, which was what I did to compare. Maybe there's a problem with the instruction prompt somewhere because a lot of times the generated text continues even after it should have stopped, often outputting gibberish at the end like [END TOOLS CALL] or something like that.

I believe Ollama has a bug in which OpenAI-compatible API calls have their context windows capped at 2048 tokens because num_ctx is specific to Ollama API. I hope they fix it soon.


License clarification

Hi, could you clarify the license of Vue-Croppa, please?
Maybe add a LICENSE.md file in the repo?

https://github.com/zhanziyang/vue-croppa/blob/master/LICENSE.md
Done.


Automate generation of singularity images

To enable #1602, we need to automate the generation of singularity images. There's multiple possibilities including

Integrating this into the workflow for accepting simulators into the registry: convert image and save image to a repository
Make pulling the Docker image and conversion to singularity (if necessary) part of running a simulation

In the first approach, we need to set up the GH actions container to convert docker to singularity and then use any singularity registry to save the built singularity images.
In the second approach, if we build a singularity image on every simulation, it'll take a lot of time to start a simulation unless we use some cache to cache the previously built image.
I think the first approach is way cleaner and more manageable in the long term.

Either way, there should be a local cache of Singularity images.
I could incorporate generation of Singularity images into the register simulator workflow and push the images to SingularityHub. This has the additional advantage of making the Singularity images publicly accessible.

I like the idea of posting to singularity hub. Then, the simulators database can include an additional format in the images section of the metadata.
The dispatch job can then use the singularity hub URL for each simulation run.  I assume that singularity, like docker, will keep a local cache automatically and will not re download the singularity images that it does not need to.

Though, I think it would be better to have a separate action to build the singularity images that is triggered by an update to the container registry. This would account for any rebuilds that we might do, as well as test tags that we need to push

Singularity Hub seems to a be an academic project that could fit our needs. It would be especially important that we use a local cache however
https://singularityhub.github.io/singularityhub-docs/2019/security-release/

I can set this up as an action on pushing containers to GHCR.

So looking into it more, I don't think singularity hub would work. It seems to require connection to git repo with recipe files, and does not have a way to push built images.

Looking at this documentation here, I think it might actually be sufficient to just run the singularity pull command from the GHCR.
Doing something such as  singularity pull docker://ghcr.io/biosimulators/gillespy2:1.5.6 should create the image for us, and cache it. We might just be able to add this to the sbatch script. I can look into this.
https://singularity.lbl.gov/docs-docker

I did just try this, and it seemed to have worked. Rather than point singularity to a precreated image on the cluster, I pointed it to the dockerhub container registry URL.  The image was downloaded, converted, cached, and then run. This took longer than the usual simulations, but hopefully the next run will be faster.

I would like to run this by @mpw6 and @moraru, but it seems that we can just change our script slightly, and not worry about building the images at all

Looking more, Singularity Hub might be tough. Overall, it seems to be an academic project that's still a bit immature. In addition, to what Bilal suggested, it has a bunch of limits on number of builds, pulls, etc. I don't think it was designed with the intention of someone using this to build a domain-specific container registry. I think we'd need to reach out to them to allow our account to bypass their limits.
Given this and what Bilal noted, I think we should ignore Singularity Hub. I couldn't find any other public Singularity Hub. I don't think we should try to run our own version of Singularity Hub.

The image was created and cached the same way that it would have been if done manually
INFO:    Creating SIF file... INFO:    Build complete: /home/FCAM/crbmapi/.singularity/cache/oci-tmp/4674a8025b15e1dde4113e0b15b426af6aa93f456345b0dcef022f58609af161/gillespy2_latest.sif INFO:    Image cached as SIF at /home/FCAM/crbmapi/.singularity/cache/oci-tmp/4674a8025b15e1dde4113e0b15b426af6aa93f456345b0dcef022f58609af161/gillespy2_latest.sif

I can confirm that the image did not need to be built the second time, it proceeded straight to running it. There was no output however, but actually an error. XPaths must reference unique objects. The following XPaths do not match any objects:

/sbml:sbml/sbml:model/sbml:listOfSpecies/sbml:species[@id="BUD"]

This looks good to me. The simulation correctly generated an error because the SED-ML references an target (XPATH) that doesn't exist in the SBML file. In this case, BUD is a variable, not a species. The SED-ML file in BioModels is actually invalid.
The target should have been this:
/sbml:sbml/sbml:model/sbml:listOfVariable/sbml:variable[@id="BUD"]

Note, I haven't yet had time to cleanup the examples collated into biosimulators_test_suite. Some of the these are invalid. We didn't notice earlier when we were saving all predictions rather than those requested by SED-ML.

Huh. It seems then that the gillespy2 image did not update yesterday as I had thought. The current singularity image does produce the output, like it use to before the fix

I was able to confirm with the tellurium image, that a direct pull from dockerhub will work. I will confirm that this is okay with mike and ion and then update the service

https://sylabs.io/guides/3.7/user-guide/singularity_and_docker.html#best-practices
@jonrkarr  This link provides some documentation into the constraints that the docker image must satisfy to be compatible with this approach. I dont see us running into any issues, but we should pin this to the documentation to ensure that all containers built for simulators are following these priciples

This seems to be a registry where we can upload singularity containers independently of running them on the hpc
https://cloud.sylabs.io/library

Here is an example container pushed  to the registry, https://cloud.sylabs.io/library/biosimulators/default/gillespy2
I was able to use the online builders that are provided. It is also possible to use the cli

I created biosimulators/Biosimulators/#24 to build workflow for generating and pushing Singularity images to Syslab

Since Docker images can easily be converted to Singularity, we have decided not to push images to Syslabs, at least until we can get a larger quoata.

[ ] Add Singularity conversion to image validation workflow
[ ] Add documentation about how to use images with Singularity

Done except merging docs in dev branch


Assignment 2 completed

What changes are you trying to make? (e.g. Adding or removing code, refactoring existing code, adding reports)
Assignment 2 submission
What did you learn from the changes you have made?
linear regression
Was there another approach you were thinking about making? If so, what approach(es) were you thinking of?
we can use some other libraries other than sklearn
Were there any challenges? If so, what issue(s) did you face? How did you overcome it?
coding syntax, by checking with help function.
How were these changes tested?
Yes
A reference to a related issue in your repository (if applicable)
Checklist

[ ] I can confirm that my changes are working as intended

A2: Complete
Great work Chetan !


How to navigate to "next" buffer?

I love this plugin! Thank you so much :)
As far as I can tell, reordering buffers only changes how buffers are displayed in this plugin. Using :bn to navigate buffer will still use the neovim buffer ordering.
I use <tab> to move to the next buffer (which calls :bn), what would be the proper mapping to reproduce the same behavior but based on buffer_manager ordering?

Hi, I have just added two functions to go the next and previous buffers in the buffer_manager list. In your case, you can use the nav_next function this way:
map('n', '<Tab>', require("buffer_manager.ui").nav_next, {noremap = true})

Thanks for your feedback. I will close the issue once it is confirmed that everything works as expected.

This is working great! Thank you :)

Hi! Is it possible to preselect the alternative buffer in the list? I hate pressing <C-^> (this is three keys for me on my keyboard with one hand) to toggle between buffers. I'd like to open the list and hit CR to open the alternative buffer.

Thanks but I don't like messing with builtin maps. The reason I asked is because this is native behavior for Telescope and I'm used to it. It's so intuitive and the only feature I like in Telescope.

I will take a look, although I am not very convinced, as I still think it is better to use built-in remaps for that.
Anyway, that question is not related to this issue and, as it seems that the added functionality regarding this issue is correct, I will close it.


synthesis script template

Hi,
I am trying to synthesis swerv-el2 by using design compiler.
I got some syntax error messages while analyzing it.
They seem to be related to 'package' and 'include'.
Actually, because I am not good at synthesis work, I don't know what to do.
Is there a kind of synthesis script template for swerv-el2 ?
Thanks in advance.

There is a "Pro" version of Core SweRV Support package (SSP), which contains tamplates and proven scripts for SweRV EL2 DC synthesis. You can use fusesoc flow with DC in a similar way as you have (probably) done with Vivado. Please contact<EMAIL_ADDRESS>for a help.

Dear Codasip,
Thanks for the advice.
Actually, I can't afford Pro version service yet.
I hope that I have a chance to use it someday.
I will try to find a way in fusesoc flow as you mentioned.
Thank you very much.


Feat: Adding method to swiggy

Describe the feature
Finding restaurants with online food delivery as per the city
Add ScreenShots

Record

[X] I agree to follow this project's Code of Conduct
[X] I'm a GSSOC 23 contributor
[X] I want to work on this issue

Go ahead @Juhibhojani
Note

Create a separate module for this, as per the folder and project structure
Do not use the `selenium web driver as it is not compatible with all devices as well as cloud platforms.
Before making any changes, check if the module you want to add already exists or not. If yes, then add your functionality as a method only else make a separate module and class for it.

All the best 👨💻


How to debug openssl could not resolve for environment spec inside a package?

(UnROOT) pkg> st
Project UnROOT v0.10.32
Status `~/Documents/github/dotFiles/homedir/.julia/dev/UnROOT/Project.toml`
  [1520ce14] AbstractTrees v0.4.5
  [7d9f7c33] Accessors v0.1.38
  [65a8f2f4] ArraysOfArrays v0.6.5
  [c3b6d118] BitIntegers v0.3.2
  [5ba52731] CodecLz4 v0.4.5
  [ba30903b] CodecXz v0.7.4
  [6b39b394] CodecZstd v0.8.5
  [68837c9b] FHist v0.11.6
  [cd3eb016] HTTP v1.10.8
  [c8e1da08] IterTools v1.10.0
  [8ac3fa9e] LRUCache v1.6.1
  [9255714d] LibDeflate v0.4.2
  [3f54b04b] LorentzVectors v0.4.3
  [6fafb56a] Memoization v0.2.1
  [2a8e4939] Mixers v0.1.2
  [d96e819e] Parameters v0.12.3
  [aea7be01] PrecompileTools v1.2.1
  [08abe8d2] PrettyTables v2.4.0
  [6099a3de] PythonCall v0.9.23
  [91c51154] SentinelArrays v1.4.5
  [90137ffa] StaticArrays v1.9.7
  [09ab397b] StructArrays v0.6.18
  [bd369af6] Tables v1.12.0
  [164e3b87] XRootD v0.1.0
  [e5d8e439] XXHashNative v1.0.1
  [a63ad114] Mmap
  [fa267f1f] TOML v1.0.3

(UnROOT) pkg> conda add openssl=3.3.0
    CondaPkg Found dependencies: /home/akako/Documents/github/dotFiles/homedir/.julia/dev/UnROOT/CondaPkg.toml
    CondaPkg Found dependencies: /home/akako/.julia/packages/PythonCall/Nr75f/CondaPkg.toml
    CondaPkg Resolving changes
             ~ openssl
    CondaPkg Installing packages
             │ /home/akako/.julia/artifacts/7973f2c7725e2d0eef7a95159454c4145f0945a2/bin/micromamba
             │ -r /home/akako/.julia/scratchspaces/0b3b1443-0f03-428d-bdfb-f27f9c1191ea/root
             │ install
             │ -y
             │ -p /home/akako/Documents/github/dotFiles/homedir/.julia/dev/UnROOT/.CondaPkg/env
             │ --override-channels
             │ --no-channel-priority
             │ libstdcxx-ng[version='>=3.4,<13.0']
             │ openssl[version='=3.3.0']
             │ openssl[version='>=1.1, <1.1.24']
             │ python[version='>=3.8,<4',channel='conda-forge',build='*cpython*']
             └ -c conda-forge
conda-forge/linux-64                                        Using cache
conda-forge/noarch                                          Using cache
error    libmamba Could not solve for environment specs
    The following packages are incompatible
    ├─ openssl 3.3.0*  is requested and can be installed;
    └─ openssl >=1.1,<1.1.24  is not installable because it conflicts with any installable versions previously reported.
critical libmamba Could not solve for environment specs
ERROR: failed process: Process(`/home/akako/.julia/artifacts/7973f2c7725e2d0eef7a95159454c4145f0945a2/bin/micromamba -r /home/akako/.julia/scratchspaces/0b3b1443-0f03-428d-bdfb-f27f9c1191ea/root install -y -p /home/akako/Documents/github/dotFiles/homedir/.julia/dev/UnROOT/.CondaPkg/env --override-channels --no-channel-priority "libstdcxx-ng[version='>=3.4,<13.0']" "openssl[version='=3.3.0']" "openssl[version='>=1.1, <1.1.24']" "python[version='>=3.8,<4',channel='conda-forge',build='*cpython*']" -c conda-forge`, ProcessExited(1)) [1]

this doesn't happen in a clean environment, but it's not clear what dependency is causing openssl to lock at a specific version

    CondaPkg Found dependencies: /home/akako/Documents/github/dotFiles/homedir/.julia/dev/UnROOT/CondaPkg.toml
    CondaPkg Found dependencies: /home/akako/.julia/packages/PythonCall/Nr75f/CondaPkg.toml

These two lines tell you where the dependencies come from. It's most likely your dev version of UnROOT.

> cat /home/akako/Documents/github/dotFiles/homedir/.julia/dev/UnROOT/CondaPkg.toml
[deps]
openssl = "=3.3.0"

Could you do a
pkg> st -m

to check for Julia's OpenSSL packages? From you output it looks as if the two version restrictions
libstdcxx-ng[version='>=3.4,<13.0']
openssl[version='>=1.1, <1.1.24']

result from the version = "<=julia"
I suspect that your OpenSSL or OpenSSL_jll is at 1.x. In that case you could do a
pkg> st -m --outdated

To check what's restricting your version. Maybe, you just need a package update?

It's your XRootD dependency, in particular its dependency of an older version of CxxWrap. You might open an issue and ask the author to support a newer version of CxxWrap.jl.

You can now set JULIA_CONDAPKG_OPENSSL_VERSION=ignore if you'd like to turn off this behaviour. See the README for more info.


Add Sliding window

Issue will be closed if:

You mention more than one algorithm. You can create a separate issue for each algorithm once the current one is completed.
You propose an algorithm that is already present or has been mentioned in a previous issue.
You create a new issue without completing your previous issue.

Note: These actions will be taken seriously. Failure to follow the guidelines may result in the immediate closure of your issue.

Name:
[Sliding window ]
About:
the purpose of a sliding window, in various fields like computer science, signal processing, and statistics, is to process data in a fixed-size window that moves or "slides" over a larger dataset. This technique is useful for efficiently handling problems that involve continuous streams of data or large datasets where processing the entire dataset at once is impractical.

Labels:
new algorithm, gssoc-ext, hacktoberfest, level1

Assignees:

[X ] Contributor in GSSoC-ext
[X ] Want to work on it

duplicate https://github.com/AlgoGenesis/C/pull/1128


\g [FILE] not works;

input like:
select * from a
\g ./file

Duplicate of #151

I just opened https://github.com/xo/usql/pull/194 that fixes this.


Handle more than one emails in the account contact

Let's give the option to add a list of emails in a account as described in https://tools.ietf.org/html/rfc8555#section-7.3.

Fix this here: https://github.com/veeti/manuale/issues/7


feat(gsoc'24): Forum Leaderboard Ranking

Fixes #18
This PR includes implementation of following feature

[x]  leaderboard page to showcase all ranks of users
[x]  points distribution on actions like forum thread creation, marking forum post as solution etc

Screenshot:

please resolve the conflicts

@nitin10s @hfactor Could you help @Waishnav  with UI for this feature ?


Hydrate Trait

Discussed in https://github.com/rruckley/tmflib/discussions/71

Originally posted by rruckley March 27, 2024
It would be useful to define a trait for any reference type, that defines a function to hydrate a reference into a real payload. To keep it simple, this could just return a string version of the payload that can later be parsed into a struct if required.
Then any struct that's defined as a reference can implement this.
This would be handy for micro-services but also back-end systems that need to pull in referenced data.

Consideration for how to represent both a reference to a foreign structure and the foreign structure itself.


Error Messages on Install

Hello! I am looking forward to being able to use your Pura add-in... but I am not able to get the first authentication install to complete. Getting these two errors:
Logger: pypura.pura
Source: /usr/local/lib/python3.11/site-packages/pypura/pura.py:193
First occurred: August 31, 2023 at 6:10:24 PM (592 occurrences)
Last logged: 7:44:15 AM

Status: 400 - {'message': 'getDevicesAndMigrate() Error'}

and
This error originated from a custom integration.

Logger: custom_components.pura.coordinator
Source: custom_components/pura/coordinator.py:50
Integration: Pura (documentation, issues)
First occurred: August 31, 2023 at 6:10:24 PM (592 occurrences)
Last logged: 7:44:15 AM

Unknown exception while updating Pura data: 400 Client Error: Bad Request for url: https://trypura.io/mobile/api/users/devices
Traceback (most recent call last):
  File "/config/custom_components/pura/coordinator.py", line 50, in _async_update_data
    if devices := await self.hass.async_add_executor_job(self.api.get_devices):
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/pypura/pura.py", line 97, in get_devices
    return self.__get("users/devices")
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/pypura/pura.py", line 199, in __get
    return self.__request("get", url, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/pypura/pura.py", line 194, in __request
    response.raise_for_status()
  File "/usr/local/lib/python3.11/site-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 400 Client Error: Bad Request for url: https://trypura.io/mobile/api/users/devices

They made a new release and some changes that broke things, so I'll have to check later


Change title font

pick one that is thicker and more blocky but doesn't look infantile

I settled on Work Sans, it's pretty good


Show partial analysis results

Think about Celery status requests. It would be good if partial results could be displayed while some calculations are still running. An idea would be to have a separate file ˋstatus.jsonˋ that contains the Celery task ID and has status information on the task. It would be updated by the Celery task function once finished (and once the results.json has been written)

May require #795

Closed by #965


Json schema for configuration file

There should be a json schema to specify the format of alias.json. This will become very useful as soon as the file is modified via text editor and not by MicroserviceManagerGUI.
test-fullautomation:
We also need to take care that we have a scaling structure. Json file becomes an API for test automation therefore later changes need to be avoided.

Hi @milanac030988 ,
please look into this for 0.13.0
Thank you,
Thomas

Not yet started

Hi @milanac030988 ,
please look into this for 0.13.0
Thank you,
Thomas