Optional protobuf compilation when it already exists

It seems that the service information is requested each time from the platform, and protobuf compilation is done each time.
Running the same script two times in a row produces the following messages each time:
~/.snet/naint/image-generation/python/Generation.proto removed.
client libraries for service with id "image-generation" in org with id "naint" generated at ~/.snet/naint/image-generation/python

This process requires several seconds. It should not be done each time. This can be achieved in different ways:

if the necessary folder exists, the info is not requested and compilation is not done by default. The flag force_update (or with another name) can be introduced to redo this.
Service versions can be supported, and only the version can be requested, and compilation can be redone if versions mismatch.
Other criteria like time passed?

Dear Necr0x0Der,
Thank you for reporting this issue. We appreciate your feedback and apologize for any inconvenience caused. After thorough investigation, we have resolved this issue in the latest version of our app.
The config now supports optional force_update key. If set to False (default) it will not re-download the proto file and re-generate the gRPC stubs if they already present in the .snet directory.
Please update to the most recent release, and if you encounter any further problems, feel free to reopen this issue or create a new one.
Best regards, Paul, SingularityNET

Thanks. It seems to work. The only question is what is the parameter for forcing proto files to be reloaded and recompiled? I'm not sure if this parameter should be True or False by default, but we may need control over it in any case

@Necr0x0Der if force_update is set to True, the SDK will always reload and recompile the proto files


Problems with example

Hello! First of all I want to thank you for such a great work!
Now I have a small problem I cant figure out. I copied the example ViewController to my project, created a new view and etc. Everything works fine except two things:

I always get the errors in NSLog (from didSelectItem: method):
2014-12-23 20:58:29.569 XXX[21526:807229] the behavior of the UICollectionViewFlowLayout is not defined because:
2014-12-23 20:58:29.569 XXXX[21526:807229] the item height must be less than the height of the UICollectionView minus the section insets top and bottom values.
2014-12-23 20:58:29.570 XXXXX[21526:807229] Please check the values return by the delegate.

The last item in the created view is always below the others...(see screenshot below)

What can be possibly be wrong? I cant figure it put for already two days))

Hi, I have problem with scrolling. I set the datasouce:
let data = [
"blank","0","1","2","3","4","5","6",
"7","8","9","\u{0022}", "\u{005C}", "§","&","@",
"#","$","€","£","¢","¥","฿","(",
")","]","[","{","}",">","<","~",
"’",".",";",":",",","–","+","±",
"*","/","_","|","%","≥","≤","‹",
"›","°","»","”","?","¿","!","¡",
"😃","😀","😊","☺","😉","😍","😘","😚",
"😗","😙","😜","😝","😛","😳","😁","😔",
"😌","😒","😞","😣","😢","😂","😭","😪",
"😥","😰","😅","😓","😩","😫","😨","😱",
"😠","😡","😤","😖","😆","😋","😷","😎",
"😴","😵","😲","😟","😦","😧","😮","😬",
"😐","😕","😯","😶","😇","😏","😑","❤",
"💔","💋","💘","💞","💌","👍","👌","👎",
"☀","☼","☽","☁","☂","★","☆","✈","⚽",
"👊","✌"
]
Scrolling is delayed (if you scroll more time, and is not working properly). And the app (thread) is blocked for a long time. Could you solve this problem and try to make this app async?
Thanks.

I tested, and it actually happens. But could you recreate a issue on AKPickerView-Swift?

@iOSDeveloperSK I tested, and it actually happens. But could you recreate a issue on AKPickerView-Swift?

And I couldn't reproduce @popovae 's problem after all. So I'm closing this issue, but any additional information are welcomed.

Hi!
Thanks for a great project - especially for the Swift version! :)
Just in case you're interested, the way to reproduce the problem where the second view was always below the others, is that you see the reported behaviour when you also see this message "behavior of the UICollectionViewFlowLayout is not defined because" ...
If you change the code to get rid of that warning message, like this Swift code:
  override func viewDidLoad() {
    super.viewDidLoad()

    // Advice from https://github.com/Akkyie/AKPickerView-Swift/issues/8
    self.automaticallyAdjustsScrollViewInsets = true

Then the problem disappears. I guess it must just be a problem with iOS.
Hope that helps!
Pete

@sseyod Thank you for your cooperation!


Explorer hide empty folder?

Hello! How to hide empty folders through files.exclude?

https://github.com/Microsoft/vscode/issues/763


For quality checks reference should be taken from actual PyTorch version of model

In order to do quick emprical testing, the ground truth of the model should be the model output from the raw float32 weights, which can be done from HF Transformers.

Issue has been resolved through PR #167 and #116. So now we can close this issue.


Get executables' version and details

Example code:
Set shell = CreateObject("Shell.Application")
Set folder = shell.Namespace("C:\Windows")

Set file = folder.ParseName("notepad.exe")

For i = 0 to 1000
    If folder.GetDetailsOf(file, i) <> "" Then _
      Wscript.Echo i & ": " & folder.GetDetailsOf(file, i)
Next

Based on http://stackoverflow.com/questions/2976734/how-to-retrieve-a-files-product-version-in-vbscript.

This doesn't work reliably over the network, so it isn't feasible as long as we rely on VBScript.
BTW, getting attribute -1 would be the best, because it includes all relevant info.

Actually, looks like it can be done with WMI, according to this:
strComputer = "."
Set objWMIService = GetObject("winmgmts:\\" & strComputer & "\root\cimv2")
Set colFiles = objWMIService.ExecQuery("Select Name, Version from CIM_Datafile Where Name = 'c:\\windows\\system32\\notepad.exe' OR Name = 'c:\\windows\\system32\\cmd.exe'")
For Each objFile in colFiles
    Wscript.Echo objFile.Name & vbTab & objFile.Version
Next

Reopening!


Docker license

Is Docker license included in Windows Server license?
The official web page for Docker Enterprise edition says that “Docker Enterprise (Windows Server) is available at no additional cost to all Windows Server 2019 and 2016 customers”, but I was not able find any license files with this information.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: e09e1b22-1344-d7b9-9462-dc4c2e160e86
Version Independent ID: f6411e97-4419-1209-56ad-9140ceb37329
Content: Windows and Linux Containers on Windows 10
Content Source: virtualization/windowscontainers/quick-start/set-up-environment.md
Service: windows-containers
Product: windows-containers
GitHub Login: @cwilhit
Microsoft Alias: crwilhit

I am confused also. What "customers" is it referring to? Docker customers or Microsoft Customers?
Docker site say free but has a button of "1 month trial".
Microsoft site say you need to install it separately but didn't mention about license.

There are similar questions about this topic here regarding Docker licenses on Windows Server systems:
https://github.com/microsoft/Windows-Containers/issues/135
https://github.com/OneGet/MicrosoftDockerProvider/issues/84
It isn't exactly clear on what is required from Windows users. My opinion is that Microsoft should explicitly define in their documentation what the licensing requirements are for running containers using the Docker engine (even if there are external licenses required) before deploying Windows containers on production systems.

We hugely appreciate your contribution, feedback, and support to our technical documentation.
We’ve phased out GitHub Issues on this repository as the feedback mechanism for content and have replaced it with a new feedback system. For more information see, Content User Feedback. As part of this rollout, we are migrating your issue where our team will use your comments to improve the documentation experience. Unfortunately, this does mean you won't be able to access this issue after the migration is complete.
All issues will be migrated by Thursday 29th August 2024.
Once again, thank you for your valuable feedback, we hope you’ll continue to contribute using our new feedback system.


Jest, ESM and Typescript - Must use import to load ES Module

🐛 Bug Report
I have 2 demo repos to show the issue. The second is just a Typescript version of the first. But essentially, the issue seems to be around using a mixture of ESM and CJS packages as dependencies triggers an error when using Typescript/Babel of:
Must use import to load ES Module: /Users/leepowell/Sites/jest-esm-ts-babel/node_modules/string-length/index.js

The repos contain 2 dependencies - is (CJS) and string-length (ESM) - just to demonstrate the combination of using both simultaneously.
The package.json contains "type": "module" and I'm running jest with the --experimental-vm-modules flag.
To Reproduce
Repo 1 - https://github.com/leepowelldev/jest-esm
This works as expected. Vanilla JS, no Typescript, and the tests run/pass.
Repo 2 - https://github.com/leepowelldev/jest-esm-ts-babel
This errors with the Must use import to load ES Module error. I have set this up as per Jests documentation around using Typescript/Babel.
Expected behavior
Repo 2 should run/pass as per repo 1
envinfo
  System:
    OS: macOS 11.5.2
    CPU: (6) x64 Intel(R) Core(TM) i5-8500B CPU @ 3.00GHz
  Binaries:
    Node: 16.7.0 - /usr/local/bin/node
    Yarn: 1.22.10 - /usr/local/bin/yarn
    npm: 7.20.3 - /usr/local/bin/npm
  npmPackages:
    jest: ^27.0.6 => 27.0.6

Repo 2 is missing 2 things mentioned in https://jestjs.io/docs/ecmascript-modules

"configure your transformer to emit ESM rather than the default CommonJS (CJS)." - see https://babeljs.io/docs/en/babel-preset-env#modules (you want to pass false)
"If you want to treat other file extensions (such as .jsx or .ts) as ESM, please use the extensionsToTreatAsEsm option."

Doing both of these makes the tests pass
diff --git i/babel.config.cjs w/babel.config.cjs
index 694b4a3..ef7dbd3 100644
--- i/babel.config.cjs
+++ w/babel.config.cjs
@@ -3,6 +3,7 @@ module.exports = {
     [
       '@babel/preset-env',
       {
+        modules: false,
         targets: {
           node: 'current',
         },
diff --git i/jest.config.js w/jest.config.js
index 947be52..5358a65 100644
--- i/jest.config.js
+++ w/jest.config.js
@@ -1,3 +1,4 @@
 export default {
   testEnvironment: 'node',
+  extensionsToTreatAsEsm: ['.ts'],
 };

@SimenB Thank you! I had tried the modules: false but not combined with the extensionsToTreatAsEsm.


[Bug]: vLLM on TPU get abnormal output for pixtral-large/12B when giving input with image.

Your current environment

The output of `python collect_env.py`
Collecting environment information...
PyTorch version: 2.6.0.dev20241126+cpu
Is debug build: False
CUDA used to build PyTorch: None
ROCM used to build PyTorch: N/A

OS: Ubuntu 22.04.5 LTS (x86_64)
GCC version: (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0
Clang version: Could not collect
CMake version: version 3.31.1
Libc version: glibc-2.35

Python version: 3.10.16 (main, Dec 11 2024, 16:24:50) [GCC 11.2.0] (64-bit runtime)
Python platform: Linux-5.19.0-1027-gcp-x86_64-with-glibc2.35
Is CUDA available: False
CUDA runtime version: No CUDA
CUDA_MODULE_LOADING set to: N/A
GPU models and configuration: No CUDA
Nvidia driver version: No CUDA
cuDNN version: No CUDA
HIP runtime version: N/A
MIOpen runtime version: N/A
Is XNNPACK available: True

CPU:
Architecture:                    x86_64
CPU op-mode(s):                  32-bit, 64-bit
Address sizes:                   52 bits physical, 57 bits virtual
Byte Order:                      Little Endian
CPU(s):                          208
On-line CPU(s) list:             0-207
Vendor ID:                       GenuineIntel
Model name:                      Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
CPU family:                      6
Model:                           143
Thread(s) per core:              2
Core(s) per socket:              52
Socket(s):                       2
Stepping:                        8
BogoMIPS:                        5399.99
Flags:                           fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid tsc_known_freq pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single ssbd ibrs ibpb stibp ibrs_enhanced fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap avx512ifma clflushopt clwb avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves avx_vnni avx512_bf16 arat avx512vbmi umip avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg avx512_vpopcntdq la57 rdpid cldemote movdiri movdir64b fsrm md_clear serialize tsxldtrk amx_bf16 avx512_fp16 amx_tile amx_int8 arch_capabilities
Hypervisor vendor:               KVM
Virtualization type:             full
L1d cache:                       4.9 MiB (104 instances)
L1i cache:                       3.3 MiB (104 instances)
L2 cache:                        208 MiB (104 instances)
L3 cache:                        210 MiB (2 instances)
NUMA node(s):                    2
NUMA node0 CPU(s):               0-51,104-155
NUMA node1 CPU(s):               52-103,156-207
Vulnerability Itlb multihit:     Not affected
Vulnerability L1tf:              Not affected
Vulnerability Mds:               Not affected
Vulnerability Meltdown:          Not affected
Vulnerability Mmio stale data:   Not affected
Vulnerability Retbleed:          Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1:        Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:        Mitigation; Enhanced IBRS, IBPB conditional, RSB filling, PBRSB-eIBRS SW sequence
Vulnerability Srbds:             Not affected
Vulnerability Tsx async abort:   Not affected

Versions of relevant libraries:
[pip3] numpy==1.26.4
[pip3] pyzmq==26.2.0
[pip3] torch==2.6.0.dev20241126+cpu
[pip3] torch-xla==2.6.0+git39e67b5
[pip3] torchvision==0.20.0.dev20241126+cpu
[pip3] transformers==4.47.0
[conda] numpy                     1.26.4                   pypi_0    pypi
[conda] pyzmq                     26.2.0                   pypi_0    pypi
[conda] torch                     2.6.0.dev20241126+cpu          pypi_0    pypi
[conda] torch-xla                 2.6.0+git39e67b5          pypi_0    pypi
[conda] torchvision               0.20.0.dev20241126+cpu          pypi_0    pypi
[conda] transformers              4.47.0                   pypi_0    pypi
ROCM Version: Could not collect
Neuron SDK Version: N/A
vLLM Version: 0.6.4.post2.dev327+g8fb26dac
vLLM Build Flags:
CUDA Archs: Not Set; ROCm: Disabled; Neuron: Disabled
GPU Topology:
Could not collect

LD_LIBRARY_PATH=/home/ext_hzchen_google_com/miniconda3/envs/tpu/lib/python3.10/site-packages/cv2/../../lib64:

Model Input Dumps
No response
🐛 Describe the bug
Abnormal output from both mistralai/Pixtral-Large-Instruct-2411 & mistralai/Pixtral-12B-2409 with multimodal input backed by vLLM+TPU(v5p-8) only. It works fine on vLLM+GPU(H100).
I installed vLLM on TPU following this official documentation
I also tried v0.6.4.post1, but get the same outcome.
I started the serving using,
vllm serve mistralai/Pixtral-Large-Instruct-2411 --config-format mistral --load-format mistral --tokenizer-mode mistral --max-model-len=8192 --limit_mm_per_prompt 'image=10' --tensor-parallel-size 4 --num-scheduler-steps 4 --swap-space 16 --disable-log-requests --dtype=bfloat16

Below script for reproduction was drafted according to the official example.
import requests
import json
from huggingface_hub import hf_hub_download
from datetime import datetime, timedelta

url = "http://localhost:8000/v1/chat/completions"
headers = {"Content-Type": "application/json", "Authorization": "Bearer token"}

model = "mistralai/Pixtral-Large-Instruct-2411"
# model = "mistralai/Pixtral-12B-2409"

model_name = model.split("/")[-1]
today = datetime.today().strftime("%Y-%m-%d")
yesterday = (datetime.today() - timedelta(days=1)).strftime("%Y-%m-%d")

SYSTEM_PROMPT = """You are {name}, a Large Language Model (LLM) created by Mistral AI, a French startup headquartered in Paris.
You power an AI assistant called Le Chat.
Your knowledge base was last updated on 2023-10-01.
The current date is {today}.

When you're not sure about some information, you say that you don't have the information and don't make up anything.
If the user's question is not clear, ambiguous, or does not provide enough context for you to accurately answer the question, you do not try to answer it right away and you rather ask the user to clarify their request (e.g. "What are some good restaurants around me?" => "Where are you?" or "When is the next flight to Tokyo" => "Where do you travel from?").
You are always very attentive to dates, in particular you try to resolve dates (e.g. "yesterday" is {yesterday}) and when asked about information at specific dates, you discard information that is at another date.
You follow these instructions in all languages, and always respond to the user in the language they use or request.
Next sections describe the capabilities that you have.

# WEB BROWSING INSTRUCTIONS

You cannot perform any web search or access internet to open URLs, links etc. If it seems like the user is expecting you to do so, you clarify the situation and ask the user to copy paste the text directly in the chat.

# MULTI-MODAL INSTRUCTIONS

You have the ability to read images, but you cannot generate images. You also cannot transcribe audio files or videos.
You cannot read nor transcribe audio files or videos and you cannot read images.
"""

system_prompt = SYSTEM_PROMPT.format(name=model_name, today=today, yesterday=yesterday)
print(system_prompt)

image_url = "https://huggingface.co/datasets/patrickvonplaten/random_img/resolve/main/europe.png"

messages = [
    {"role": "system", "content": system_prompt},
    {
        "role": "user",
        "content": [
            {
                "type": "text",
                "text": "Which of the depicted countries has the best food? Which the second and third and fourth? Name the country, its color on the map and one its city that is visible on the map, but is not the capital. Make absolutely sure to only name a city that can be seen on the map.",
            },
            {"type": "image_url", "image_url": {"url": image_url}},
        ],
    },
]

data = {"model": model, "messages": messages}

response = requests.post(url, headers=headers, data=json.dumps(data))

print(response.json())

print(response.json()["choices"][0]["message"]["content"])

I got output like
 You do not the You.
 I don't.
 The some.

 You to translate the search..
 The This question. Sorry.2 the the data with the given.
02. released.
 You to understand a response and then ask the the

 Since I don no. 20. 2,., a. You. I a any context of the word and the date.
 The You. Once } and a sentence to the images. You are working on a score.
 Sorry[TOOL_CALLS]Unfortunately, the I don the you. I don the information about an image.
 I don no information in 20 2 of the current
 You can use a the image.
 You are reading the human error., reviews.
 I don the date or February of2.

While the expected output is like,
Determining which country has the "best" food can be subjective and depends on personal preferences. However, based on popular culinary reputations, here are some countries known for their cuisine:

1. **Italy** (Brown) - Known for its pasta, pizza, and diverse regional dishes.
   - City: Milan

2. **France** (Dark Brown) - Renowned for its fine dining, pastries, and wine.
   - City: Lyon

3. **Spain** (Yellow) - Famous for tapas, paella, and a variety of seafood dishes.
   - City: Barcelona

4. **Greece** (Yellow) - Known for its Mediterranean cuisine, including moussaka, souvlaki, and fresh seafood.
   - City: Thessaloniki

These rankings are based on general culinary reputations and can vary widely depending on individual tastes.

Below was the running logs with export VLLM_LOGGING_LEVEL=DEBUG, since it is too long I removed some duplicated rows.
nohup: ignoring input
DEBUG 12-12 11:16:11 scripts.py:139] Setting VLLM_WORKER_MULTIPROC_METHOD to 'spawn'
INFO 12-12 11:16:11 api_server.py:625] vLLM API server version 0.6.4.post2.dev327+g8fb26dac
INFO 12-12 11:16:11 api_server.py:626] args: Namespace(subparser='serve', model_tag='mistralai/Pixtral-Large-Instruct-2411', config='', host=None, port=8000, uvicorn_log_level='info', allow_credentials=False, allowed_origins=['*'], allowed_methods=['*'], allowed_headers=['*'], api_key=None, lora_modules=None, prompt_adapters=None, chat_template=None, chat_template_content_format='auto', response_role='assistant', ssl_keyfile=None, ssl_certfile=None, ssl_ca_certs=None, ssl_cert_reqs=0, root_path=None, middleware=[], return_tokens_as_token_ids=False, disable_frontend_multiprocessing=False, enable_auto_tool_choice=False, tool_call_parser=None, tool_parser_plugin='', model='mistralai/Pixtral-Large-Instruct-2411', task='auto', tokenizer=None, skip_tokenizer_init=False, revision=None, code_revision=None, tokenizer_revision=None, tokenizer_mode='mistral', trust_remote_code=False, allowed_local_media_path=None, download_dir=None, load_format='mistral', config_format='mistral', dtype='bfloat16', kv_cache_dtype='auto', quantization_param_path=None, max_model_len=8192, guided_decoding_backend='xgrammar', distributed_executor_backend=None, worker_use_ray=False, pipeline_parallel_size=1, tensor_parallel_size=4, max_parallel_loading_workers=None, ray_workers_use_nsight=False, block_size=16, enable_prefix_caching=None, disable_sliding_window=False, use_v2_block_manager=True, num_lookahead_slots=0, seed=0, swap_space=16.0, cpu_offload_gb=0, gpu_memory_utilization=0.9, num_gpu_blocks_override=None, max_num_batched_tokens=None, max_num_seqs=None, max_logprobs=20, disable_log_stats=False, quantization=None, rope_scaling=None, rope_theta=None, hf_overrides=None, enforce_eager=False, max_seq_len_to_capture=8192, disable_custom_all_reduce=False, tokenizer_pool_size=0, tokenizer_pool_type='ray', tokenizer_pool_extra_config=None, limit_mm_per_prompt={'image': 10}, mm_processor_kwargs=None, mm_cache_preprocessor=False, enable_lora=False, enable_lora_bias=False, max_loras=1, max_lora_rank=16, lora_extra_vocab_size=256, lora_dtype='auto', long_lora_scaling_factors=None, max_cpu_loras=None, fully_sharded_loras=False, enable_prompt_adapter=False, max_prompt_adapters=1, max_prompt_adapter_token=0, device='auto', num_scheduler_steps=4, multi_step_stream_outputs=True, scheduler_delay_factor=0.0, enable_chunked_prefill=None, speculative_model=None, speculative_model_quantization=None, num_speculative_tokens=None, speculative_disable_mqa_scorer=False, speculative_draft_tensor_parallel_size=None, speculative_max_model_len=None, speculative_disable_by_batch_size=None, ngram_prompt_lookup_max=None, ngram_prompt_lookup_min=None, spec_decoding_acceptance_method='rejection_sampler', typical_acceptance_sampler_posterior_threshold=None, typical_acceptance_sampler_posterior_alpha=None, disable_logprobs_during_spec_decoding=None, model_loader_extra_config=None, ignore_patterns=[], preemption_mode=None, served_model_name=None, qlora_adapter_name_or_path=None, otlp_traces_endpoint=None, collect_detailed_traces=None, disable_async_output_proc=False, scheduling_policy='fcfs', override_neuron_config=None, override_pooler_config=None, compilation_config=None, kv_transfer_config=None, worker_cls='auto', disable_log_requests=True, max_log_len=None, disable_fastapi_docs=False, enable_prompt_tokens_details=False, dispatch_function=<function serve at 0x7f68b5c49fc0>)
DEBUG 12-12 11:16:11 __init__.py:60] No plugins found.
DEBUG 12-12 11:16:11 api_server.py:178] Multiprocessing frontend to use ipc:///tmp/17716325-eed1-408e-81ac-e19f0f233e8c for IPC Path.
INFO 12-12 11:16:11 api_server.py:197] Started engine process with PID 310962
INFO 12-12 11:16:12 config.py:1933] Downcasting torch.float32 to torch.bfloat16.
DEBUG 12-12 11:16:14 __init__.py:60] No plugins found.
INFO 12-12 11:16:15 config.py:1933] Downcasting torch.float32 to torch.bfloat16.
INFO 12-12 11:16:17 config.py:446] This model supports multiple tasks: {'score', 'classify', 'reward', 'embed', 'generate'}. Defaulting to 'generate'.
INFO 12-12 11:16:20 config.py:446] This model supports multiple tasks: {'score', 'generate', 'classify', 'reward', 'embed'}. Defaulting to 'generate'.
2024-12-12 11:16:22,319	INFO worker.py:1812 -- Started a local Ray instance. View the dashboard at <IP_ADDRESS>:8265
INFO 12-12 11:16:23 llm_engine.py:250] Initializing an LLM engine (v0.6.4.post2.dev327+g8fb26dac) with config: VllmConfig(model_config=<vllm.config.ModelConfig object at 0x7efe77a7feb0>, cache_config=<vllm.config.CacheConfig object at 0x7efe77a7fc40>, parallel_config=ParallelConfig(pipeline_parallel_size=1, tensor_parallel_size=4, worker_use_ray=False, max_parallel_loading_workers=None, disable_custom_all_reduce=False, tokenizer_pool_config=None, ray_workers_use_nsight=False, placement_group=<ray.util.placement_group.PlacementGroup object at 0x7eff2807d840>, distributed_executor_backend='ray', worker_cls='vllm.worker.multi_step_tpu_worker.MultiStepTPUWorker', sd_worker_cls='auto', world_size=4, rank=0), scheduler_config=SchedulerConfig(runner_type='generate', max_num_batched_tokens=8192, max_num_seqs=256, max_model_len=8192, num_lookahead_slots=3, delay_factor=0.0, enable_chunked_prefill=False, is_multimodal_model=True, preemption_mode=None, num_scheduler_steps=4, multi_step_stream_outputs=True, send_delta_data=False, policy='fcfs', chunked_prefill_enabled=False), device_config=<vllm.config.DeviceConfig object at 0x7eff429d7940>, load_config=LoadConfig(load_format=<LoadFormat.MISTRAL: 'mistral'>, download_dir=None, model_loader_extra_config=None, ignore_patterns=['original/**/*']), lora_config=None, speculative_config=None, decoding_config=DecodingConfig(guided_decoding_backend='xgrammar'), observability_config=ObservabilityConfig(otlp_traces_endpoint=None, collect_model_forward_time=False, collect_model_execute_time=False), prompt_adapter_config=None, quant_config=None, compilation_config=CompilationConfig(level=2, debug_dump_path='', backend='openxla', custom_ops=[], splitting_ops=['vllm.unified_attention', 'vllm.unified_attention_with_output'], use_inductor=True, candidate_compile_sizes=[], inductor_compile_config={}, inductor_passes={}, use_cudagraph=False, cudagraph_num_of_warmups=0, cudagraph_capture_sizes=None, cudagraph_copy_inputs=False, pass_config=PassConfig(dump_graph_stages=[], dump_graph_dir=PosixPath('.'), enable_fusion=True, enable_reshape=True), compile_sizes=[], capture_sizes=[256, 248, 240, 232, 224, 216, 208, 200, 192, 184, 176, 168, 160, 152, 144, 136, 128, 120, 112, 104, 96, 88, 80, 72, 64, 56, 48, 40, 32, 24, 16, 8, 4, 2, 1], enabled_custom_ops=Counter(), disabled_custom_ops=Counter(), compilation_time=0.0, static_forward_context={}), kv_transfer_config=None, instance_id='23ba6'),use_cached_outputs=True,
DEBUG 12-12 11:16:28 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:16:36 ray_tpu_executor.py:105] workers: [Actor(RayWorkerWrapper, edd6b98e4842e39cef7be1b001000000), Actor(RayWorkerWrapper, 5eab7c7840089d8cb35d0f8501000000), Actor(RayWorkerWrapper, 63cd8c1259f8d9e4d868481a01000000)]
DEBUG 12-12 11:16:36 ray_tpu_executor.py:106] driver_dummy_worker: Actor(RayWorkerWrapper, 017ea3d4b1262911e5ebd26d01000000)
(RayWorkerWrapper pid=311752) WARNING:root:libtpu.so and TPU device found. Setting PJRT_DEVICE=TPU.
WARNING:root:libtpu.so and TPU device found. Setting PJRT_DEVICE=TPU.
(RayWorkerWrapper pid=311752) DEBUG 12-12 11:16:36 __init__.py:60] No plugins found.
INFO 12-12 11:16:38 tpu.py:27] Cannot use _Backend.FLASH_ATTN backend on TPU.
INFO 12-12 11:16:38 selector.py:163] Using Pallas backend.
WARNING 12-12 11:16:38 tpu_model_runner.py:126] The max_model_len (8192) is too large. This may degrade the performance due to the insufficient smem size. Consider setting --max-model-len to a smaller value.
DEBUG 12-12 11:16:38 parallel_state.py:958] world_size=4 rank=0 local_rank=0 distributed_init_method=tcp://<IP_ADDRESS>:45807 backend=gloo
DEBUG 12-12 11:16:38 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:16:38 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:16:48 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:16:48 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:16:48 client.py:186] Waiting for output from MQLLMEngine.
(RayWorkerWrapper pid=311752) INFO 12-12 11:16:38 tpu.py:27] Cannot use _Backend.FLASH_ATTN backend on TPU.
(RayWorkerWrapper pid=311752) INFO 12-12 11:16:38 selector.py:163] Using Pallas backend.
(RayWorkerWrapper pid=311752) WARNING 12-12 11:16:38 tpu_model_runner.py:126] The max_model_len (8192) is too large. This may degrade the performance due to the insufficient smem size. Consider setting --max-model-len to a smaller value.
(RayWorkerWrapper pid=311752) DEBUG 12-12 11:16:38 parallel_state.py:958] world_size=4 rank=1 local_rank=1 distributed_init_method=tcp://<IP_ADDRESS>:45807 backend=gloo
DEBUG 12-12 11:16:50 shm_broadcast.py:214] Binding to tcp://<IP_ADDRESS>:40611
INFO 12-12 11:16:50 shm_broadcast.py:254] vLLM message queue communication handle: Handle(connect_ip='<IP_ADDRESS>', local_reader_ranks=[1, 2, 3], buffer_handle=(3, 4194304, 6, 'psm_66a94cb2'), local_subscribe_port=40611, remote_subscribe_port=None)
(RayWorkerWrapper pid=311752) DEBUG 12-12 11:16:50 shm_broadcast.py:278] Connecting to tcp://<IP_ADDRESS>:40611
(RayWorkerWrapper pid=311759) DEBUG 12-12 11:16:36 __init__.py:60] No plugins found. [repeated 2x across cluster] (Ray deduplicates logs by default. Set RAY_DEDUP_LOGS=0 to disable log deduplication, or see https://docs.ray.io/en/master/ray-observability/user-guides/configure-logging.html#log-deduplication for more options.)
(RayWorkerWrapper pid=311759) INFO 12-12 11:16:38 tpu.py:27] Cannot use _Backend.FLASH_ATTN backend on TPU. [repeated 2x across cluster]
(RayWorkerWrapper pid=311759) INFO 12-12 11:16:38 selector.py:163] Using Pallas backend. [repeated 2x across cluster]
(RayWorkerWrapper pid=311759) WARNING 12-12 11:16:38 tpu_model_runner.py:126] The max_model_len (8192) is too large. This may degrade the performance due to the insufficient smem size. Consider setting --max-model-len to a smaller value. [repeated 2x across cluster]
(RayWorkerWrapper pid=311759) DEBUG 12-12 11:16:38 parallel_state.py:958] world_size=4 rank=3 local_rank=3 distributed_init_method=tcp://<IP_ADDRESS>:45807 backend=gloo [repeated 2x across cluster]
DEBUG 12-12 11:16:50 decorators.py:105] Inferred dynamic dimensions for forward method of <class 'vllm.model_executor.models.llama.LlamaModel'>: ['input_ids', 'positions', 'intermediate_tensors', 'inputs_embeds']
(RayWorkerWrapper pid=311752) DEBUG 12-12 11:16:50 decorators.py:105] Inferred dynamic dimensions for forward method of <class 'vllm.model_executor.models.llama.LlamaModel'>: ['input_ids', 'positions', 'intermediate_tensors', 'inputs_embeds']
(RayWorkerWrapper pid=311752) DEBUG 12-12 11:16:51 config.py:2720] enabled custom ops: Counter({'rms_norm': 177, 'silu_and_mul': 88, 'rotary_embedding': 1})
(RayWorkerWrapper pid=311752) DEBUG 12-12 11:16:51 config.py:2722] disabled custom ops: Counter()
DEBUG 12-12 11:16:51 config.py:2720] enabled custom ops: Counter({'rms_norm': 177, 'silu_and_mul': 88, 'rotary_embedding': 1})
DEBUG 12-12 11:16:51 config.py:2722] disabled custom ops: Counter()
DEBUG 12-12 11:16:51 config.py:2720] enabled custom ops: Counter({'rms_norm': 258, 'silu_and_mul': 88, 'rotary_embedding': 1})
DEBUG 12-12 11:16:51 config.py:2722] disabled custom ops: Counter()
(RayWorkerWrapper pid=311752) INFO 12-12 11:16:52 weight_utils.py:243] Using model weights format ['consolidated*.safetensors', '*.pt']
INFO 12-12 11:16:52 weight_utils.py:243] Using model weights format ['consolidated*.safetensors', '*.pt']
Loading safetensors checkpoint shards:   0% Completed | 0/52 [00:00<?, ?it/s]
Loading safetensors checkpoint shards:   2% Completed | 1/52 [00:01<00:53,  1.05s/it]
Loading safetensors checkpoint shards:   4% Completed | 2/52 [00:01<00:30,  1.64it/s]
Loading safetensors checkpoint shards:   6% Completed | 3/52 [00:01<00:23,  2.13it/s]
Loading safetensors checkpoint shards:   8% Completed | 4/52 [00:01<00:15,  3.04it/s]
Loading safetensors checkpoint shards:  10% Completed | 5/52 [00:02<00:14,  3.16it/s]
Loading safetensors checkpoint shards:  12% Completed | 6/52 [00:02<00:14,  3.18it/s]
Loading safetensors checkpoint shards:  13% Completed | 7/52 [00:02<00:13,  3.28it/s]
Loading safetensors checkpoint shards:  15% Completed | 8/52 [00:02<00:13,  3.32it/s]
Loading safetensors checkpoint shards:  17% Completed | 9/52 [00:03<00:12,  3.39it/s]
Loading safetensors checkpoint shards:  19% Completed | 10/52 [00:03<00:12,  3.48it/s]
Loading safetensors checkpoint shards:  21% Completed | 11/52 [00:03<00:11,  3.51it/s]
Loading safetensors checkpoint shards:  23% Completed | 12/52 [00:04<00:11,  3.57it/s]
Loading safetensors checkpoint shards:  25% Completed | 13/52 [00:04<00:11,  3.52it/s]
Loading safetensors checkpoint shards:  27% Completed | 14/52 [00:04<00:10,  3.55it/s]
Loading safetensors checkpoint shards:  29% Completed | 15/52 [00:04<00:10,  3.62it/s]
Loading safetensors checkpoint shards:  31% Completed | 16/52 [00:05<00:10,  3.58it/s]
DEBUG 12-12 11:16:58 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:16:58 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:16:58 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:16:58 client.py:186] Waiting for output from MQLLMEngine.
Loading safetensors checkpoint shards:  33% Completed | 17/52 [00:05<00:09,  3.63it/s]
DEBUG 12-12 11:16:58 utils.py:156] Loaded weight lm_head.weight with shape torch.Size([8192, 12288])
Loading safetensors checkpoint shards:  35% Completed | 18/52 [00:05<00:09,  3.40it/s]
Loading safetensors checkpoint shards:  37% Completed | 19/52 [00:06<00:09,  3.47it/s]
Loading safetensors checkpoint shards:  38% Completed | 20/52 [00:06<00:08,  3.58it/s]
Loading safetensors checkpoint shards:  40% Completed | 21/52 [00:06<00:08,  3.61it/s]
Loading safetensors checkpoint shards:  42% Completed | 22/52 [00:06<00:08,  3.65it/s]
Loading safetensors checkpoint shards:  44% Completed | 23/52 [00:07<00:07,  3.67it/s]
Loading safetensors checkpoint shards:  46% Completed | 24/52 [00:07<00:07,  3.72it/s]
Loading safetensors checkpoint shards:  48% Completed | 25/52 [00:07<00:07,  3.75it/s]
Loading safetensors checkpoint shards:  50% Completed | 26/52 [00:07<00:06,  3.79it/s]
Loading safetensors checkpoint shards:  52% Completed | 27/52 [00:08<00:06,  3.79it/s]
Loading safetensors checkpoint shards:  54% Completed | 28/52 [00:08<00:06,  3.76it/s]
Loading safetensors checkpoint shards:  56% Completed | 29/52 [00:08<00:06,  3.80it/s]
Loading safetensors checkpoint shards:  58% Completed | 30/52 [00:08<00:05,  3.71it/s]
Loading safetensors checkpoint shards:  60% Completed | 31/52 [00:09<00:05,  3.76it/s]
Loading safetensors checkpoint shards:  62% Completed | 32/52 [00:09<00:05,  3.73it/s]
Loading safetensors checkpoint shards:  63% Completed | 33/52 [00:09<00:05,  3.76it/s]
Loading safetensors checkpoint shards:  65% Completed | 34/52 [00:10<00:04,  3.73it/s]
Loading safetensors checkpoint shards:  67% Completed | 35/52 [00:13<00:20,  1.23s/it]
Loading safetensors checkpoint shards:  69% Completed | 36/52 [00:13<00:15,  1.04it/s]
Loading safetensors checkpoint shards:  71% Completed | 37/52 [00:14<00:11,  1.28it/s]
Loading safetensors checkpoint shards:  73% Completed | 38/52 [00:14<00:09,  1.54it/s]
Loading safetensors checkpoint shards:  75% Completed | 39/52 [00:14<00:07,  1.79it/s]
Loading safetensors checkpoint shards:  77% Completed | 40/52 [00:15<00:05,  2.03it/s]
DEBUG 12-12 11:17:08 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:17:08 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:17:08 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:17:08 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:17:08 client.py:186] Waiting for output from MQLLMEngine.
Loading safetensors checkpoint shards:  79% Completed | 41/52 [00:15<00:04,  2.23it/s]
Loading safetensors checkpoint shards:  81% Completed | 42/52 [00:15<00:03,  2.55it/s]
Loading safetensors checkpoint shards:  83% Completed | 43/52 [00:16<00:03,  2.60it/s]
Loading safetensors checkpoint shards:  85% Completed | 44/52 [00:16<00:03,  2.66it/s]
Loading safetensors checkpoint shards:  87% Completed | 45/52 [00:16<00:02,  2.85it/s]
Loading safetensors checkpoint shards:  88% Completed | 46/52 [00:17<00:02,  2.85it/s]
Loading safetensors checkpoint shards:  90% Completed | 47/52 [00:17<00:01,  2.83it/s]
Loading safetensors checkpoint shards:  92% Completed | 48/52 [00:17<00:01,  2.92it/s]
Loading safetensors checkpoint shards:  94% Completed | 49/52 [00:18<00:00,  3.11it/s]
Loading safetensors checkpoint shards:  96% Completed | 50/52 [00:18<00:00,  3.26it/s]
Loading safetensors checkpoint shards:  98% Completed | 51/52 [00:18<00:00,  3.32it/s]
Loading safetensors checkpoint shards: 100% Completed | 52/52 [00:18<00:00,  3.49it/s]
Loading safetensors checkpoint shards: 100% Completed | 52/52 [00:18<00:00,  2.74it/s]

DEBUG 12-12 11:17:18 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:19:08 client.py:186] Waiting for output from MQLLMEngine.
(RayWorkerWrapper pid=311759) DEBUG 12-12 11:17:05 utils.py:156] Loaded weight lm_head.weight with shape torch.Size([8192, 12288])
(RayWorkerWrapper pid=311759) DEBUG 12-12 11:16:50 shm_broadcast.py:278] Connecting to tcp://<IP_ADDRESS>:40611 [repeated 2x across cluster]
(RayWorkerWrapper pid=311759) DEBUG 12-12 11:16:50 decorators.py:105] Inferred dynamic dimensions for forward method of <class 'vllm.model_executor.models.llama.LlamaModel'>: ['input_ids', 'positions', 'intermediate_tensors', 'inputs_embeds'] [repeated 2x across cluster]
(RayWorkerWrapper pid=311759) DEBUG 12-12 11:16:51 config.py:2720] enabled custom ops: Counter({'rms_norm': 258, 'silu_and_mul': 88, 'rotary_embedding': 1}) [repeated 5x across cluster]
(RayWorkerWrapper pid=311759) DEBUG 12-12 11:16:51 config.py:2722] disabled custom ops: Counter() [repeated 5x across cluster]
(RayWorkerWrapper pid=311759) INFO 12-12 11:16:52 weight_utils.py:243] Using model weights format ['consolidated*.safetensors', '*.pt'] [repeated 2x across cluster]
INFO 12-12 11:19:09 ray_tpu_executor.py:270] # TPU blocks: 18736, # CPU blocks: 11912
INFO 12-12 11:19:10 tpu_model_runner.py:274] Compiling the model with different input shapes...
DEBUG 12-12 11:19:18 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:20:58 client.py:186] Waiting for output from MQLLMEngine.
(RayWorkerWrapper pid=311759) INFO 12-12 11:19:16 tpu_model_runner.py:274] Compiling the model with different input shapes...
(RayWorkerWrapper pid=311770) DEBUG 12-12 11:17:07 utils.py:156] Loaded weight lm_head.weight with shape torch.Size([8192, 12288]) [repeated 2x across cluster]
INFO 12-12 11:21:06 tpu_model_runner.py:284] batch_size: 1, seq_len: 16
(RayWorkerWrapper pid=311752) INFO 12-12 11:21:06 tpu_model_runner.py:284] batch_size: 1, seq_len: 16
(RayWorkerWrapper pid=311752) INFO 12-12 11:19:16 tpu_model_runner.py:274] Compiling the model with different input shapes... [repeated 2x across cluster]
INFO 12-12 11:21:07 tpu_model_runner.py:284] batch_size: 1, seq_len: 32

DEBUG 12-12 11:21:08 client.py:186] Waiting for output from MQLLMEngine.
INFO 12-12 11:21:09 tpu_model_runner.py:284] batch_size: 1, seq_len: 64
INFO 12-12 11:21:11 tpu_model_runner.py:284] batch_size: 1, seq_len: 128
(RayWorkerWrapper pid=311752) INFO 12-12 11:21:11 tpu_model_runner.py:284] batch_size: 1, seq_len: 128 [repeated 9x across cluster]
INFO 12-12 11:21:13 tpu_model_runner.py:284] batch_size: 1, seq_len: 256
INFO 12-12 11:21:15 tpu_model_runner.py:284] batch_size: 1, seq_len: 512
INFO 12-12 11:21:17 tpu_model_runner.py:284] batch_size: 1, seq_len: 1024
DEBUG 12-12 11:21:18 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:21:18 client.py:186] Waiting for output from MQLLMEngine.
(RayWorkerWrapper pid=311752) INFO 12-12 11:21:17 tpu_model_runner.py:284] batch_size: 1, seq_len: 1024 [repeated 9x across cluster]
INFO 12-12 11:21:20 tpu_model_runner.py:284] batch_size: 1, seq_len: 2048
INFO 12-12 11:21:23 tpu_model_runner.py:284] batch_size: 1, seq_len: 4096
(RayWorkerWrapper pid=311752) INFO 12-12 11:21:23 tpu_model_runner.py:284] batch_size: 1, seq_len: 4096 [repeated 6x across cluster]
INFO 12-12 11:21:27 tpu_model_runner.py:284] batch_size: 1, seq_len: 8192
INFO 12-12 11:21:27 tpu_model_runner.py:291] Compilation for prefill done in 137.57 s.
DEBUG 12-12 11:21:28 client.py:186] Waiting for output from MQLLMEngine.

DEBUG 12-12 11:23:18 client.py:186] Waiting for output from MQLLMEngine.
INFO 12-12 11:23:20 tpu_model_runner.py:327] batch_size: 32, seq_len: 1
INFO 12-12 11:23:22 tpu_model_runner.py:327] batch_size: 48, seq_len: 1
(RayWorkerWrapper pid=311752) INFO 12-12 11:23:22 tpu_model_runner.py:327] batch_size: 48, seq_len: 1 [repeated 9x across cluster]
INFO 12-12 11:23:24 tpu_model_runner.py:327] batch_size: 64, seq_len: 1
INFO 12-12 11:23:27 tpu_model_runner.py:327] batch_size: 80, seq_len: 1
DEBUG 12-12 11:23:28 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:23:28 client.py:186] Waiting for output from MQLLMEngine.
INFO 12-12 11:23:29 tpu_model_runner.py:327] batch_size: 96, seq_len: 1
(RayWorkerWrapper pid=311752) INFO 12-12 11:23:29 tpu_model_runner.py:327] batch_size: 96, seq_len: 1 [repeated 9x across cluster]
INFO 12-12 11:23:32 tpu_model_runner.py:327] batch_size: 112, seq_len: 1
INFO 12-12 11:23:34 tpu_model_runner.py:327] batch_size: 128, seq_len: 1
INFO 12-12 11:23:36 tpu_model_runner.py:327] batch_size: 144, seq_len: 1
DEBUG 12-12 11:23:38 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:23:38 client.py:186] Waiting for output from MQLLMEngine.
(RayWorkerWrapper pid=311752) INFO 12-12 11:23:36 tpu_model_runner.py:327] batch_size: 144, seq_len: 1 [repeated 9x across cluster]
INFO 12-12 11:23:39 tpu_model_runner.py:327] batch_size: 160, seq_len: 1
INFO 12-12 11:23:41 tpu_model_runner.py:327] batch_size: 176, seq_len: 1
INFO 12-12 11:23:44 tpu_model_runner.py:327] batch_size: 192, seq_len: 1
(RayWorkerWrapper pid=311752) INFO 12-12 11:23:44 tpu_model_runner.py:327] batch_size: 192, seq_len: 1 [repeated 9x across cluster]
INFO 12-12 11:23:46 tpu_model_runner.py:327] batch_size: 208, seq_len: 1
DEBUG 12-12 11:23:48 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:23:48 client.py:186] Waiting for output from MQLLMEngine.
INFO 12-12 11:23:49 tpu_model_runner.py:327] batch_size: 224, seq_len: 1
(RayWorkerWrapper pid=311752) INFO 12-12 11:23:49 tpu_model_runner.py:327] batch_size: 224, seq_len: 1 [repeated 6x across cluster]
INFO 12-12 11:23:51 tpu_model_runner.py:327] batch_size: 240, seq_len: 1
INFO 12-12 11:23:54 tpu_model_runner.py:327] batch_size: 256, seq_len: 1
INFO 12-12 11:23:54 tpu_model_runner.py:334] Compilation for decode done in 146.35 s.
INFO 12-12 11:23:54 llm_engine.py:447] init engine (profile, create kv cache, warmup model) took 384.57 seconds
(RayWorkerWrapper pid=311752) INFO 12-12 11:23:54 tpu_model_runner.py:334] Compilation for decode done in 146.35 s.
DEBUG 12-12 11:23:54 engine.py:130] Starting Startup Loop.
DEBUG 12-12 11:23:54 engine.py:132] Starting Engine Loop.

INFO:     Application startup complete.
INFO:     Uvicorn running on http://<IP_ADDRESS>:8000 (Press CTRL+C to quit)
DEBUG 12-12 11:23:58 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:23:58 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:24:04 client.py:165] Heartbeat successful.
DEBUG 12-12 11:24:04 metrics.py:467] Avg prompt throughput: 0.0 tokens/s, Avg generation throughput: 0.0 tokens/s, Running: 0 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 0.0%, CPU KV cache usage: 0.0%.
DEBUG 12-12 11:24:04 engine.py:190] Waiting for new requests in engine loop.
DEBUG 12-12 11:24:08 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:24:08 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:24:14 client.py:165] Heartbeat successful.
DEBUG 12-12 11:24:14 client.py:165] Heartbeat successful.
...
DEBUG 12-12 11:29:14 metrics.py:467] Avg prompt throughput: 0.0 tokens/s, Avg generation throughput: 0.0 tokens/s, Running: 0 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 0.0%, CPU KV cache usage: 0.0%.
DEBUG 12-12 11:29:14 engine.py:190] Waiting for new requests in engine loop.
DEBUG 12-12 11:29:18 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:29:18 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:29:24 client.py:165] Heartbeat successful.
DEBUG 12-12 11:29:24 client.py:165] Heartbeat successful.
DEBUG 12-12 11:29:24 metrics.py:467] Avg prompt throughput: 0.0 tokens/s, Avg generation throughput: 0.0 tokens/s, Running: 0 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 0.0%, CPU KV cache usage: 0.0%.
DEBUG 12-12 11:29:24 engine.py:190] Waiting for new requests in engine loop.
DEBUG 12-12 11:29:28 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:29:28 client.py:186] Waiting for output from MQLLMEngine.
DEBUG 12-12 11:29:34 client.py:165] Heartbeat successful.
DEBUG 12-12 11:29:34 client.py:165] Heartbeat successful.
DEBUG 12-12 11:29:34 metrics.py:467] Avg prompt throughput: 0.0 tokens/s, Avg generation throughput: 0.0 tokens/s, Running: 0 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 0.0%, CPU KV cache usage: 0.0%.
DEBUG 12-12 11:29:34 engine.py:190] Waiting for new requests in engine loop.
...
DEBUG 12-12 11:31:48 client.py:186] Waiting for output from MQLLMEngine.
INFO 12-12 11:31:51 chat_utils.py:331] Detected the chat template content format to be 'string'. You can set `--chat-template-content-format` to override this.
WARNING 12-12 11:31:51 chat_utils.py:961] 'add_generation_prompt' is not supported for mistral tokenizer, so it will be ignored.
WARNING 12-12 11:31:51 chat_utils.py:965] 'continue_final_message' is not supported for mistral tokenizer, so it will be ignored.
INFO 12-12 11:31:52 preprocess.py:215] Your model uses the legacy input pipeline instead of the new multi-modal processor. Please note that the legacy pipeline will be removed in a future release. For more details, see: https://github.com/vllm-project/vllm/issues/10114
DEBUG 12-12 11:31:54 client.py:165] Heartbeat successful.
INFO 12-12 11:31:55 metrics.py:467] Avg prompt throughput: 403.1 tokens/s, Avg generation throughput: 0.1 tokens/s, Running: 1 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 1.4%, CPU KV cache usage: 0.0%.

INFO 12-12 11:32:00 metrics.py:467] Avg prompt throughput: 0.0 tokens/s, Avg generation throughput: 30.2 tokens/s, Running: 1 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 1.5%, CPU KV cache usage: 0.0%.

DEBUG 12-12 11:32:01 client.py:186] Waiting for output from MQLLMEngine.
INFO:     <IP_ADDRESS>:39378 - "POST /v1/chat/completions HTTP/1.1" 200 OK
DEBUG 12-12 11:32:01 llm_engine.py:1477] Stopping remote worker execution loop.
DEBUG 12-12 11:32:04 client.py:165] Heartbeat successful.
DEBUG 12-12 11:32:11 client.py:186] Waiting for output from MQLLMEngine.

DEBUG 12-12 11:32:11 client.py:165] Heartbeat successful.
INFO 12-12 11:32:11 metrics.py:467] Avg prompt throughput: 0.0 tokens/s, Avg generation throughput: 1.5 tokens/s, Running: 0 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 0.0%, CPU KV cache usage: 0.0%.
DEBUG 12-12 11:32:11 engine.py:190] Waiting for new requests in engine loop.
DEBUG 12-12 11:32:21 client.py:186] Waiting for output from MQLLMEngine.

DEBUG 12-12 11:32:21 client.py:165] Heartbeat successful.
INFO 12-12 11:32:21 metrics.py:467] Avg prompt throughput: 0.0 tokens/s, Avg generation throughput: 0.0 tokens/s, Running: 0 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 0.0%, CPU KV cache usage: 0.0%.
DEBUG 12-12 11:32:21 engine.py:190] Waiting for new requests in engine loop.
DEBUG 12-12 11:32:22 launcher.py:54] port 8000 is used by process psutil.Process(pid=310890, name='vllm', status='running', started='11:16:07') launched with command:
DEBUG 12-12 11:32:22 launcher.py:54] /home/ext_hzchen_google_com/miniconda3/envs/tpu/bin/python /home/ext_hzchen_google_com/miniconda3/envs/tpu/bin/vllm serve mistralai/Pixtral-Large-Instruct-2411 --config-format mistral --load-format mistral --tokenizer-mode mistral --max-model-len=8192 --limit_mm_per_prompt image=10 --tensor-parallel-size 4 --num-scheduler-steps 4 --swap-space 16 --disable-log-requests --dtype=bfloat16
INFO 12-12 11:32:22 launcher.py:57] Shutting down FastAPI HTTP server.
DEBUG 12-12 11:32:22 engine.py:137] Shutting down MQLLMEngine.
DEBUG 12-12 11:32:22 engine.py:139] MQLLMEngine is shut down.
(RayWorkerWrapper pid=311759) WARNING:root:libtpu.so and TPU device found. Setting PJRT_DEVICE=TPU. [repeated 2x across cluster]
INFO:     Shutting down
DEBUG 12-12 11:32:26 client.py:252] Shutting down MQLLMEngineClient output handler.
DEBUG 12-12 11:32:26 client.py:252] Shutting down MQLLMEngineClient output handler.
DEBUG 12-12 11:32:26 client.py:168] Shutting down MQLLMEngineClient check health loop.
DEBUG 12-12 11:32:26 client.py:252] Shutting down MQLLMEngineClient output handler.
DEBUG 12-12 11:32:26 client.py:252] Shutting down MQLLMEngineClient output handler.

INFO:     Waiting for application shutdown.
INFO:     Application shutdown complete.
/home/ext_hzchen_google_com/miniconda3/envs/tpu/lib/python3.10/multiprocessing/resource_tracker.py:224: UserWarning: resource_tracker: There appear to be 1 leaked shared_memory objects to clean up at shutdown
  warnings.warn('resource_tracker: There appear to be %d '

Moreover, if you only input text, the output looks normal. The problem is only found when image input was given.
Another symptom is that, if I set --max-model-len<=4096, I will get error like,
max_tokens must be at least 1, got -186.

which may point to the same root cause.
Before submitting a new issue...

[X] Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

Hi @totorochina i don't think TPU supports multimodal yet, but it's on the roadmap for next month or 2 @robertgshaw2-neuralmagic @WoosukKwon @lsy323 we will update this bug when it's ready :)


fix: consume off chain cell bug

In general, the current version cannot use offchain cell mainly because of the following three problems:

never use offchain cell, https://github.com/nervosnetwork/ckb-sdk-go/pull/196/files#diff-e07325bb986f42ea3feed3f589464564fb219542b7e6af8192633754f7bb6c80L46 because current will be overwritten by live cell.
nil pointer error, https://github.com/nervosnetwork/ckb-sdk-go/pull/196/files#diff-e07325bb986f42ea3feed3f589464564fb219542b7e6af8192633754f7bb6c80L63 because the initial value of next is nil.
script is a variable of pointer type and cannot be compared with != https://github.com/nervosnetwork/ckb-sdk-go/pull/196/files#diff-e07325bb986f42ea3feed3f589464564fb219542b7e6af8192633754f7bb6c80L110

could you add the bug description to the pr?

could you add the bug description to the pr?

updated

similar to #193
Approved


Cloning and date of tagging

seems the script is not differentiating date of the commit (first) being tagged, from the date the tag was done (second)
team | submitted_at | commit | tag | tagged_at
3427684 | 26/7/2020 18:23:44 | 2413c6288fe3eb74eaad902588a08704b754ef44 | submission | 26/7/2020 18:23:44
This comes from this repo whose tag was changed later than 26/7:
https://github.com/RMIT-COSC1127-1125-AI/p0-warmup-sunilXY

mm it is strange as I do have example where the tagging and commit have different dates, which suggest the script is doing the right thing:
team | submitted_at | commit | tag | tagged_at
3828894 | 9/8/2020 10:58:16 | fe65c9b06343e88d27aaf513b84456f3e2e3f0ba | submission | 9/8/2020 10:59:32

However if one goes to repos, GitHub will show tag and commit the same most cases. How could that be as one will take at least a few seconds between commit and tagging that commit. Strange...

This is in fact not a bug and is all good. What happens is that there is no date tagging for lightweights tags, so the tagged date is assumed to be the same as the commit:
    tag_commit_date = datetime.datetime.fromtimestamp(tag_commit.committed_date, tz=TIMEZONE)
    try:
        tagged_date = datetime.datetime.fromtimestamp(tag.object.tagged_date, tz=TIMEZONE)  # if it is an annotated tag
    except:
        tagged_date = tag_commit_date  # if it is a lightweight tag (no date stored)


Implement sample data from factor analysis model.

This allows generating high dimensional example data which
comes from a lower dimensional subspace. Originally I intended
to implement factor analysis, but I think this new example data is
useful on its own.

Thanks for this! Will be cool to have. I just made some suggestions about the naming conventions, and about the docstrings, otherwise looks good!


[Question] Certificates renew and restart of services

Hi,
I was wondering, if it was necessary  / mandatory to restart the postfix and dovecot (or in this case, our mail container) services after renewing the certificates.
If I am not mistaken, renewing a cert with nginx requires a service restart (and not just a reload). I am wondering if it is also the case with the mail stack.
Thanks in advance.

Hi @Nesousx, yes restart is necessary.

Apparently postfix just needs to be reloaded while dovecot has to be restarted:
https://www.shivering-isles.com/lets-encrypt-free-trusted-certificates-for-postfix-and-dovecot/#reloadyourcertificatesafterrenew


Use new classification color scheme

Codecov Report

Merging #357 (6061512) into master (2b6b7e2) will decrease coverage by 0.02%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master     #357      +/-   ##
==========================================
- Coverage   67.24%   67.22%   -0.03%
==========================================
  Files         120      120
  Lines       10583    10583
==========================================
- Hits         7117     7114       -3
- Misses       3466     3469       +3

Impacted Files
Coverage Δ

assemblyline/common/classification.py
81.46% <100.00%> (ø)

assemblyline/odm/randomizer.py
94.29% <0.00%> (-0.88%)
:arrow_down:

assemblyline/datastore/helper.py
32.17% <0.00%> (-0.15%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 2b6b7e2...6061512. Read the comment docs.


[Text Analytics] Minor refactorings and fix tags

Makes some refactorings that have been on mind for some time to make processing of service responses more uniform using generic utilities. Furthermore, it removes the TextAnalyticsResult type that was not used anywhere other than in tests. It also fixes https://github.com/Azure/azure-sdk-for-js/issues/13438 by removeing all uses of @hidden.

/azp run js - ai-text-analytics - tests


Flush onscreen texture to offscreen texture on context switches

not valid since is the content of the current texture has been presented already


Add Sort::Adt to fhir and defer index-flattening to conv

This PR is a real mess. There's probably / hopefully some way to clean up the abstractions but right now its a bit gross to support the cases where:

Adt with a single index used without fields (e.g. RVec refined by len:int)
Adt with multiple-indices used as packed Pair[@p] or flattened Pair[x, y]

Anyways, lmk your thoughts @nilehmann!

superseded by #296


AP-4373: Add internally routed LFA url

What
Link to story
We have seen a number of slow calls to LFA from Apply, this caused slow page transitions and possibly errors for providers while also polluting the logs and alerts channels for devs
This PR adds a JS host variable that allows https, externally routed, calls to LFA for the Javascript search
The CSP did not need updating as it still uses the https, service.gov.uk, url as the CSP prohibits calling the internal routing http url from a secure, https, page
Checklist
Before you ask people to review this PR:

Tests and rubocop should be passing: bundle exec rake
Github should not be reporting conflicts; you should have recently run git rebase main.
There should be no unnecessary whitespace changes. These make diffs harder to read and conflicts more likely.
The PR description should say what you changed and why, with a link to the JIRA story.
You should have looked at the diff against main and ensured that nothing unexpected is included in your changes.
You should have checked that the commit messages say why the change was made.

Updated with correction, thanks for the comprehensive check @jsugarman ⭐


Change harvester approach to update instead of delete and reinsert

The lontra harvester currently deletes occurrence data and inserts upon re-indexing. Support update operations instead, to allow auto_id maintenance.

Issue solved, as SiBBr will revert its behavior to be the same as Canadensys.

We won't update records for now but we will keep the id between harvest when possible.
See Issue #14


CASMINST-7035 remove docs for manual CSM upgrade in 1.6

Description
In CSM 1.6, the manual CSM upgrade path was not tested. CSM has been exclusively upgraded with IUF. Because of this, we are removing the manual CSM upgrade.

Checklist

[x] If I added any command snippets, the steps they belong to follow the prompt conventions (see example).
[x] If I added a new directory, I also updated .github/CODEOWNERS with the corresponding team in Cray-HPE.
[x] My commits or Pull-Request Title contain my JIRA information, or I do not have a JIRA.

This pages can be deleted as they were only part of Upgrade Only CSM without IUF procedure(**Deleted) and not referenced in any other file.
https://github.com/Cray-HPE/docs-csm/blame/release/1.6/upgrade/Upgrade_Only_CSM_without_iuf.md#L18
(https://github.com/Cray-HPE/docs-csm/blob/f8706e5dec7b7b745200c5c79334a88c1e046e3c/troubleshooting/README.md?plain=1#L54)
(https://github.com/Cray-HPE/docs-csm/blob/release/1.6/troubleshooting/known_issues/ims_image_creation_failure.md)
https://github.com/Cray-HPE/docs-csm/blob/f8706e5dec7b7b745200c5c79334a88c1e046e3c/upgrade/Upgrade_Only_CSM_without_iuf.md?plain=1#L21
(https://github.com/Cray-HPE/docs-csm/blob/f8706e5dec7b7b745200c5c79334a88c1e046e3c/troubleshooting/README.md?plain=1#L48)
(https://github.com/Cray-HPE/docs-csm/blob/release/1.6/troubleshooting/known_issues/ceph_osd_latency.md)

@Srinivas-Anand-HPE, I have removed the https://github.com/Cray-HPE/docs-csm/blame/release/1.6/upgrade/Upgrade_Only_CSM_without_iuf.md page from the documentation.
However, I have not removed https://github.com/Cray-HPE/docs-csm/blob/release/1.6/troubleshooting/known_issues/ims_image_creation_failure.md or https://github.com/Cray-HPE/docs-csm/blob/release/1.6/troubleshooting/known_issues/ceph_osd_latency.md since both of these are still important pages of documentation even if we do not have a manual CSM upgrade.


crypto: document which cipher.Block implementations are safe for concurrent use

Many of them are, but since it's undocumented it might change from one architecture to the next.
This came up in https://go-review.googlesource.com/c/crypto/+/118535 because x/crypto/xts effectively assumes they all are.

Hey @FiloSottile ! Are you OK if I help with this issue? Do you have any pointers?

@nodo Absolutely! It's a matter of going through the implementations (mainly AES and DES) and checking that they don't write to object state in Encrypt / Decrypt. You can also use the race detector to help, but some implementations are in assembly, so it will not work everywhere.

Hey @FiloSottile,
I was checking the packages, would it be enough to verify the files below?

https://github.com/golang/go/blob/master/src/crypto/aes/gcm_amd64.s
https://github.com/golang/go/blob/master/src/crypto/aes/block.go
https://github.com/golang/go/blob/master/src/crypto/des/block.go

There are a few other implementations for other platforms in those packages that you'll have to check. By the way, this is about cipher.Block, so you don't have to check the GCM mode, which is a cipher.AEAD implementation.

I think the same should apply to some of the other interfaces and implementations. For example, cipher.BlockMode, and specifically the CBCEncrypter/Decrypter types, have iv as a shared state, so it's not concurrent safe. This is equivalent to the XTS tweak situation.
I can open a separate issue for this if it makes more sense to do so.

In general nothing is concurrent safe until explicitly marked. cipher.Block
was confusing because they mostly (all) are and that assumption had made
its way into places. If you think it would be worth explicitly documenting
other implementations, feel free to open another issue, though.


feat(backend-common): added ports range

Signed-off-by: Antonio Musolino<EMAIL_ADDRESS>Hey, I just made a Pull Request!
Hello, I added the possibility to specify a port range in the backend.reading.allow in the form: .example.com:100-1000; I need it because, in my company, we have services deployed under different ports internally. WDYT?
:heavy_check_mark: Checklist

[x] A changeset describing the change and affected packages. (more info)
[ ] Added or updated documentation
[x] Tests for new functionality and regression tests for bug fixes
[ ] Screenshots attached (for UI changes)
[x] All your commits have a Signed-off-by line in the message. (more info)

I'm wondering if this is really necessary, or we just have a catch all for all ports. Want to probably get some more eyes on this from other @backstage/maintainers when they come back from holiday next week, so going to add some labels here so we don't forgot.

I made the changes, PTAL

Thanks for this! Sorry for the delay! :pray:


1470 - Shuffle the Array

Description of the Problem
Given the array nums consisting of 2n elements in the form [x1,x2,...,xn,y1,y2,...,yn].
Return the array in the form [x1,y1,x2,y2,...,xn,yn].
Example 1:
Input: nums = [2,5,1,3,4,7], n = 3
Output: [2,3,5,4,1,7]
Explanation: Since x1=2, x2=5, x3=1, y1=3, y2=4, y3=7 then the answer is [2,3,5,4,1,7].
Example 2:
Input: nums = [1,2,3,4,4,3,2,1], n = 4
Output: [1,4,2,3,3,2,4,1]
Example 3:
Input: nums = [1,1,2,2], n = 2
Output: [1,2,1,2]
Constraints:
1 <= n <= 500
nums.length == 2n
1 <= nums[i] <= 10^3
Code
class Solution:
    def shuffle(self, nums: List[int], n: int) -> List[int]:

Link To The LeetCode Problem
LeetCode

I would like to be assigned to this.

Can you please assign this to me.


Unable to use polygons

I'm am trying to run a hexagon in the form of a <polygon/> element through SVGO using SVGmin for Grunt.
This is the SVG I am using in the form of hexagon.svg
<?xml version="1.0" encoding="utf-8"?>
<!-- Generator: Adobe Illustrator 18.1.1, SVG Export Plug-In . SVG Version: 6.00 Build 0)  -->
<svg version="1.1" id="Layer_1" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" x="0px" y="0px"
     viewBox="0 0 100 100" enable-background="new 0 0 100 100" xml:space="preserve">
<polygon points="93,75 49.5,100 6,75 6,25 49.5,0 93,25 "/>
</svg>

This is the console output from the grunt task
grunt
Running "svgmin:dist" (svgmin) task
✔ dist/Untitled-5.svg (saved 288 B 71%)
Fatal error: Cannot read property 'value' of undefined

Removing the polygon produces a .length error
Fatal error: Cannot read property 'length' of undefined

This makes sense with no data to read.
Removing the file allows <path/>, <clipPath/>, <circle/> and  others to run as expected.

Sorry, but I cannot find what's wrong with svgo.

Do you mean that you can't duplicate, or you are unsure of what is causing the issue?

Yeah, it looks good to me, I have no errors, and this error looks odd to me. Does disabling convertShapeToPath plugin solves the issue?
svgo --disable=convertShapeToPath

May be you should check your node.js version.

Please, check out if the problem persists in v0.5.1.

I get the same error when using @betsydupuis' code, but it works when you add the width and height attributes like this:
<?xml version="1.0" encoding="utf-8"?>
<!-- Generator: Adobe Illustrator 18.1.1, SVG Export Plug-In . SVG Version: 6.00 Build 0)  -->
<svg version="1.1" id="Layer_1" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" x="0px" y="0px"
     viewBox="0 0 100 100" width="100" height="100" enable-background="new 0 0 100 100" xml:space="preserve">
<polygon points="93,75 49.5,100 6,75 6,25 49.5,0 93,25 "/>
</svg>

@TadWohlrapp, I see no errors with the latest SVGO version with or without widht/height.

@GreLI, you're right. I confused it with https://jakearchibald.github.io/svgomg/ where the error currently occurres. Sorry for the mixup, I might have had too many tabs open at once.


Widget autohide widget

Hello World!
My first addition to the Bangle Apps is a widget that hides the widget section except for 4 seconds after the watch is unlocked.
It is a fork from the Widget Visibility Widget

I like this idea, perhaps the timeout could be configured?

Yes, that is definitely a plan for the future

Nice - thanks! It's a shame we haven't got a well-defined way to force a redraw of the whole screen yet, as potentially this might be really neat if clocks used 'Bangle.appRect' - they could then use the available space when widgets weren't there.


Great workaround

This worked great for me. But it's no longer needed since https://github.com/fastlane/fastlane/pull/16689 / fastlane 2.150.0.rc4, you might want to add that to the README.

Thanks, noted!


TypeError: unsupported operand type(s) for |: 'type' and 'NoneType'

Having trouble to get this working on Windows. Any ideas?
Python 3.9.4
(venv) PS C:\Users\tiki\Documents\Transcription\frogbase> streamlit run ui/01_🏠_Home.py

  You can now view your Streamlit app in your browser.

  Local URL: http://localhost:8501
  Network URL: http://<IP_ADDRESS>:8501

2023-09-19 10:45:53.943 Uncaught app exception
Traceback (most recent call last):
  File "c:\users\tiki\documents\transcription\frogbase\venv\lib\site-packages\streamlit\runtime\scriptrunner\script_runner.py", line 552, in _run_script
    exec(code, module.__dict__)
  File "C:\Users\tiki\Documents\Transcription\frogbase\ui\01_🏠_Home.py", line 13, in <module>
    init_session(st.session_state)
  File "ui\config.py", line 60, in init_session
    from frogbase import FrogBase
  File "C:\Users\tiki\Documents\Transcription\frogbase\frogbase\__init__.py", line 1, in <module>
    from .core import FrogBase
  File "C:\Users\tiki\Documents\Transcription\frogbase\frogbase\core.py", line 13, in <module>
    from frogbase.captions import Captions
  File "C:\Users\tiki\Documents\Transcription\frogbase\frogbase\captions.py", line 17, in <module>
    class Captions(BaseModel):
  File "C:\Users\tiki\Documents\Transcription\frogbase\frogbase\captions.py", line 42, in Captions
    settings: dict | None = Field(default=None, description="The settings under which these captions were generated.")
TypeError: unsupported operand type(s) for |: 'type' and 'NoneType'

same here

Same here with python 2.7 and 3.9


Full Screen

Thanks for the great work.
Is there a way to make the window full screen without any icons?(minimize, full screen, close)

@heeh , thanks for feedback, I would like to hear more, so you don't want to have any window title, any buttons on title bar (min, max, close), window frame and anything added by window manager? and how do you expect such window to behave ? for example, you expect to switch between normal and full screen mode based on certain keyboard stroke? just like firefox (on Windows) can switch by F11 ?

@hideyukn88
Thanks for your reply.

so you don't want to have any window title, any buttons on title bar (min, max, close), window frame and anything added by window manager?
Exactly.

and how do you expect such window to behave ? for example, you expect to switch between normal and full screen mode based on certain keyboard stroke? just like firefox (on Windows) can switch by F11 ?
Yes. It would be nice if we have something similar to the full screen toggling in i3-wm ( https://i3wm.org/ )

I see that Firefox (on wsl) enters the full screen mode by pressing F11. It is not the case for the other application.
For example, PyCharm's distraction free mode does not enter full screen mode (without any icons including min, max, and close).
Lastly, firefox fullscreen transition contains animation delay even if I set to zero in about:config
full-screen-api.transition-duration.enter = "0 0"
full-screen-api.transition-duration.leave = "0 0"
Thanks.

Is it possible to open a connection to the system weston session with mstsc ?


[charter]Other Related Groups: mention other sustainability oriented communities

OS-Climate, another group under LF, uses data and technologies to accelerate investment with sustainable impacts
Open Compute Project. Thought it is mostly about systems, some projects such as heat reuse, can help software systems to build a better heuristics, e.g. through OpenTelemetry.

Green Software Foundation

Roll the Cloud

Under discussion https://github.com/cncf/wg-env-sustainability/discussions/16


How to Use a Local SVG File as an Icon in U-Icon

Description
I'm currently using U-Icon, which typically requires an icon package and configuration file setup. However, I have a custom SVG file in my project that I would like to use as an icon. Could someone guide me on how to integrate this custom SVG file with U-Icon?

You can include custom collections as shown here: https://ui.nuxt.com/getting-started/theming#custom-config


Test with database

What is the problem / what does the code in this PR do
See https://github.com/XENONnT/straxen/issues/277, https://github.com/XENONnT/straxen/issues/350
(by the way, this is the same PR as #351)
Can you briefly describe how it works?
We do give a read only account to continuous integration in order to test our real software. Otherwise we're increasingly not testing stuff because we are relying more and more on the database.
Also, let's remove some unclear imports that cause errors in places one does not expect them.
To make this work
We should add some read-only account here (see #350):
https://github.com/XENONnT/straxen/blob/c884945548bdd5ef9a77db972e42ebe78f4a4358/.github/scripts/create_empty_utilix_config.sh

@jorana in your fork can you try adding this to the utilix config file?
[basic]
logging_level=debug

Might help with the utilix issue.

https://github.com/XENONnT/straxen/pull/351#issuecomment-774207309
@ershockley , thanks, yeah I added it in this PR


How to replace SetScreenNameAndClass

Hi,
I believe the SetScreenNameAndClass method in Firebase.Analytics.Analytics is not longer present in the package "Xamarin.Firebase.iOS.Analytics", I don't know how to replace it.
Can anyone help ?
Thanks

+1

You need to use the normal LogEvent function and use "screen_view" as the event name. If you want to log the class then you can also add "screen_class" as an optional parameter.


Update to Bevy 0.15

Hello, thank you for your work on this repo! I updated this code to work with newest version of Bevy and thought to contribute it back.

Seems we both needed it 😄
See also https://github.com/JonahPlusPlus/bevy_spectator/pull/14 with a couple of other tweaks 🤷

Ah, forgot to enable notifications for this repo. I'm not the original developer, but have merge rights.


Dark Mode

Hey great job resurrecting the project. Could you please add a dark mode? Link to issue in previous project.

Hi @Damecek ,
I started to work on a dark mode version few times ago but did not finished it.
Since the extension is released in the Chrome Web Store I may have some contributions on this feature.
I'll keep you informed in this thread !

Chrome has an automatic dark mode which can be enabled from the dev console.
Can be a good starting point to reproduce those colors in the extension:

@tprouvot you've put the `help wanted'' tag, is there a branch/fork that's being used for development?

Hi @Astisme,
Yes the link is in my comment from the 18/04/23 dark mode version.
I think that for now it is easier to start from a new one.
The idea would be :

Add an input toggle in the new "Options" page to enable / disable it and store the preference in localStorage
Detect if dark mode is the preferred theme in browser window.matchMedia && window.matchMedia('(prefers-color-scheme: dark)').matches by default if no preference is stored enable the dark mode if the previous code returs true

Hey @tprouvot I'm working on this at https://github.com/Astisme/Salesforce-Inspector-reloaded/tree/feature/darkModeUI_v2
It seems like there's an issue on the addons/links.js file: chrome says Uncaught SyntaxError: Unexpected token 'export'.
Do you get the same error?

Hi @Astisme,
I've seen it few months ago but this is not something which affects the functionality itself.

I've also tried working on firefox but I get this error on loading:
`Extension is invalid
Reading manifest: Error processing background: Value must either: contain the required "page" property, contain the required "scripts" property, or not contain an unexpected "type" property`

Hi @Astisme, I've seen it few months ago but this is not something which affects the functionality itself.

It doesn't let me run the extension so I guess it does a little bit ahah

I've also tried working on firefox but I get this error on loading:
`Extension is invalid
Reading manifest: Error processing background: Value must either: contain the required "page" property, contain the required "scripts" property, or not contain an unexpected "type" property`
Reading the file

it doesn't seem that a page property is defind.
the scripts string is found only on content_scripts
the type property is not found

Firefox manifest needs some adjustments and the releaseCandidate branch does not reflect those (firefoxAddon does)

Hi @Astisme, I've seen it few months ago but this is not something which affects the functionality itself.

It doesn't let me run the extension so I guess it does a little bit ahah

Are you experiencing this issue on releaseCandidate ?

Yes, I'm getting the same error even for the releaseCandidate branch after running npm run firefox-dev-build

mhh it seems like the chrome issue is no longer a problem (I don't know what I've done tbh)

Just to be clear, do you want me to test everything on firefox as well or will it be done once `firefoxAddon'' gets merged?
Without the changes on that branch it's pretty much impossible to run the addon on firefox.

Hi @Astisme,
I'm expecting that the dev you are working on are not exclusive to chrome and compatible with firefox.
A test on firefox would help you to check that.
Once your devs are done, you can create a new branch based on firefoxAddon and merge your dev into it to check the behaviour on firefox.
Don't hesitate to share me the link on your current branch so that I can check if it goes the way I was expected

https://github.com/Astisme/Salesforce-Inspector-reloaded/tree/feature/darkModeUI_v2
 |

https://github.com/Astisme/Salesforce-Inspector-reloaded/tree/feature/darkModeUI_v2
 |

Hi @tprouvot, I'm at a good point in the implementation of this feature.
Would you mind telling me where the inspect-inline.js is invoked?
I only see it in the manifest and it isn't imported anywhere.

Hi, I'm having issues with the test-framework: it does not find AccountContactRelation during the data-export test.
Do you have any insights on where it looks for this Relation?
Everything else works fine.
I'm still having troubles getting it to work on firefox

running the firefoxAddon branch by itself does not make the addon to load
after branching from firefoxAddon and merging my devs, firefox refuses the manifest

May you please check what's going on here, please?

Here are some new insighs.

Yes, I did and I've also followed the other steps.
I've tried to reupload all of the metadata and Inspector_Test__c, SfInspctor and Account (settings) have been changed so I guess that the first time didn't work.
It is still not working though. The issue is still on that AccountContactRelation.

Account
AccountChangeEvent
AccountCleanInfo
AccountContactRole
AccountContactRoleChangeEvent
AccountFeed
AccountHistory
AccountPartner
AccountShare
ThirdPartyAccountLink
UserProvAccount
UserProvAccountStaging

That's 12 account autocompletes

I found a rather interesting fact: while trying to disable the feature "contacts to multiple accounts", I found that Salesforce has not "registered" that the feature is enable as it gives out the error You can't disable Contacts to Multiple Accounts unless the feature is enabled.
It seems like there could be an issue with deploying this specific setting.
I've created a new dev org and have manually enabled this setting. Now the test-framework is working correctly.

The edits do not work on firefox due to the export in the links.js file

Hey great job resurrecting the project. Could you please add a dark mode? Link to issue in previous project.

@Damecek hah you beat me this time. My first thought was, oh someone requested on the old project?... oh yeah it was me hah.
Saw the PR has had a lot of activity. Thanks for all the work @Astisme and @tprouvot! Was also happy to hear you on the SalesforceWay Podcast :).


Stop NodeDataWorker in UserNodePlayer on close

Summary
We're currently leaking a 50MB NodeDataWorker every time we open a
file. (Most of the weight is probably typescript?) We should explicitly
terminate the worker instead.
Alternatively, we could reuse these -- either by keeping references to
old unused workers, or by making them static and never terminating them
(assuming they're stateless.) To inform a discussion of this point, I've
measured the time to instantiate a NodeDataWorker in an Rpc and
send it a dummy message. It takes between 1.5 and 1.6 seconds on my
personal laptop.
A design question, answerable later: Should Rpc have a terminate()
method? I imagine this sort of thing is pretty common.
Also something to fix later: On application startup, we also leak a
650KB roslib "workersocket" every second. Not much, but it's over 2 gigs
per hour so it could occasionally cause users pain.
Test plan
I've loaded the app a few times, imported a few bags and made sure the web-workers have been cleaned up. If you think this could use some unit testing I'd definitely appreciate some ideas on how to do that.
Versioning impact
None.

Oh and around unit testing, I don't see any great unit testing opportunities here. Seems fine the way it is.


Only enable want_dvr when set to 1

Before DVR was enabled when you set the variable 'want_dvr' to any
value, even false. Now we check that the value has to be 1 (true).

gating failed because of an unrelated error (tempest).


Adjusting Return button

Screenshots
If applicable, add screenshots to help explain your problem.
Shifting the return button to extreme left just below the drop-down menu

@ankitapuri  I would like to work on this issue

@ankitapuri can i work on this issue?
please assign this to me
Thank you!

@ankitapuri i am also interested in this issue


closeOpenAllRows not working on Android

when one row is open and I switch to another tab, on Android devices, the open row remains open, whereas on iOS devices, it closes. The behavior I expect is for the open row to close when I take other actions, similar to how it behaves on iOS devices. The React Native version I'm using is 0.72.4.

same behavior on my end just, left it like that.

I'm on 0.72.6, and my hidden row is above my visible row when it should be the opposite. Also only on Android.


Changing a character into a number

Rafael and I were wondering if there's a way to convert a character into a number on Rstudio. For example check the data set of "women" included in R: the variables "height" and "weight" are considered characters even though they are numbers; therefore, it's not possible to calculate some statistics!!
Thanks a lot! :)

If you have a data frame called data and a variable called height then use as.numeric like this:
data$height <- as.numeric(data$height)


Any way to configure callback_path when configuring through devise ?

I would like to configure my callback URI with your gem, but I can't figure out how (or if I can). I can't seem to properly setup callback_path with the openid_connect strategy when using Devise. (see https://github.com/omniauth/omniauth/issues/593)
I'd be open to make a fork and open a PR if this not possible right now and you could give me some pointers ?
Thank you,

Hey @kofronpi
First of all, I have to say that I've been out of the omniauth context for a while, and it's possible that I'm missing something.
As of my understanding, you cannot do this with the "ominauth-openidconnect" gem,  because it's just an underlying provider.
Again, it's possible that I'm wrong; it's hard to say without seeing the exact code and examples of requests.

Hello @m0n9oose, thanks, I jumped at the same conclusion reading the omniauth_openid_connect code and ended up using the openid_connect gem directly to achieve what I wanted. Closing !


Update manifest for 2.8.0

Description
Update manifest for 2.8.0.
Issues Resolved
List any issues this PR will resolve, e.g. Closes [...].
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Still a mess, will retry a new one here.

Replaced with:

https://github.com/opensearch-project/opensearch-build/pull/3580


Relax version constraints

This is based on my ruby22 branch. Sorry for piling on that one!

This looks good.
@sbleon: I'm not able to continue maintaining this gem. Would you like to do so? I'm happy to make the transfer on rubygems.

Sure! We'd be honored to be the maintainers :-)
Please transfer the repo to me and I'll move it into my company's account
after that.
You'll also need to add me as an author on rubygems using gem owner.
On Fri, May 15, 2015 at 6:41 PM, Eric Wendelin<EMAIL_ADDRESS>wrote:

This looks good.
@sbleon https://github.com/sbleon: I'm not able to continue maintaining
this gem. Would you like to do so? I'm happy to make the transfer on
rubygems.
—
Reply to this email directly or view it on GitHub
https://github.com/eriwen/gnip-rule/pull/6#issuecomment-102541728.

@sbleon Wonderful! Transfer pending. To add a RubyGems owner, I need your email address (couldn't easily find it on the interwebs). You can email<EMAIL_ADDRESS>if you prefer.

I'm<EMAIL_ADDRESS>Thanks!
On Mon, May 25, 2015 at 2:58 PM, Eric Wendelin<EMAIL_ADDRESS>wrote:

@sbleon https://github.com/sbleon Wonderful! Transfer pending. To add a
RubyGems owner, I need your email address (couldn't easily find it on the
interwebs). You can email<EMAIL_ADDRESS>if you prefer.
—
Reply to this email directly or view it on GitHub
https://github.com/eriwen/gnip-rule/pull/6#issuecomment-105289243.


Convert all mongodb keys to str

Fix Mongodb key issue. Mongodb requires keys to be string. Change Mongodb port to 27117. Since the Kytos MongoDB is using default port 27017.

Coverage: 46.454% (+0.3%) from 46.187% when pulling aa541cae52cea467bf34adfbb78027fb3c3a916f on fix-mongodb-key-format into cd014d185d9934e7594b8ce54b61038185ee0d82 on main.


Add support for pnpm

Not sure if this error pops up due to wrong usage on my end or if it simply doesn't work yet.
This is the stack trace that I encounter:
$ pnpm dlx prisma-lint apps/backend/prisma/schema.prisma
.../share/pnpm/store/v3/tmp/dlx-653806   |  +72 +++++++
.../share/pnpm/store/v3/tmp/dlx-653806   | Progress: resolved 72, reused 72, downloaded 0, added 72, done
Unable to find configuration file for prisma-lint ✖
 ERROR  Command failed with exit code 1: prisma-lint apps/backend/prisma/schema.prisma

pnpm: Command failed with exit code 1: prisma-lint apps/backend/prisma/schema.prisma
    at makeError (/home/user/.volta/tools/image/pnpm/8.2.0/dist/pnpm.cjs:24230:17)
    at handlePromise (/home/user/.volta/tools/image/pnpm/8.2.0/dist/pnpm.cjs:24801:33)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async Object.handler [as dlx] (/home/user/.volta/tools/image/pnpm/8.2.0/dist/pnpm.cjs:206486:7)
    at async /home/user/.volta/tools/image/pnpm/8.2.0/dist/pnpm.cjs:215818:21
    at async main (/home/user/.volta/tools/image/pnpm/8.2.0/dist/pnpm.cjs:215785:34)
    at async runPnpm (/home/user/.volta/tools/image/pnpm/8.2.0/dist/pnpm.cjs:216040:5)
    at async /home/user/.volta/tools/image/pnpm/8.2.0/dist/pnpm.cjs:216032:7

If pnpm is officially not supported yet, it would be great to make a small note in the README for it.

Good call out, I haven't tried with pnpm. I'll take a look shortly -- thanks for the feedback.

I manually tested pnpm seems to work fine. I think you're just missing a config file. https://github.com/loop-payments/prisma-lint/pull/58 should improve the error message.
Try creating a .prismalintrc.json file in your project root with this content and let me know if it works (with plural instead of singular if you prefer):
{
  "rules": {
    "model-name-grammatical-number": [
      "error",
      {
        "style": "singular"
      }
    ]
}

% pnpm init
{
  "name": "test",
  "version": "1.0.0",
  "description": "",
  "main": "index.js",
  "scripts": {
    "test": "echo \"Error: no test specified\" && exit 1"
  },
  "keywords": [],
  "author": "",
  "license": "ISC"
}

% pnpm install prisma-lint
Packages: +72
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

dependencies:
+ prisma-lint 0.0.17

Done in 3.5s

~/tmp/test
% cp ~/prisma-lint/example/valid.prisma prisma/schema.prisma

~/tmp/test
% cp ~/prisma-lint/example/.prismalintrc.json .

~/tmp/test
% mv valid.prisma prisma/schema.prisma

~/tmp/test
% pnpm prisma-lint
prisma/schema.prisma ✔

You are correct, it works once I add .prismalintrc.json
There's often tools that use default settings when no config is provided, and it wasn't clear to me through the README that the config file would be a hard requirement.
Thanks for pointing me to a solution; I will be playing around with prisma-lint now ;)

Makes sense. I considered a default configuration, but my feeling was that most of the rules are a matter of taste. Perhaps we could add an "init" script that runs when no configuration is found, asking the user in a series of CLI prompts how they'd like to configure the linter.


Adding CallOptions to metadata API

Is there a way to add call options to the header of the SOAP API request?  My application works with many different and disparate orgs and some of them have namespaces.
Use case:
the read() metadata api requires the fullname with namespace to be provided UNLESS defaultNamespace is specified in the SOAP header.
The listMetadata API shows the fullnames without the namespace, and attempting to use these directly returns {}.  Utilizing the readMetadata() call will require transforming all fullnames between every '.' with the namespace.  And I want to compare data programmatically and that fails if the namespace makes the values have different names in two orgs.
Examples:
Response from listMetadata()
    {
      "createdById": "005i0000000u31gAAA",
      "createdByName": "user",
      "createdDate": "2013-09-26T21:47:31.000Z",
      "fileName": "objects/Account.object",
      "fullName": "Account.High_Wealth",
      "id": "012i0000000n4C9AAI",
      "lastModifiedById": "005i0000000u31mAAA",
      "lastModifiedByName": "Automated Process",
      "lastModifiedDate": "2016-04-04T04:59:06.000Z",
      "manageableState": "unmanaged",
      "namespacePrefix": "namespace_sample",
      "type": "RecordType"
    },

Calling without namespace prefix:
{}

Calling with full namespace prefix:
fullname =  namespace_sample__Campsite__c.namespace_sample__West_Coast
    {
      "fullName": "namespace_sample__Campsite__c.namespace_sample__West_Coast",
      "active": "true",
      "description": "Campsites located on the west coast",
      "label": "West Coast",
      "picklistValues": {
        "picklist": "namespace_sample__Governing_Agency__c",
        "values": [
          {
            "fullName": "Eastern Ballroom Society",
            "default": "false"
          },
          {
            "fullName": "KOA",
            "default": "false"
          },
          {
            "fullName": "Local Agency",
            "default": "false"
          },
          {
            "fullName": "National Park Service",
            "default": "true"
          },
          {
            "fullName": "Unknown",
            "default": "false"
          },
          {
            "fullName": "Western Society of the Masses",
            "default": "false"
          }
        ]
      }
    }

Soap call with the defaultNamespace specified
<soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/" xmlns:met="http://soap.sforce.com/2006/04/metadata">
   <soapenv:Header>
      <met:CallOptions>
         <met:client></met:client>
         <met:defaultNamespace>namespace_sample</met:defaultNamespace>
      </met:CallOptions>
      <met:SessionHeader>
         <met:sessionId>xxx</met:sessionId>
      </met:SessionHeader>
   </soapenv:Header>
   <soapenv:Body>
      <met:readMetadata>
         <met:type>RecordType</met:type>
         <!--Zero or more repetitions:-->
         <met:fullNames>Campsite__c.West_Coast</met:fullNames>
      </met:readMetadata>
   </soapenv:Body>
</soapenv:Envelope>

Soap response with the defaultNamespace specified
<soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/" xmlns="http://soap.sforce.com/2006/04/metadata" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
   <soapenv:Body>
      <readMetadataResponse>
         <result>
            <records xsi:type="RecordType">
               <fullName>Campsite__c.West_Coast</fullName>
               <active>true</active>
               <description>Campsites located on the west coast</description>
               <label>West Coast</label>
               <picklistValues>
                  <picklist>Governing_Agency__c</picklist>
                  <values>
                     <fullName>Eastern Ballroom Society</fullName>
                     <default>false</default>
                  </values>
                  <values>
                     <fullName>KOA</fullName>
                     <default>false</default>
                  </values>
                  <values>
                     <fullName>Local Agency</fullName>
                     <default>false</default>
                  </values>
                  <values>
                     <fullName>National Park Service</fullName>
                     <default>true</default>
                  </values>
                  <values>
                     <fullName>Unknown</fullName>
                     <default>false</default>
                  </values>
                  <values>
                     <fullName>Western Society of the Masses</fullName>
                     <default>false</default>
                  </values>
               </picklistValues>
            </records>
         </result>
      </readMetadataResponse>
   </soapenv:Body>
</soapenv:Envelope>

Closing - didn't realize that callOptions was available in the connection object.

Passing callOptions to connection constructor does not seem to do the trick anymore (at least for my purposes). callOptions seem to always go to HTTP header for every request to Salesforce in HttpApi.prototype.beforeSend, which does not produce the results I need.
I am primarily interested in all of my jsForce calls being logged in 'API Calls Made Within Last 7 Days' Report. And that seems to only work if I directly make changes to Header in SOAP envelope. Again, setting header in HTTP requests with "Sforce-Call-Options" does not reflect requests in 'API Calls Made Within Last 7 Days' Report.


Update process failed: Token recognition error

I can't start the server using latest itzg/docker-minecraft-server.
I have followed instructions for packwiz using git, added .gitattributes and run git add --renormalize ..
I also tried reinitialising packiwz.
Would anyone know why I'm getting this error?
My pack.toml
[init] Changing uid of minecraft to 1044
[init] Changing gid of minecraft to 65539
[init] Running as uid=1044 gid=65539 with /data as 'drwx-w---- 1 1044 1000 556 Nov 25 18:48 /data'
[init] Resolved version given 1.19.2 into 1.19.2 and major version 1.19
[init] Autopause functionality enabled
[init] Updated rcon port in knockd config
[init] Resolving type given FABRIC
[init] Checking Fabric Launcher version information.
[init] Checking Fabric Loader version information.
[init] Running packwiz installer against URL: https://github.com/filcuk/fimc-vanilla-plus/blob/v1.0.0-rc.4/pack.toml
packwiz-installer was started without packwiz-installer-bootstrap. Use the bootstrapper for automatic updates! (Disregard this message if you have your own update mechanism)
Loading manifest file...
Loading pack file...
[FATAL] Update process failed:
ParseError(errorDescription=token recognition error at: '<', line=8, cause=LexerNoViableAltException('<'))
	at cc.ekblad.toml.serialization.TomlErrorListener.syntaxError(SourceFile:21)
	at org.antlr.v4.runtime.ProxyErrorListener.syntaxError(SourceFile:41)
	at org.antlr.v4.runtime.Lexer.notifyListeners(SourceFile:364)
	at org.antlr.v4.runtime.Lexer.nextToken(SourceFile:144)
	at org.antlr.v4.runtime.BufferedTokenStream.fetch(SourceFile:169)
	at org.antlr.v4.runtime.BufferedTokenStream.sync(SourceFile:152)
	at org.antlr.v4.runtime.BufferedTokenStream.consume(SourceFile:136)
	at org.antlr.v4.runtime.Parser.consume(SourceFile:570)
	at org.antlr.v4.runtime.Parser.match(SourceFile:204)
	at cc.ekblad.toml.parser.TomlParser.document(SourceFile:151)
	at cc.ekblad.toml.serialization.TomlDeserializerKt.from(SourceFile:49)
	at cc.ekblad.toml.serialization.TomlDeserializerKt.from(SourceFile:28)
	at link.infra.packwiz.installer.UpdateManager.start(SourceFile:489)
	at link.infra.packwiz.installer.UpdateManager.<init>(SourceFile:43)
	at link.infra.packwiz.installer.Main.startup(SourceFile:109)
	at link.infra.packwiz.installer.Main.<init>(SourceFile:150)
	at link.infra.packwiz.installer.Main$Companion.main(SourceFile:142)
	at link.infra.packwiz.installer.Main.main(SourceFile)
Caused by: LexerNoViableAltException('<')
	at org.antlr.v4.runtime.atn.LexerATNSimulator.failOrAccept(SourceFile:309)
	at org.antlr.v4.runtime.atn.LexerATNSimulator.execATN(SourceFile:230)
	at org.antlr.v4.runtime.atn.LexerATNSimulator.match(SourceFile:114)
	at org.antlr.v4.runtime.Lexer.nextToken(SourceFile:141)
	... 14 more
[init] ERROR failed to run packwiz installer

Could it be that you want to use https://raw.githubusercontent.com/filcuk/fimc-vanilla-plus/v1.0.0-rc.4/pack.toml instead of https://github.com/filcuk/fimc-vanilla-plus/blob/v1.0.0-rc.4/pack.toml? When packwiz tries to download the latter it will get a bunch of HTML instead of the pack.toml you want it to look for, resulting in it failing to parse the file.

That would be it... thank you :)

What do we do if, in my case, I used https://github.com/NoicTheBrave/UMS4_0_2-BareBones/blob/main/pack.toml inside of there, and it still did not work? The corresponding index.toml (https://github.com/NoicTheBrave/UMS4_0_2-BareBones/blob/main/index.toml) is in the same folder (not sure if that is even relevant here, but just something to note)
The pre-launch command:
'"$INST_JAVA" -jar packwiz-installer-bootstrap.jar https://github.com/NoicTheBrave/UMS4_0_2-BareBones/blob/main/pack.toml'
The report that follows:
Running Pre-Launch command: C:/Program Files/Java/jre1.8.0_331/bin/javaw.exe -jar packwiz-installer-bootstrap.jar https://github.com/NoicTheBrave/UMS4_0_2-BareBones/blob/main/pack.toml Current version is: v0.5.14 New version is: v0.5.14 Already up to date! Loading manifest file... Loading pack file... [FATAL] Update process failed:  ParseError(errorDescription=token recognition error at: '<', line=7, cause=LexerNoViableAltException('<')) 	at cc.ekblad.toml.serialization.TomlErrorListener.syntaxError(SourceFile:21) 	at org.antlr.v4.runtime.ProxyErrorListener.syntaxError(SourceFile:41) 	at org.antlr.v4.runtime.Lexer.notifyListeners(SourceFile:364) 	at org.antlr.v4.runtime.Lexer.nextToken(SourceFile:144) 	at org.antlr.v4.runtime.BufferedTokenStream.fetch(SourceFile:169) 	at org.antlr.v4.runtime.BufferedTokenStream.sync(SourceFile:152) 	at org.antlr.v4.runtime.BufferedTokenStream.consume(SourceFile:136) 	at org.antlr.v4.runtime.Parser.consume(SourceFile:570) 	at org.antlr.v4.runtime.Parser.match(SourceFile:204) 	at cc.ekblad.toml.parser.TomlParser.document(SourceFile:151) 	at cc.ekblad.toml.serialization.TomlDeserializerKt.from(SourceFile:49) 	at cc.ekblad.toml.serialization.TomlDeserializerKt.from(SourceFile:28) 	at link.infra.packwiz.installer.UpdateManager.start(SourceFile:488) 	at link.infra.packwiz.installer.UpdateManager.<init>(SourceFile:42) 	at link.infra.packwiz.installer.Main.startup(SourceFile:112) 	at link.infra.packwiz.installer.Main.<init>(SourceFile:154) 	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) 	at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source) 	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source) 	at java.lang.reflect.Constructor.newInstance(Unknown Source) 	at link.infra.packwiz.installer.bootstrap.LoadJAR.start(LoadJAR.java:51) 	at link.infra.packwiz.installer.bootstrap.Main.<init>(Main.java:91) 	at link.infra.packwiz.installer.bootstrap.Main.main(Main.java:46) Caused by: LexerNoViableAltException('<') 	at org.antlr.v4.runtime.atn.LexerATNSimulator.failOrAccept(SourceFile:309) 	at org.antlr.v4.runtime.atn.LexerATNSimulator.execATN(SourceFile:230) 	at org.antlr.v4.runtime.atn.LexerATNSimulator.match(SourceFile:114) 	at org.antlr.v4.runtime.Lexer.nextToken(SourceFile:141) 	... 19 more User selected to quit, exiting with code 1... Process exited with code 1. Pre-Launch command failed with code 1.
Any help would be appreciated

Again, if you use the URL https://github.com/NoicTheBrave/UMS4_0_2-BareBones/blob/main/pack.toml, you get a web page, not the raw contents of the file, so packwiz downloads the .html file instead of the .toml file that's visually embedded somewhere within.
Click the "Raw" button on the right of the page, then copy that page URL and use it instead.