[Bug]: Async engine hangs with 0.4.* releases

Your current environment
Collecting environment information...
PyTorch version: 2.3.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A

OS: Ubuntu 22.04.3 LTS (x86_64)
GCC version: (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0
Clang version: Could not collect
CMake version: version 3.29.3
Libc version: glibc-2.35

Python version: 3.10.12 (main, Nov 20 2023, 15:14:05) [GCC 11.4.0] (64-bit runtime)
Python platform: Linux-6.5.0-1020-oem-x86_64-with-glibc2.35
Is CUDA available: True
CUDA runtime version: 12.1.105
CUDA_MODULE_LOADING set to: LAZY
GPU models and configuration: GPU 0: NVIDIA RTX 6000 Ada Generation
Nvidia driver version: 545.29.06
cuDNN version: Could not collect
HIP runtime version: N/A
MIOpen runtime version: N/A
Is XNNPACK available: True

CPU:
Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      46 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             32
On-line CPU(s) list:                0-31
Vendor ID:                          GenuineIntel
Model name:                         13th Gen Intel(R) Core(TM) i9-13900K
CPU family:                         6
Model:                              183
Thread(s) per core:                 2
Core(s) per socket:                 24
Socket(s):                          1
Stepping:                           1
CPU max MHz:                        5800.0000
CPU min MHz:                        800.0000
BogoMIPS:                           5990.40
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb intel_pt sha_ni xsaveopt xsavec xgetbv1 xsaves split_lock_detect avx_vnni dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp hwp_pkg_req hfi vnmi umip pku ospke waitpkg gfni vaes vpclmulqdq tme rdpid movdiri movdir64b fsrm md_clear serialize pconfig arch_lbr ibt flush_l1d arch_capabilities
Virtualization:                     VT-x
L1d cache:                          896 KiB (24 instances)
L1i cache:                          1.3 MiB (24 instances)
L2 cache:                           32 MiB (12 instances)
L3 cache:                           36 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-31
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass:    Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Enhanced / Automatic IBRS, IBPB conditional, RSB filling, PBRSB-eIBRS SW sequence
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected

Versions of relevant libraries:
[pip3] mypy-extensions==1.0.0
[pip3] numpy==1.26.4
[pip3] nvidia-nccl-cu12==2.20.5
[pip3] torch==2.3.0
[pip3] triton==2.3.0
[pip3] vllm-nccl-cu12==<IP_ADDRESS>.4.0
[conda] Could not collectROCM Version: Could not collect
Neuron SDK Version: N/A
vLLM Version: 0.4.2
vLLM Build Flags:
CUDA Archs: Not Set; ROCm: Disabled; Neuron: Disabled
GPU Topology:
GPU0	CPU Affinity	NUMA Affinity	GPU NUMA ID
GPU0	 X 	0-31	0		N/A

Legend:

  X    = Self
  SYS  = Connection traversing PCIe as well as the SMP interconnect between NUMA nodes (e.g., QPI/UPI)
  NODE = Connection traversing PCIe as well as the interconnect between PCIe Host Bridges within a NUMA node
  PHB  = Connection traversing PCIe as well as a PCIe Host Bridge (typically the CPU)
  PXB  = Connection traversing multiple PCIe bridges (without traversing the PCIe Host Bridge)
  PIX  = Connection traversing at most a single PCIe bridge
  NV#  = Connection traversing a bonded set of # NVLinks

🐛 Describe the bug
The code below worked fine with vllm==0.3.3 (I could see the generated output printed to the console).
However, when I try to use it with 0.4.0, 0.4.1 or 0.4.2 it hangs.
import argparse
import asyncio

from vllm.engine.arg_utils import AsyncEngineArgs
from vllm.engine.async_llm_engine import AsyncLLMEngine, AsyncStream
from vllm.sampling_params import SamplingParams

def parse_args():
    parser = argparse.ArgumentParser()
    parser = AsyncEngineArgs.add_cli_args(parser)
    return parser.parse_args()

async def iterate_over_output_for_one_prompt(output_iterator: AsyncStream) -> str:
    last_text = ""
    prompt = "???"

    async for output in output_iterator:
        prompt = output.prompt
        last_text = output.outputs[0].text

    return prompt + last_text

async def generate(engine: AsyncLLMEngine, prompts: list[str]) -> list[str]:
    sampling_params = SamplingParams(n=1, max_tokens=100, ignore_eos=True)
    output_iterators = [await engine.add_request(f"req_{i}", prompt, sampling_params)
                        for i, prompt in enumerate(prompts)]
    outputs = await asyncio.gather(*[iterate_over_output_for_one_prompt(output_iterator)
                                     for output_iterator in output_iterators])
    return list(outputs)

def main():
    args = parse_args()
    engine = AsyncLLMEngine.from_engine_args(AsyncEngineArgs.from_cli_args(args))
    prompts = ["I've never been to", "I would like to see"]
    outputs = asyncio.run(generate(engine, prompts))
    for output in outputs:
        print(output)
    print("FINISHED")

if __name__ == '__main__':
    main()

The last logs before iterrupting the execution are
INFO 05-13 14:28:39 async_llm_engine.py:120] Finished request req_0.
INFO 05-13 14:28:39 async_llm_engine.py:120] Finished request req_1.

And after finally pressing Ctrl+C I get
  File "/workdir/repo/llmvpr/vllm/minimal.py", line 46, in <module>
    main()
  File "/workdir/repo/llmvpr/vllm/minimal.py", line 39, in main
    outputs = asyncio.run(generate(engine, prompts))
  File "/usr/lib/python3.10/asyncio/runners.py", line 47, in run
    _cancel_all_tasks(loop)
  File "/usr/lib/python3.10/asyncio/runners.py", line 63, in _cancel_all_tasks
    loop.run_until_complete(tasks.gather(*to_cancel, return_exceptions=True))
  File "/usr/lib/python3.10/asyncio/base_events.py", line 636, in run_until_complete
    self.run_forever()
  File "/usr/lib/python3.10/asyncio/base_events.py", line 603, in run_forever
    self._run_once()
  File "/usr/lib/python3.10/asyncio/base_events.py", line 1871, in _run_once
    event_list = self._selector.select(timeout)
  File "/usr/lib/python3.10/selectors.py", line 469, in select
    fd_event_list = self._selector.poll(timeout, max_ev)
KeyboardInterrupt
Task was destroyed but it is pending!
task: <Task pending name='Task-2' coro=<AsyncLLMEngine.run_engine_loop() running at /usr/local/lib/python3.10/dist-packages/vllm/engine/async_llm_engine.py:490> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[_raise_exception_on_finish(error_callback=<bound method...7851eba052d0>>)() at /usr/local/lib/python3.10/dist-packages/vllm/engine/async_llm_engine.py:30, <1 more>, gather.<locals>._done_callback() at /usr/lib/python3.10/asyncio/tasks.py:720]>

Is there something wrong with my code or is it a bug in vllm?

If you experienced crashes or hangs, it would be helpful to run vllm with export VLLM_TRACE_FUNCTION=1 . All the function calls in vllm will be recorded. Inspect these log files, and tell which function crashes or hangs.

Quote from issue templates.

When you initialize the async engine I think it expects to be in an running event loop, not sure why though.
If you change the code to
diff --git a/original.py b/repro.py
index 37ede83..8881b6f 100644
--- a/original.py
+++ b/repro.py
@@ -32,15 +32,15 @@ async def generate(engine: AsyncLLMEngine, prompts: list[str]) -> list[str]:
     return list(outputs)

-def main():
+async def main():
     args = parse_args()
     engine = AsyncLLMEngine.from_engine_args(AsyncEngineArgs.from_cli_args(args))
     prompts = ["I've never been to", "I would like to see"]
-    outputs = asyncio.run(generate(engine, prompts))
+    outputs = await generate(engine, prompts)
     for output in outputs:
         print(output)
     print("FINISHED")

 if __name__ == '__main__':
-    main()
+    asyncio.run(main())

The prints should succeed.
However, the script still will not exit. I'm looking into that.

Saw the same issue. I tested and the culprit commit should be #3015. It's not clear to me what's the root cause though.

So the problem is that https://github.com/vllm-project/vllm/blob/97b030005c7f5cde7c1b97c718a8841db7d6220b/vllm/engine/async_llm_engine.py#L509 triggered https://github.com/python/cpython/issues/86296
The bug is fixed in Python 3.12 but will not be backported. It's very easy to workaround it in Python 3.11 with asyncio.timeout. However, the workaround for Python 3.8 - 3.11 is not straightforward.

@zifeitong I am facing exactly the same issue.
Setting engine_use_ray and worker_use_ray to True can help me walk around this issue.


MobileServiceSyncTable_IdMustBeString

What is this constraint about?
It's breaking my app that was working just fine.

There are a number of features that are required when using the sync table, for which the back end requires the Id to be a string.  Specifically optimistic concurrency, soft delete, and generally the system columns are driven off this concept.
If you are using a .NET backend you can convert your actual Id into a string & back just for over the wire purposes.
For future relaxing of this constraint, what type are your Id columns and which backend are you using?

I'm using Guid and long.


documentation format

We're yet to the stage where we should start documenting the code for all those that are gonna use this project. Our documentation tools are going to be mkdocs, mkdocstring for extracting comments to turn them to documentation and material-for-mkdocs for the material design look of the documentation page. This  article from realpython gives a brief on how we're going to do it.

@ht-thomas is anyone working on this issue?

@HassanBahati not really, I was hoping it would be a collective duty for everyone contributing to the code base to add docstring to the code they are submitting, in the format supported by mkdocstring (the tool we'll use to extract docstrings to be built into the overall documentation).
However with the way we're structuring the codebase, documentation can even be done independently of the code being submitted. So it's possible to work on documentation separately. If it's something you're interested in, you can gladly take it up.

@HassanBahati not really, I was hoping it would be a collective duty for everyone contributing to the code base to add docstring to the code they are submitting, in the format supported by mkdocstring (the tool we'll use to extract docstrings to be built into the overall documentation).
However with the way we're structuring the codebase, documentation can even be done independently of the code being submitted. So it's possible to work on documentation separately. If it's something you're interested in, you can gladly take it up.

Alright. I have submitted a pull request. Please review!

is it possible to have like a google doc work space where  all those doc strings the developers add to their code can be extracted to eddited and latter combined to a documentation that can easily be transfered to github

docstrings are necessary to be placed where they are to enable the automated generation of docs when the docs phase reaches


Disabled package sources are used in NuGet.Config

For my repository, I have a disabled package source in my NuGet.Config---used only for CD builds where it is enabled.
This causes Dependabot to think they are active package sources:
updater | I, [2021-03-17T20:05:49.459298 #7]  INFO -- sentry: ** [Raven] Raven 3.1.1 ready to catch errors
updater | INFO <job_96808390> Starting job processing
updater | INFO <job_96808390> Starting update job for AshleighAdams/Verlite
updater | INFO <job_96808390> Checking if xunit 2.4.1 needs updating
  proxy | 2021/03/17 20:05:53 [036] GET https://nuget.pkg.github.com:443/AshleighAdams/index.json
  proxy | 2021/03/17 20:05:53 [036] 401 https://nuget.pkg.github.com:443/AshleighAdams/index.json
updater | INFO <job_96808390> Handled error whilst updating xunit: private_source_authentication_failure {:source=>"https://nuget.pkg.github.com/AshleighAdams/index.json"}

My NuGet.Config looks as follows:
<?xml version="1.0" encoding="utf-8"?>
<configuration>
  <packageSources>
    <add key="github" value="https://nuget.pkg.github.com/AshleighAdams/index.json" />
  </packageSources>
  <disabledPackageSources>
    <add key="github" value="true" />
  </disabledPackageSources>
</configuration>

I would expect Dependabot to ignore the disabled github package source, and thus require no secrets.
The repository in question is https://github.com/AshleighAdams/Verlite

I opened a draft with a proposed fix + unit test. Granted, I've never used Ruby or any of its ecosystem before, so apologies if my code sucks!

I added a PoC with a disabled nuget source that has a newer package version, and it does result in opening a PR that will then fail:
https://github.com/AshleighAdams/dependabot-bug-poc/pull/1


Displaying automatically colors in files

Hi,
I was wondering if I can replace colorizer.lua with using only your's color-picker.nvim. If I open some files and there are, like hex numbers meaning come colors it would show, what color it's. I mean something like this:

I think you should stick to colorizer.lua for now, until better alternatives show up. I use colorizer too.

Thanks man. Take care :)


Does not play nice with CompressionPlugin

If I use both SplitByPathPlugin to break  out a vendor.js and CompressionPlugin to compress the resulting bundles, then only the vendor.js bundle is compressed. The primary (index.js) bundle is not compressed.

We just released 2.0.0 version of this plugin for webpack 2.
For webpack 1 there is still a branch webpack1 and version 1.0.0 on NPM.
Hi @aldendaniels
Please consider upgrading to webpack 2 and version 2.0.0 of this plugin.
If this issue still reproduces on 2.0.0 please re-open this issue.
If you really need to have this in 1.0.0, PR's to webpack1 branch are always welcome, but I don't longer plan to fix issues for webpack1.
Thanks!


Streaming object not working

While trying to use the Streaming object on a python code, I got this error :
algo = Streaming(mu=0.45, sigma=0.1, outRatio=2, outAfter=7)
File "/usr/local/lib/python3.7/dist-packages/distclus-0.1-py3.7.egg/distclus/streaming.py", line 21, in init
inner_space, window
File "/usr/local/lib/python3.7/dist-packages/distclus-0.1-py3.7.egg/distclus/oc.py", line 18, in init
self._set_descr()
File "/usr/local/lib/python3.7/dist-packages/distclus-0.1-py3.7.egg/distclus/oc.py", line 24, in _set_descr
algo = self.builder(self.args)
TypeError: 'struct Algo()(space, double *, size_t, size_t, size_t, long, int, double, double, double, int, int, float, int, float, int, space, int)' expects 18 arguments, got 17
It seems to come from inside of distclus code, and not from mine.

J'ai corrigé l'erreur.
Vous confirmez ?

L'erreur a disparue mais il y en a maintenant une autre :
algo.push(train_vectors[1:])
File "/usr/local/lib/python3.7/dist-packages/distclus-0.1-py3.7.egg/distclus/oc.py", line 48, in push
handle_error(err)
File "/usr/local/lib/python3.7/dist-packages/distclus-0.1-py3.7.egg/distclus/bind.py", line 131, in handle_error
raise RuntimeError(ffi.string(err))
RuntimeError: b'buffer is full'
Je suis en train de suivre ce tutoriel : https://wearelumenai.github.io/docs/tutorials/nlp-with-bbc-news/


added Eisley

Thanks for initiating this. Go ahead and identify which module you want to lead in the calendar and then add the link to your repo once you've created it. If you push those changes to your fork, it will automatically update this PR and I'll review it when those changes are made.


Implement File-System for the Flash-Storage

Implement solution based on results from #156

Pushed back to "ToDo" in favor of #155!


Question

Hi!
How can I change the viewing view on the iPad, what would it be displayed as on the iPhone, that is, it opens from below?

https://github.com/slackhq/PanModal/issues/74


Hubert compatibility and RVC v2 support

I tried a few different hubert checkpoints including this and this and some of these and an official fairseq base, and a few random RVC models from huggingface, I always get an error
Missing key(s) in state_dict: "hubert.encoder.pos_conv_embed.conv.parametrizations.weight.original0", "hubert.encoder.pos_conv_embed.conv.parametrizations.weight.original1".
Unexpected key(s) in state_dict: "encoder.pos_conv.0.weight_g", "encoder.pos_conv.0.weight_v".

Tried to fix it with edited mapping
r"encoder.pos_conv.0.weight_g": r"hubert.encoder.pos_conv_embed.conv.parametrizations.weight.original0",
r"encoder.pos_conv.0.weight_v": r"hubert.encoder.pos_conv_embed.conv.parametrizations.weight.original1",

I faced another issue:
RuntimeError: Error(s) in loading state_dict for SynthesizerTrnMs256NSFsid:
	size mismatch for enc_p.emb_phone.weight: copying a param with shape torch.Size([192, 768]) from checkpoint, the shape in current model is torch.Size([192, 256]).

turns out it was a v2 model, tried a v1 model and it worked.
changed emb_phone size to 768 and it converted v2 models, but v2 fails on inference:
RuntimeError: mat1 and mat2 shapes cannot be multiplied (112x256 and 768x192)

Does hubert base get used in v2 or hubert large? I looked at the paper it seems like large?, but the embedding size is 768, maybe they use the last layer as the input instead?
https://arxiv.org/pdf/2106.07447.pdf

Interested in this as well, I have the same issues with v2 models and cannot find any v1 models for the voice I am looking to use.

The number of parameters in the RVC Hubert model does not match any of the base models and it remains unclear how it was trained. Furthermore, now that VITS has been implemented in the transformer library, it should be used in the future. However, there is currently no time to update this project and it is difficult for me to implement it.


[wip] Make island shop items randomizable

Closes #9

Island shops will be randomized by the patcher writing directly to the overlays at randomization time. This is still nice to have as a self-documenting example of how to change the shop items though.


More emphasized background color for table header

I think table header looks better with more emphasized background (especially because the first tbody row is less emphasized). Intended result:

Before
After

👍 agree it seems better
we could even have a different background color for the header maybe?
going to merge this, but open for further improvements


download_dsyms broken (probably due to S3 outage)

New Issue Checklist

[x] Updated fastlane to the latest version
[x] I have read the Contribution Guidelines

Issue Description
download_dsyms fails with:
[12:28:53]: $ unzip -qo /~/dev/.../bundle_id-1.0-xx.dSYM.zip
[12:28:53]: ▸ [/~/dev/.../bundle_id-1.0-xx.dSYM.zip]
[12:28:53]: ▸ End-of-central-directory signature not found.  Either this file is not
[12:28:53]: ▸ a zipfile, or it constitutes one disk of a multi-part archive.  In the
[12:28:53]: ▸ latter case the central directory and zipfile comment will be found on
[12:28:53]: ▸ the last disk(s) of this archive.
[12:28:53]: ▸ unzip:  cannot find zipfile directory in one of /~/dev/.../bundle_id-1.0-xx.dSYM.zip or
[12:28:53]: ▸ /~/dev/.../bundle_id-1.0-xx.dSYM.zip.zip, and cannot find /~/dev/.../bundle_id-1.0-xx.dSYM.zip.ZIP, period.

Notes
Just opening an issue here in case other people are confused about this, since the file does download. My guess is that they store these in S3. Obviously nothing that Fastlane can do :)

Also downloading builds from TestFlight seems down, who knew they store them in S3?

@NachoSoto Can you confirm if this is resolved so we can close out this issue? Thanks!

Yup!


Feature: Snippets Page

[ ] Create snippets layout
[ ] Create snippets page
[ ] Add snippets/types

Example: https://leerob.io/snippets


Remove request from retry queue in case of a bad request

Remove request from retry queue in case of a bad request.
@Sarkar @aaustin

👍


Simplify Next.js docs

Summary
Rewrites the Next.js <> Cloudfare Pages docs
refs https://github.com/cloudflare/next-on-pages/pull/850

closing in favor of https://github.com/cloudflare/cloudflare-docs/pull/15995


ECOS_BB does not support exponential cone problems??

from cvxpy import *
import numpy as np
a = 0.124
b = np.matrix([[ 3.34066667,  6.63 ,       9.91933333, 13.20866667 ,16.498    ,  19.78733333]])
c = np.matrix([[-0.34113587],[-2.61301062], [-1.89579811], [-2.86916955], [-4.8875752 ],[-6.6925799 ]])
sum_val = 336
p = Int(c.size)
objective = Minimize(b*p)
constraints = [p >= 0,sum_entries(-entr(p/sum_val)-mul_elemwise(c, p/sum_val)) <=
a,sum_entries(p)==sum_val]
prob = Problem(objective, constraints)
print "Optimal value", prob.solve(solver=ECOS_BB)
print prob.status
print "Optimal var"
print p.value
I am using version 0.4.9 and I get the error:
SolverError: The solver ECOS_BB cannot solve the problem because it cannot solve exponential cone problems.
That is strange because it should be able to solve exponential cone problems according to the table given here: http://www.cvxpy.org/en/latest/tutorial/advanced/
Note that if I were to change "p = Variable(c.size)" and use the default solver, it solves fine (but not as an integer solver).

This looks like a mismatch between that table / documentation and the code:
class ECOS_BB(ECOS):
    # Solver capabilities.
    LP_CAPABLE = True
    SOCP_CAPABLE = True
    SDP_CAPABLE = False
    EXP_CAPABLE = False
    MIP_CAPABLE = True

The question is then if there was a reason to deactivate EXP or not? Skimming through ECOS_BB @ github and also these slides (page 19) somewhat indicate it should be supported in ECOS_BB.
On cvxpy's side though, there is clearly a different in the problem-setup between the continuous and mixed-solver here:
    data[s.DIMS]['e'] = data[s.DIMS][s.EXP_DIM]  # not part of ECOS_BB intf

I agree with @rileyjmurray. This was a bug in the interface.

Just tried it with 1.0. Also, I'm not sure why the github code blocks are not rendering my code as a code block.
""" Begin Code"""
from cvxpy import *
import numpy as np
is_integer = True
a = 0.124
b = np.matrix([[ 3.34066667, 6.63 , 9.91933333, 13.20866667 ,16.498 , 19.78733333]])
c = np.matrix([[-0.34113587],[-2.61301062], [-1.89579811], [-2.86916955], [-4.8875752 ],[-6.6925799 ]])
sum_val = 336
p = Variable((c.size,1),integer=is_integer)
objective = Minimize(b*p)
constraints = [p >= 0,sum(-entr(p/sum_val)-multiply(c, p/sum_val)) <=
a,sum(p)==sum_val]
prob = Problem(objective, constraints)
print "Optimal value", prob.solve(solver=ECOS_BB if is_integer else ECOS)
print prob.status
print "Optimal var"
print p.value
""" End Code"""
When I run it with "is_integer = True", I get the error "Combined backtracking failed"
When I run it with "is_integer = False", it runs fine.
So 1.0 at least tried to solve the problem, which is an improvement over 0.4.9. Still need to figure out why it failed despite the fact that the problem is a convex integer program.


ImportError: cannot import name 'BingBrowser' from 'lagent.actions'

Thanks for your amazing work! I am trying to run it at local. But it seems not working. Here is my error when running "python app.py". Could you please take a look?
Traceback (most recent call last):
File "/export/xgen-video/code/mmlm/VSA/app.py", line 2, in
from models.vsa_model import VisionSearchAssistant
File "/export/xgen-video/code/mmlm/VSA/models/vsa_model.py", line 27, in
from lagent.actions import ActionExecutor, BingBrowser
ImportError: cannot import name 'BingBrowser' from 'lagent.actions'

Thanks for your interest. This might be related to the requirements problem. We've fixed the requirements and you can have a try.

It works and thank you so much! But I have a new problem. After launching a demo and testing an instance, the code returns errors like this. Do you have any ideas about this?
topk_proposals = torch.topk(topk_logits, topk, dim=1)[1]

RuntimeError: CUDA error: an illegal memory access was encountered
CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1.
Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

Well, we didn't have such an error. You should maybe provide more information. What's your environment, how many GPUs do you have, and what's their memory?

Thank you for your reply. We have 8 A100 gpus with each of 40GB memory. May I ask your cuda version?

Our cuda version is 12.4 and we use 4090 GPUs.

It was resolved. I just need change "cuda:x" into "cuda" and it works now.


Does java runtime injection require a restart with javaagent?

No, we use the attach interface of "com.sun.tools.attach.VirtualMachine" to dynamically inject the running Java process. Recovery is the same.


chore: moved IATP model classes up from IdentityHub

What this PR changes/adds
This PR moves most of the commonly used IATP model classes up into EDC from the IdentityHub. Most notably:

model classes that are used to query the CredentialServce (=IdentityHub)
Transformers for the model classes
constants

Why it does that
The model classes will be shared by the connector and IdentityHub
Further notes

This PR does not introduce any functional changes, only moves classes from one repo to another
once this PR is merged, the classes will be deleted from IdentityHub

Linked Issue(s)
Closes # <-- insert Issue number if one exists
Please be sure to take a look at the contributing guidelines and our etiquette for pull requests.

Codecov Report
Attention: 97 lines in your changes are missing coverage. Please review.

Comparison is base (5b13175) 72.11% compared to head (06253a4) 71.74%.

Files
Patch %
Lines

...ntitytrust/model/presentationdefinition/Field.java
0.00%
24 Missing :warning:

.../model/presentationdefinition/InputDescriptor.java
0.00%
23 Missing :warning:

...presentationdefinition/PresentationDefinition.java
0.00%
21 Missing :warning:

...ust/model/credentialservice/PresentationQuery.java
0.00%
16 Missing :warning:

...m/to/JsonObjectToPresentationQueryTransformer.java
63.15%
5 Missing and 2 partials :warning:

.../identitytrust/core/IdentityAndTrustExtension.java
0.00%
2 Missing :warning:

.../model/credentialservice/PresentationResponse.java
0.00%
1 Missing :warning:

...rust/model/presentationdefinition/Constraints.java
0.00%
1 Missing :warning:

...model/presentationdefinition/FilterExpression.java
0.00%
1 Missing :warning:

...titytrust/model/presentationdefinition/Format.java
0.00%
1 Missing :warning:

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #3612      +/-   ##
==========================================
- Coverage   72.11%   71.74%   -0.37%
==========================================
  Files         898      909      +11
  Lines       17973    18084     +111
  Branches     1021     1021
==========================================
+ Hits        12961    12975      +14
- Misses       4571     4666      +95
- Partials      441      443       +2

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Create a www.apache.org/mirrors page again

This page used to exist (e.g. https://web.archive.org/web/20140102185326/https://www.apache.org/mirrors) and many links to it still exist (e.g. https://github.com/fink/fink-mirrors/blob/master/apache), so it seems to make sense to publish the placeholder linking to the CDN here as well

Maybe redirect mirrors.html to dev/mirrors.html rather than having 2 related but different pages?

Yeah - we already have basically the same information at content/dev/mirrors.md,
content/info/how-to-mirror.md and content/info/mirror-proxy.md - perhaps we should roll all four into one? or do you see a reason not to? what would be the best 'main' location?

Agreed there should ideally be only one source of information. I don't mind which is chosen.
AIUI it's up to Infra to decide.

Makes sense - I picked one, happy to change it again based on feedback.


Data Factory Continuous Integration Deployment - Issue with IR when AAD authentication with managed identity used

Hello,
Question based on this document: https://docs.microsoft.com/en-us/azure/data-factory/continuous-integration-deployment#set-up-an-azure-pipelines-release
When I want to deploy to a data factory from an arm template built from my dev data factory environment, I have an issue with my IR that uses "AAD authentication with the managed identity for your ADF": indeed, in this case the catalogAdminUserName is set to null. Therefore, I get this error at deployment from my release pipeline:
_

The provided value for the template parameter 'XXXX_properties_typeProperties_ssisProperties_catalogInfo_catalogAdminUserName' at line '1' and column '4053' is not valid.'

_
Any idea about how to fix this issue ?
Thank you!

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 1e22e4d6-366f-fbf8-e141-8905ca7ab7ae
Version Independent ID: 5be2acf2-66e7-cadf-6666-5a85a65b9771
Content: Continuous integration and delivery in Azure Data Factory
Content Source: articles/data-factory/continuous-integration-deployment.md
Service: data-factory
GitHub Login: @gauravmalhot
Microsoft Alias: gamal

@bertrandpons
Thanks for the feedback! We are currently investigating and will update you shortly.

@bertrandpons I found an interesting blog that addresses the same issue as you are getting. Please have a look at this blog.
Hope this helps.
Also, I would recommend you to create a thread on the forums - MSDN  or stack overflow(https://stackoverflow.com/questions/tagged/azure-data-factory).
Once you post your issue on forums, it will have visibility across the community which is a better suited audience for such types of issues.
Please create a Forum thread and post it's link here and tag me. I will now proceed to close this issue. Feel free to comment if you have any other queries.

@ChiragMishra-MSFT Thank you for your reply. The blog post you provided the link to does not meet exactly my case as I want to use native capacities of Azure Data Factory ARM templates with Git integration and Azure DevOps to deploy to my environments: the ARM template is supposed to provide the right way as to make it work, I guess.
Therefore I am going to post my case on stackoverflow as you advise.

I opened a post here: https://stackoverflow.com/questions/55157839/data-factory-continuous-integration-deployment-issue-with-ir-when-aad-authenti

@bertrandpons Thanks for posting it on Stack Overflow. You may also post the same on MSDN. These forums are more suited for such types of issues and it will have better visibility across the whole community.

@ChiragMishra-MSFT Ok thank you. Done right now: https://social.msdn.microsoft.com/Forums/en-US/df8fb935-79cf-408a-9ed7-252a040f828a/data-factory-continuous-integration-deployment-issue-with-ir-when-aad-authentication-with-managed?forum=AzureDataFactory


Android Basics: LiveData

URL of codelab
https://developer.android.com/codelabs/basic-android-kotlin-training-livedata
In which task and step of the codelab can this issue be found?
4. Add LiveData to the current scrambled word
Describe the problem
In step 3, it says to change the backing field currentWordCount type to LiveData, however the backing field is actually called currentScrambledWord, not currentWordCount. This should be fixed to the correct backing field name to prevent any confusion.
Steps to reproduce?

Go to...
Click on...
See error...

Versions
Android Studio version:
API version of the emulator:
Additional information
Include screenshots if they would be useful in clarifying the problem.

Thank you so much for reporting this issue. This is fixed and will be published soon.


moebius_example.html

Coverage remained the same at 66.05% when pulling e8f4dba0e388ff409ecfd3b63ade7298f43c7528 on rpanai:moebius_example.html into 415f6a7da9c1d153e2de25a1ebded2830c9d6f90 on maartenbreddels:master.

Thanks!
I've added a few fixed, feel free to add some description/credits in the first markdown cell!

Thanks!
I've added a few fixed, feel free to add some description/credits in the first markdown cell!

Do I need to make a new PR for this?

It would be nice if you credit yourself, and maybe @deeplook.

@maartenbreddels done!


Custom status page

Description
Customize button for

custom CSS
custom powered by footer (text only)

Screenshots (if any)

Its good but it's better if it accept custom html code for example I want to put link in the text of the description

Its good but it's better if it accept custom html code for example I want to put link in the text of the description

Thanks for your feedback, footer field now supports HTML input.
Merry Christmas! 🎄

I am re-structing the internal logic of status page, it should be after #863.

Would love to have this in uptime kuma!!

The powerBy text should not be changed, but I will add a option to show/hide the text later.
TODO

[ ] [Database] Add new field in status_page table: css
[ ] [Backend] Insert into table
[ ] [Frontend] Move css field to sidebar


how to get the window handle of an application which is currently running.

I need to get the window-handle (example "0xB0F4C") of an application(process) by looping through all the process that is currently open in Inspect window. This window handle will then be used to create a new session in winappdriver like this: capabilities.setCapability("appTopLevelWindow", "0xB0F4C");
Please suggest how to get the window handle.

Create a root session and find the Window by it's properties from there.
I can see that it has "Name" attribute set to "Qualtia Setup".

Hi, I've published a course about test automation using WinAppDriver. Given below is a special launch promo code(valid 4 days).
Automated UI Testing Windows Apps in Appium WinAppDriver, C#

string appText = "MyappTextName in Process";
IntPtr appTopLevelWindowHandle = new IntPtr();
Thread.Sleep(15000);
while (found != 1)
{
foreach (Process clsProcess in Process.GetProcesses())
{
if (clsProcess.ProcessName.IndexOf(appText, StringComparison.OrdinalIgnoreCase) >= 0 ||
clsProcess.MainWindowTitle.IndexOf(appText, StringComparison.OrdinalIgnoreCase) >= 0)
{
appTopLevelWindowHandle = clsProcess.MainWindowHandle;
found = 1;
break;
}
}
}
var appTopLevelWindowHandleHex = appTopLevelWindowHandle.ToString("x");

@naeemakram I am facing an error on the remote machine.  Failed to locate opened application window with appId: ApplicationID_bpx612tnafn9m!App, and processId: 4932.

I'm sorry I've never tried it on a remote machine.


No indication if CVE-2014-9515 is solved

Dozer 5.5.1 has vulnerability CVE-2014-9515.
I couldn't find any information about it in Dozer 6.X release notes and migration documents.
It is either not fixed yet or the information is missing.

not fixed. @kdebski85 ; do you want to provide a fix?

See #217


Implement feature for setting an array of images in horizontal picker

Is it possible to set values of images in horizontal picker?

Your problem is solved?

Hello, I have used gradle plugin to use this, all is working fine but when I am going to add it dynamically by using setValues its crashing and giving me error like Caused by: java.lang.IllegalArgumentException: Layout: -12 < 0, please help me out.


[Serial] Terminal hits error and stays in broken state until refresh

Giles got into a state where he could not interact with the REPL or see serial output.
This persisted until we refreshed the tab regardless of disconnect/reconnect/flash.
I think it's represented by this Sentry issue. There's a similar one with working source map here.

This is the same as https://github.com/microbit-foundation/python-editor-next/issues/603. I also saw it on a call with Jonny earlier today.
Logs from #603:
instrument.ts:125 Device status CONNECTED
helpers.ts:120 Uncaught TypeError: Cannot read properties of undefined (reading 'loadCell')
    at t._forEachCell (xterm.js:1:122707)
    at t._drawBackground (xterm.js:1:123185)
    at t.onGridChanged (xterm.js:1:124882)
    at t.renderRows (xterm.js:1:116358)
    at t._renderRows (xterm.js:1:162731)
    at e._renderCallback (xterm.js:1:160756)
    at e._innerRefresh (xterm.js:1:36928)
    at xterm.js:1:36644
    at i (helpers.ts:98:17)
instrument.ts:125 Stopping serial before flash

You get the same trace if you open() a terminal twice, with or without an intervening dispose.
I think XTerm.js is being remounted (reason TBC). It does the open call but not clean-up as there's a weird split of responsibilities between the hook and the component. It's like that to support the serial actions having access to the terminal.
A related bug can be triggered by changing language after connect. That results in the terminal being disposed but not recreated (triggered by the value of intl changing).
I think we should change the design so that the context tracks the current terminal (probably via a ref) which is used for the actions and all the lifecycle management moves into the XTerm component.


fix: Boundary extraction bug fixes

Summary of Changes
The detection of boundary values is imprecise in some places or does not produce the desired results.
In this regard, the detection and processing has been improved and unnecessary code has been removed.

@lars-reimann  The fix is ready to review.

@lars-reimann The merge conflict was resolved.


'container-title' should now be 'journal-title' in metadata blobs

journal-title property now appears in the blob with id="common". Journal name is pulled from CrossRef, not from our Fedora data (they may be different).
[
  {
    "id": "common",
    "data": {
      ...
      "journal-title": "Some journal name goes here",
      ...
    }
  },
  ...
]

verified that "journal-title" correctly appears in the metadata0


Type 'SolanaSocket' does not conform to protocol 'WebSocketDelegate'

I have utilized this package dependency for Solana integration and used version 2.0.2 for Solana's flow. Unfortunately, I am encountering the following error in Xcode 15:
Type 'SolanaSocket' does not conform to the 'WebSocketDelegate' protocol.
There is already a WebSocketDelegate method within the SolanaSocket extension, but I am still getting this error, and I am unable to edit the file due to the package dependency.
It would be great if you could assist me with this?

omg, the same problem, i dont know how to fix it, tested like million variants....
did you solve the problem?

Did you fix the error? @nikunj-inx @BebekBebek99

Did you fix the error? @nikunj-inx @BebekBebek99

No, don't understand what the problem. One way I see is to copy library and try to edit errors..
idk how I can work with solana right now on iOS.

i am also getting same problem, anyone able to solve this issue ?
@nikunj-inx  @BebekBebek99  @csarigumba  @ajamaica  @NathanLawrence

i am also getting same problem, anyone able to solve this issue ?
@nikunj-inx  @BebekBebek99  @csarigumba  @ajamaica  @NathanLawrence

No...
Why developers not fixing...

Hello @BebekBebek99 @mirbraintoo @csarigumba
I Fixed this issue for a temporary.
I have attached screenshot and shared the steps to fix the issue.
You have to go through that path. Show in finder that SolanaSocket file first -> Open that file in TextEdit -> Add the following code which I have shared in screenshot and save that file.

i am also getting same problem, anyone able to solve this issue ?
@nikunj-inx  @BebekBebek99  @csarigumba  @ajamaica  @NathanLawrence

No... Why developers not fixing...

I apologize for being unavailable. As part of my employment agreement at the job I took shortly after contributing to this project, I am no longer permitted to contribute code to open source projects without legal approval.

@nikunj-inx  One way to address this (it's a ugly hack) is to set '4.0.4' for starscream in your Package.resolved or Podfile.lock

The same mistake; in the end, I used this library added by pod.
pod 'SolanaSwift'
This method worked for me.


docs: Add an example of type checking a middleware function

name: :book: New/Updated Documentation Content
about: Adding a new docs page, or updating content in an existing docs page
PR Type
Does this PR add a new page, or update an existing page?
It updates an existing page.
Checklist

[ ] Is there an existing issue for this PR?
[x] Have the files been linted and formatted?

What docs page is being added or updated?

Section: Recipes
Page: Usage With TypeScript

For Updating Existing Content
What updates should be made to the page?
It was pointed out in a Reactiflux conversation last night that the TypeScript
examples provided by Redux currently do not demonstrate how to type a middleware
function. This patch adds a brief section to the docs that shows how to define a
typed middleware.
Do these updates change any of the assumptions or target audience? If so, how do they change?
This recipe assumes an entry-level knowledge of Redux and TypeScript and the new example aims to remain in line with these expectations.

Thanks!


separate callback part of sender and receiver in client classes

client_downloader and client_uploader are spinning between sender and receiver. This is not good approach. update_stage and sender are combinedly acting as receiver callback and vice versa. This is complicating things in error nous cases. Who is going to change execution path update_stage or sender/receiver ?
Add separate callbacks for sender and receiver. This will keep things clean. server loop is implemented in this way.

update 07/09/21
Proposed changes in original post were to have to sender, sender_cb and receiver, receiver_cb pairs. This reduces the burden but does not completely solve the problem. Sender and sender_cb will keep on growing and handle multiple things. A state enum will still be required which brings it's own set of headaches to handle it everywhere. To resolve this issues each transaction have to be broken into it's own method. Each transaction will have it's own set of worker and worker callbacks. This will need to be done for all client and server classes. For example, client_downloader should have send_request and it's callback, send_ack and it's corresponding callback. These two methods were previously part of single sender method.
No state maintenance enum should be required now since state is inherently taken into account.

This change is done for download classes of client and server.