Yufeng HeandMatthew Bonanni b2198670b1 [Bugfix] V1: support tuple model outputs in ubatch wrapper (dbo + spec decode) (#40789) ...

Signed-off-by: Yufeng He <40085740+he-yufeng@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

2026-05-13 15:47:51 -07:00

..

attention

expose flex block size for batch invariant mode (#41252)

2026-05-13 14:11:57 -07:00

core

[Spec Decode] Support hybrid attention models in extract_hidden_states (#39949)

2026-05-13 10:45:53 -07:00

engine

feat(kv-events): emit KV cache metadata (#40984)

2026-05-12 15:58:48 +00:00

executor

fix nixl side-channel host selection (#41806)

2026-05-11 07:40:37 +00:00

kv_offload

[kv_offload] Add multi-tier KV cache offloading framework (#40020)

2026-05-13 17:21:43 +03:00

metrics

[Bugfix][Metrics] Fix RayPrometheusMetric.labels() returning shared labeled child (#40840)

2026-05-01 08:43:39 +01:00

pool

[chore] Refactor pooling metadata token ID accessors (#42368)

2026-05-13 06:08:01 +00:00

sample

[XPU] keep generator state of sycl kernel align with pytorch (#41771)

2026-05-12 11:44:47 +00:00

simple_kv_offload

[Bugfix][SimpleCPUOffloadBackend] Dedup in-flight CPU offload stores across scheduler steps (#41289)

2026-05-13 01:53:32 -07:00

spec_decode

[Spec Decode] Support hybrid attention models in extract_hidden_states (#39949)

2026-05-13 10:45:53 -07:00

structured_output

[Bugfix] Pass reasoning parser kwargs to structured output (#41199)

2026-04-30 23:38:02 -07:00

worker

[Bugfix] V1: support tuple model outputs in ubatch wrapper (dbo + spec decode) (#40789)

2026-05-13 15:47:51 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Mypy] Fix mypy for vllm/config (#37808)

2026-03-23 14:33:59 +00:00

kv_cache_interface.py

[Spec Decode] Support hybrid attention models in extract_hidden_states (#39949)

2026-05-13 10:45:53 -07:00

outputs.py

[Core] Replace routing replay with device cache and async D2H pipeline (#39917)

2026-05-07 11:24:56 -07:00

request.py

[Bugfix][KV Transfer][NIXL] Notify P node on pre-admission rejection to free stranded KV blocks (#41269)

2026-05-09 22:52:09 -07:00

serial_utils.py

Add tensor IPC transfer mechanism for multimodal data (#32104)

2026-03-21 20:10:20 +00:00

utils.py

[Refactor] Unify engine process monitoring in engine manager and add Ray backend support (#35862)

2026-03-30 10:16:09 -07:00