Nick HillandCyrus Leung 439368496d [BugFix] Fix PP/async scheduling with pooling models (#28899) ...

Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

2025-11-18 00:20:45 -08:00

..

attention

[ROCm][Qwen3-32B] Fix AITER MHA accuracy issue cause by #25763 (#28670)

2025-11-16 20:52:11 -08:00

core

[Misc] Fix wrong comment in scheduler (#28880)

2025-11-17 15:32:22 -08:00

engine

[BugFix] Fix PP/async scheduling with pooling models (#28899)

2025-11-18 00:20:45 -08:00

executor

[BugFix] Fix PP/async scheduling with pooling models (#28899)

2025-11-18 00:20:45 -08:00

kv_offload

Implement ARC KV cache eviction policy for CPU offloader (#27039)

2025-11-12 09:51:39 -08:00

metrics

[Metrics] Fix KV cache usage percent metric multiproc (#28792)

2025-11-17 09:54:15 +00:00

pool

[Chore] Separate out vllm.utils.platform_utils.py (#27374)

2025-10-23 19:08:06 +00:00

sample

[Core] Async Scheduling X Spec Decoding Compatibility (#24799)

2025-11-17 12:16:20 -08:00

spec_decode

[Core] Async Scheduling X Spec Decoding Compatibility (#24799)

2025-11-17 12:16:20 -08:00

structured_output

[Bugfix] Fix llguidance backend, rollback when EOS was encountered (#25905)

2025-11-10 14:53:32 -05:00

worker

[BugFix] Corner case that could cause out-of-sync with external launcher mode and dp >1 (#28774)

2025-11-17 15:22:11 -08:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[LoRA] LoRA cuda graph specialization (#25914)

2025-10-20 04:21:09 +00:00

kv_cache_interface.py

[Hybrid] Pass kernel block size to builders (#27753)

2025-11-03 05:48:03 +00:00

outputs.py

[Redo] #26368 (#28771)

2025-11-14 22:47:41 -08:00

request.py

[Model] Allow users to control skip reading cache per request. (#28194)

2025-11-16 00:04:50 -08:00

serial_utils.py

[DisaggEverything] Tokens in<>out /generate endpoint (#24261)

2025-11-14 09:58:01 -07:00

utils.py

[BugFix] Fix async scheduling + chunked prefill + preemption (#28787)

2025-11-17 06:46:46 +08:00