Nick HillandCyrus Leung 439368496d [BugFix] Fix PP/async scheduling with pooling models (#28899) ...

Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

2025-11-18 00:20:45 -08:00

..

__init__.py

[DisaggEverything] Tokens in<>out /generate endpoint (#24261)

2025-11-14 09:58:01 -07:00

async_llm.py

[RL] [V1] Remove unused device argument from reset_kv_cache (#28766)

2025-11-14 23:59:42 -08:00

coordinator.py

[Misc] Clean up more utils (#27567)

2025-10-27 15:30:38 +00:00

core_client.py

[CI] Fix mypy for vllm/v1/core and vllm/v1/engine (#27108)

2025-10-30 11:32:17 +00:00

core.py

[BugFix] Fix PP/async scheduling with pooling models (#28899)

2025-11-18 00:20:45 -08:00

detokenizer.py

[CI] Fix mypy for vllm/v1/core and vllm/v1/engine (#27108)

2025-10-30 11:32:17 +00:00

exceptions.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

llm_engine.py

[RL] [V1] Remove unused device argument from reset_kv_cache (#28766)

2025-11-14 23:59:42 -08:00

logprobs.py

[Perf] Use np.ndarray instead of list[list[int]] to reduce GC overhead (#28245)

2025-11-11 10:28:47 -08:00

output_processor.py

[Perf] Support stream interval for reducing host overhead (#27869)

2025-11-13 13:21:25 -05:00

parallel_sampling.py

[n-gen] DO NOT repeatedly return finished child requests (#28591)

2025-11-13 03:36:07 +00:00

processor.py

[Core] Async Scheduling X Spec Decoding Compatibility (#24799)

2025-11-17 12:16:20 -08:00

utils.py

[V1] Support MP Executor for multi node distributed inference (#23691)

2025-11-16 09:01:21 +00:00