jennyyyyzhenandyZhen a4cf9b22ba [ROCM][Bugfix] Use correct stride in cp_mha_gather_cache_kernel for hybrid model (#37228) (#37228) ...

Signed-off-by: jennyyyyzhen <yzhen@hmc.edu>
Co-authored-by: yZhen <yZhen@fb.com>

2026-03-26 10:33:39 -07:00

..

attention

[ROCM][Bugfix] Use correct stride in cp_mha_gather_cache_kernel for hybrid model (#37228) (#37228)

2026-03-26 10:33:39 -07:00

core

[Core][KV Connector] Remove use of num_cached_tokens in error handling (#38096)

2026-03-25 18:20:48 +00:00

engine

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

executor

elastic_ep: Fix issues with repeated scale up/down cycles (#37131)

2026-03-20 23:13:02 +00:00

kv_offload

[KV Offload] Refactor CPU offloading: pluggable CachePolicy, remove Backend abstraction, restructure into cpu/ package (#37874)

2026-03-24 07:02:51 +02:00

metrics

[Metrics] Some small refactoring for better maintainability (#33898)

2026-03-20 16:11:34 +00:00

pool

[Refactor] Remove dead code in pooling model (#37572)

2026-03-20 07:39:43 +08:00

sample

[Feature] limit thinking tokens (hard limit) (#20859)

2026-03-24 09:53:07 -07:00

spec_decode

[Feature] Support per-draft-model MoE backend via --speculative-config (#37880)

2026-03-25 14:31:52 +00:00

structured_output

[Refactor] Rename WAITING_FOR_FSM to WAITING_FOR_STRUCTURED_OUTPUT_GRAMMAR (#38048)

2026-03-25 11:41:44 -04:00

worker

Relocate Encoder CUDA graph manager (#38116)

2026-03-25 20:52:12 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Mypy] Fix mypy for vllm/config (#37808)

2026-03-23 14:33:59 +00:00

kv_cache_interface.py

[BUGFIX][Mamba][Qwen3.5] Zero freed SSM cache blocks on GPU (#35219)

2026-03-10 03:32:20 -07:00

outputs.py

[KVConnector] Support worker -> scheduler metadata (#31964)

2026-03-11 17:36:37 +00:00

request.py

[Refactor] Rename WAITING_FOR_FSM to WAITING_FOR_STRUCTURED_OUTPUT_GRAMMAR (#38048)

2026-03-25 11:41:44 -04:00

serial_utils.py

Add tensor IPC transfer mechanism for multimodal data (#32104)

2026-03-21 20:10:20 +00:00

utils.py

[Frontend] Move APIServerProcessManager target server fn (#38115)

2026-03-25 18:14:41 +00:00