zhanqiuhuandNicolò Lucchesi 90f3c01fa4 [Spec Decode][KV Connector] Fix KV transfer in PD + speculative decoding (#35158) ...

Signed-off-by: Claude <noreply@anthropic.com>
Signed-off-by: Zhanqiu Hu <zh338@cornell.edu>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

2026-03-06 08:50:44 +01:00

..

gpu

[Misc] Rename group_mm_kwargs_by_modality -> group_and_batch_mm_kwargs (#36158)

2026-03-06 12:32:48 +08:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

[V1][Hybrid] Mamba Prefix Caching with align mode (#30877)

2026-01-23 09:56:48 -08:00

cp_utils.py

[V1][Hybrid] Mamba Prefix Caching with align mode (#30877)

2026-01-23 09:56:48 -08:00

cpu_model_runner.py

[1/N] Elastic EP Milestone 2 (#34861)

2026-02-28 04:46:42 +00:00

cpu_worker.py

[Bugfix] Propagate compilation_time from workers to main process for TP>1 (#35503)

2026-02-28 05:03:22 +00:00

dp_utils.py

[DP] Only use DP padding when cudagraphs are actually used (#34102)

2026-02-27 15:14:31 -05:00

ec_connector_model_runner_mixin.py

[Misc] Introduce ec_both role EC (encoder cache) connector (#34182)

2026-02-10 18:55:35 +00:00

gpu_input_batch.py

[V1][Hybrid] Mamba Prefix Caching with align mode (#30877)

2026-01-23 09:56:48 -08:00

gpu_model_runner.py

[Spec Decode][KV Connector] Fix KV transfer in PD + speculative decoding (#35158)

2026-03-06 08:50:44 +01:00

gpu_ubatch_wrapper.py

[Bugfix] Fix AttributeError in SMControlContextManager (#35338)

2026-02-25 18:01:10 -08:00

gpu_worker.py

[Feature] Add --distributed-timeout-seconds CLI option (#36047)

2026-03-05 20:57:51 -08:00

kv_connector_model_runner_mixin.py

[Spec Decode][KV Connector] Fix KV transfer in PD + speculative decoding (#35158)

2026-03-06 08:50:44 +01:00

lora_model_runner_mixin.py

Reduce the kernel overhead when num of active loras is smaller than max loras. Multiple cuda graphs are captured for each num of active-loras. (#32005)

2026-02-02 12:30:06 -05:00

mamba_utils.py

[perf] Use pinned memory for async H2D transfer in do_mamba_copy_block (#35480)

2026-02-28 01:50:37 +08:00

tpu_input_batch.py

[Cleanup] Remove unused ModelRunner V1 InputBatch.num_tokens field (#30218)

2025-12-18 09:17:00 -08:00

ubatch_utils.py

[6/N][Attention] Move utils to more appropriate locations (#32215)

2026-01-13 05:38:52 -08:00

ubatching.py

[Misc] Replace Optional[X] with X | None syntax (#33332)

2026-01-30 01:56:59 -08:00

utils.py

[BugFix] Add support for MTP num_speculative_tokens > 1 with sparse MLA (#34552)

2026-03-03 07:21:57 -08:00

worker_base.py

[Core] Move ray-specific WorkerWrapperBase methods to RayWorkerWrapper (#35328)

2026-03-05 12:11:59 +08:00

workspace.py

[1/N] Elastic EP Milestone 2 (#34861)

2026-02-28 04:46:42 +00:00

xpu_model_runner.py

[XPU] Enable ModelRunnerV2 on XPU (#36078)

2026-03-05 17:19:18 +00:00

xpu_worker.py

[XPU] Enable ModelRunnerV2 on XPU (#36078)

2026-03-05 17:19:18 +00:00