Michael GoinandNick Hill ac36a7a1e7 [MRV2][Spec Decode] Avoid rejection sampler OOM by chunking (#48630) ...

Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

2026-07-23 18:13:13 +08:00

..

__init__.py

[Model] Add DiffusionGemma Support (#45163)

2026-06-11 22:17:35 -07:00

attention.py

[Attention] Allow selecting a different attention backend per KV-cache group (#48012)

2026-07-17 15:19:02 -04:00

cache.py

[2/N][Core] support partial prefix cache hit for hybrid model (#46384)

2026-07-12 05:37:51 +00:00

compilation.py

[Model][Hardware][AMD]: Part 1/2 -> Enable e2e QK Norm + RoPE + KV Cache runtime fusion for Qwen3-30B-A3B on ROCM_AITER_FA, and ROCM_AITER_UNIFIED_ATTN (#42749)

2026-07-16 17:39:04 -05:00

device.py

platforms: add uses_cpu_device() hook to Platform for DeviceConfig (#42313)

2026-05-12 12:39:17 -07:00

diffusion.py

[Model] Add DiffusionGemma Support (#45163)

2026-06-11 22:17:35 -07:00

ec_transfer.py

[Misc] Introduce ec_both role EC (encoder cache) connector (#34182)

2026-02-10 18:55:35 +00:00

kernel.py

[Feat][Perf] Add new warmup infrastructure for JITs (#47451)

2026-07-20 13:21:55 -07:00

kv_events.py

[Mypy] Better fixes for the mypy issues in vllm/config (#37902)

2026-03-25 06:14:43 -07:00

kv_transfer.py

[Connector] Remove P2pNcclConnector (#44854)

2026-06-08 18:58:29 +08:00

load.py

[Bugfix][Config] Keep pydantic validation for fields with a TYPE_CHECKING Literal alias (#46220)

2026-06-24 12:25:50 +00:00

lora.py

[Model] Add Inkling LoRA support [4/N] (#48884)

2026-07-17 09:52:15 +08:00

mamba.py

[Hardware][CPU] Enable granite-4 model on cpu (#47641)

2026-07-20 06:15:16 +00:00

model_arch.py

[Model] Support Unlimited OCR (#46564)

2026-06-27 23:09:18 -07:00

model.py

[MRV2][Spec Decode] Avoid rejection sampler OOM by chunking (#48630)

2026-07-23 18:13:13 +08:00

multimodal.py

[Misc] Move PyNvVideoCodec stuff out of gpu worker (#49322)

2026-07-22 10:11:56 +08:00

observability.py

[Feat] Add runtime monitor for post-warmup CuTeDSL compilation (#46167)

2026-06-23 23:33:17 +00:00

offload.py

[offloader] v2: Hide weight onloading latency via prefetching (#29941)

2026-02-25 17:20:59 -08:00

parallel.py

[ROCm] Upgrade NIXL and UCX (#49251)

2026-07-21 22:30:02 -05:00

pooler.py

[Bugfix] Reject removed pooling parameters (#48984)

2026-07-19 05:18:03 -07:00

profiler.py

[Hardware][GPU] Profiler config additional to increase it scope and annotation details (#37524)

2026-07-17 13:38:59 -07:00

quantization.py

[Quant] Add nvfp4_per_token online MoE quantization (#48538)

2026-07-16 14:25:27 -07:00

reasoning.py

[Feature] Add auto-detection for reasoning_config when only reasoning_parser is set (#38214)

2026-04-10 01:36:26 +00:00

scheduler.py

[Misc] Remove old now unsupported max_num_partial_prefills and max_long_partial_prefills (#49244)

2026-07-21 08:52:52 +00:00

speculative.py

[Spec Decode][DSpark] Add Gemma4-12B DSpark draft model (#47216)

2026-07-16 21:51:47 +00:00

speech_to_text.py

support hotwords for FunASR model (#39674)

2026-04-22 02:25:06 -07:00

structured_outputs.py

Remove unused disable_fallback field (#36546)

2026-03-09 20:56:54 -07:00

utils.py

[EPLB] Mask padding in EPLB load recording (#38128)

2026-06-28 19:43:58 -07:00

vllm.py

[ROCm] Remove redundant AITER fused_qk_rmsnorm probe (avoids config-time HIP init) (#47992)

2026-07-21 22:58:14 -05:00

weight_transfer.py

Weight sync refactor + move sparse nccl engine (#44353)

2026-07-01 01:25:19 -07:00