vLLM/vllm/config at 836bb3839ffefcda8283ea7d41671a89e1a613df - vLLM

__init__.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781 )

2026-09-12 00:36:47 -04:00

attention.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781 )

2026-09-12 00:36:47 -04:00

cache.py

[Deprecation] Deprecate items scheduled for 0.29 (#55353 )

2026-09-11 08:17:02 -07:00

compilation.py

[Bugfix] Fall back to full decode graphs for noncompiled models (#55095 )

2026-09-11 01:56:05 -07:00

device.py

platforms: add uses_cpu_device() hook to Platform for DeviceConfig (#42313 )

2026-05-12 12:39:17 -07:00

diffusion.py

[Model] Add DiffusionGemma Support (#45163 )

2026-06-11 22:17:35 -07:00

ec_manager_config.py

[Core] Configure custom encoder cache managers from VllmConfig (#51251 )

2026-08-13 16:08:01 +08:00

ec_transfer.py

[EPD] Add ECMooncakeConnector for encoder cache over Mooncake TransferEngine (#41567 )

2026-09-07 06:21:43 +00:00

engram.py

[DS V4.1][Engram] Support async prefetch for offloaded engram lookups and engram DP sharding (#56512 )

2026-09-13 02:44:23 -07:00

fault_tolerance.py

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428 )

2026-07-25 11:49:09 -04:00

kernel.py

[Quantization] Select linear backends per quantization (#51204 )

2026-09-14 16:24:18 -04:00

kv_events.py

[Mypy] Better fixes for the mypy issues in vllm/config (#37902 )

2026-03-25 06:14:43 -07:00

kv_transfer.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781 )

2026-09-12 00:36:47 -04:00

load.py

Fast Start (#54921 )

2026-09-04 06:32:06 -07:00

lora.py

[Model] Add Inkling LoRA support [4/N] (#48884 )

2026-07-17 09:52:15 +08:00

mamba.py

[Kernel] Add support for Flashinfer Mamba SSU algorithm selection (#50157 )

2026-08-04 09:40:23 -07:00

model_arch.py

Fix Gemma 4 for upcoming Transformers version (#49797 )

2026-08-10 07:48:26 +00:00

model.py

[Bugfix] Align vLLM YaRN with Transformers and stop re-scaling max_model_len (#56446 )

2026-09-11 13:01:38 +00:00

multimodal.py

[Deprecation] Deprecate items scheduled for 0.29 (#55353 )

2026-09-11 08:17:02 -07:00

observability.py

[Frontend][Core][Spec Decode] Per-request acceptance stats in OpenAI API responses (#48915 )

2026-08-20 15:42:49 -07:00

offload.py

[offloader] v2: Hide weight onloading latency via prefetching (#29941 )

2026-02-25 17:20:59 -08:00

parallel.py

[Elastic EP] Reuse CUDA graphs across reconfiguration (#54985 )

2026-09-12 10:26:39 -04:00

pooler.py

[Bugfix] Reject removed pooling parameters (#48984 )

2026-07-19 05:18:03 -07:00

profiler.py

[Profiler] Add Proton CUDA graph attribution for MRV2 (#51084 )

2026-09-14 19:02:07 +00:00

quantization.py

[Quantization] Support online quantization with partially pre-quantized checkpoints (#51392 )

2026-09-04 11:46:06 -07:00

reasoning.py

[Feat] Support thinking_token_budget in Model Runner V2 (#46727 )

2026-08-07 03:36:18 +00:00

scheduler.py

[Docs] Clarify admission control limits apply server-wide, not per DP rank (#55124 )

2026-09-07 14:08:48 +00:00

speculative.py

[Model Runner V2] Acceptance estimation for adaptive verification (#52228 )

2026-09-14 15:58:48 -07:00

speech_to_text.py

support hotwords for FunASR model (#39674 )

2026-04-22 02:25:06 -07:00

structured_outputs.py

Remove unused disable_fallback field (#36546 )

2026-03-09 20:56:54 -07:00

utils.py

[UX] Reject incompatible nested runtime overrides (#49247 )

2026-07-24 07:16:22 -07:00

vllm.py

[Minor] Invert MRV1 specdec method fallback logic (#56899 )

2026-09-14 18:56:04 -07:00

watermarking.py

[watermarking] Dual-key gumbel-max watermarking for speculative decoding support (#56122 )

2026-09-12 18:42:01 +00:00

weight_transfer.py

[RL] P2P RDT weight sync (#43375 )

2026-08-23 09:42:22 -07:00