Wei-Ming Chen 1c94e8dc7d Add NVFP4 KV 4-over-6 scale search (#45187) ...

Signed-off-by: weimingc <17592131+meenchen@users.noreply.github.com>

2026-08-07 13:22:27 -07:00

..

__init__.py

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

attention.py

[Attention][MiniMax-M3] Add MSA speculative decode verification (#50032)

2026-08-02 13:46:55 -07:00

cache.py

Add NVFP4 KV 4-over-6 scale search (#45187)

2026-08-07 13:22:27 -07:00

compilation.py

[Perf] Raise Blackwell CUDA graph capture default to 1024 (#49390)

2026-08-07 15:18:14 -04:00

device.py

platforms: add uses_cpu_device() hook to Platform for DeviceConfig (#42313)

2026-05-12 12:39:17 -07:00

diffusion.py

[Model] Add DiffusionGemma Support (#45163)

2026-06-11 22:17:35 -07:00

ec_manager_config.py

Encoder cache extension hooks (#48218)

2026-07-24 02:52:00 -07:00

ec_transfer.py

[EPD] Remove duplicate image preprocessing in EPD and enable preprocess on GPU (#50390)

2026-08-05 15:59:54 -07:00

fault_tolerance.py

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

kernel.py

[Kernel] TD operand loads for batched MoE GEMM (moe_mmk) on XPU (#46340)

2026-07-26 08:50:07 +08:00

kv_events.py

[Mypy] Better fixes for the mypy issues in vllm/config (#37902)

2026-03-25 06:14:43 -07:00

kv_transfer.py

[Connector] Remove P2pNcclConnector (#44854)

2026-06-08 18:58:29 +08:00

load.py

[Bugfix][Config] Keep pydantic validation for fields with a TYPE_CHECKING Literal alias (#46220)

2026-06-24 12:25:50 +00:00

lora.py

[Model] Add Inkling LoRA support [4/N] (#48884)

2026-07-17 09:52:15 +08:00

mamba.py

[Kernel] Add support for Flashinfer Mamba SSU algorithm selection (#50157)

2026-08-04 09:40:23 -07:00

model_arch.py

[R3] Unify routed expert shape configuration (#50940)

2026-08-04 20:20:41 -07:00

model.py

[Bugfix] Skip fetching revision for model when model and weights_model are different (#51260)

2026-08-07 12:55:50 +00:00

multimodal.py

[Model] Fused mm preprocess normalisation on the Device (#50411)

2026-08-06 03:11:14 -07:00

observability.py

[Feat] Add runtime monitor for post-warmup CuTeDSL compilation (#46167)

2026-06-23 23:33:17 +00:00

offload.py

[offloader] v2: Hide weight onloading latency via prefetching (#29941)

2026-02-25 17:20:59 -08:00

parallel.py

[BugFix] Dense multinode DP rescope with regression test (#49212)

2026-08-05 18:12:03 -07:00

pooler.py

[Bugfix] Reject removed pooling parameters (#48984)

2026-07-19 05:18:03 -07:00

profiler.py

[Hardware][GPU] Profiler config additional to increase it scope and annotation details (#37524)

2026-07-17 13:38:59 -07:00

quantization.py

[Online quantization] Add online MXFP4 quantization support (#49347)

2026-08-07 12:39:46 -07:00

reasoning.py

[Feat] Support thinking_token_budget in Model Runner V2 (#46727)

2026-08-07 03:36:18 +00:00

scheduler.py

[Misc] Remove old now unsupported max_num_partial_prefills and max_long_partial_prefills (#49244)

2026-07-21 08:52:52 +00:00

speculative.py

Interns2mobius support (#51149)

2026-08-06 10:39:35 +00:00

speech_to_text.py

support hotwords for FunASR model (#39674)

2026-04-22 02:25:06 -07:00

structured_outputs.py

Remove unused disable_fallback field (#36546)

2026-03-09 20:56:54 -07:00

utils.py

[UX] Reject incompatible nested runtime overrides (#49247)

2026-07-24 07:16:22 -07:00

vllm.py

Add NVFP4 KV 4-over-6 scale search (#45187)

2026-08-07 13:22:27 -07:00

weight_transfer.py

Weight sync refactor + move sparse nccl engine (#44353)

2026-07-01 01:25:19 -07:00