meena-at-workandClaude Sonnet 4.6 363fc84407 Integrate flashinfer b12x MoE and FP4 GEMM kernels for SM120/121 (#40082) ...

Signed-off-by: Meenakshi Venkataraman <meenakshiv@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-05-20 17:21:11 +00:00

..

__init__.py

[Audio] Bundle get_generation_prompt() params into SpeechToTextParams (#36268)

2026-04-22 12:24:18 +08:00

attention.py

[Attention] Remove deprecated MLA prefill arguments (#42555)

2026-05-14 10:34:06 -07:00

cache.py

Support bf16 for mamba ssm cache (#41680)

2026-05-16 17:54:58 -07:00

compilation.py

[Fix] Misc Fixes in ViT CUDA Graph (#38040)

2026-05-14 23:49:06 +08:00

device.py

platforms: add uses_cpu_device() hook to Platform for DeviceConfig (#42313)

2026-05-12 12:39:17 -07:00

ec_transfer.py

[Misc] Introduce ec_both role EC (encoder cache) connector (#34182)

2026-02-10 18:55:35 +00:00

kernel.py

Integrate flashinfer b12x MoE and FP4 GEMM kernels for SM120/121 (#40082)

2026-05-20 17:21:11 +00:00

kv_events.py

[Mypy] Better fixes for the mypy issues in vllm/config (#37902)

2026-03-25 06:14:43 -07:00

kv_transfer.py

[Misc] Set default kv_buffer_device in a better way (#36862)

2026-03-13 19:07:33 +00:00

load.py

[Performance] Make safetensors checkpoint prefetch settings configurable (#41499)

2026-05-10 15:55:15 +00:00

lora.py

[LoRA] Support 2D and 3D MoE LoRA adapter at the same time (#42242)

2026-05-18 15:22:26 +08:00

mamba.py

[Mamba] Flashinfer selective_state_update (#36162)

2026-04-14 15:10:58 -04:00

model_arch.py

[Misc] use model arch converter for bidi models identification (#40701)

2026-04-23 13:42:52 +00:00

model.py

[Feature] Support manually enabling the cumem allocator (#33648)

2026-05-20 08:58:30 -04:00

multimodal.py

[Perf] FP8 FlashInfer Attn for ViT (#38065)

2026-04-27 13:44:15 +08:00

observability.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

offload.py

[offloader] v2: Hide weight onloading latency via prefetching (#29941)

2026-02-25 17:20:59 -08:00

parallel.py

[Bug] Fix status update address for non-MOE model within external dp mode (#40839)

2026-05-04 16:37:16 -07:00

pooler.py

feat: rename logit_bias/logit_scale to logit_mean/logit_sigma for affine score calibration (#39530)

2026-04-13 04:43:44 +00:00

profiler.py

Remove need for explicit \n in docstring lists for --help formatting (#38350)

2026-03-27 08:38:00 -07:00

quantization.py

[Quantization] Rework quantization_config to use QuantKey and allow for activation override (#41566)

2026-05-13 16:58:32 -04:00

reasoning.py

[Feature] Add auto-detection for reasoning_config when only reasoning_parser is set (#38214)

2026-04-10 01:36:26 +00:00

scheduler.py

[Refactor] Clean up log once scope="local" (#40540)

2026-04-22 16:42:43 -04:00

speculative.py

[Model] Support InternS2 Preview (#42705)

2026-05-14 21:30:26 -07:00

speech_to_text.py

support hotwords for FunASR model (#39674)

2026-04-22 02:25:06 -07:00

structured_outputs.py

Remove unused disable_fallback field (#36546)

2026-03-09 20:56:54 -07:00

utils.py

Remove need for explicit \n in docstring lists for --help formatting (#38350)

2026-03-27 08:38:00 -07:00

vllm.py

[Feature] Support manually enabling the cumem allocator (#33648)

2026-05-20 08:58:30 -04:00

weight_transfer.py

[bug] fix WeightTransferConfig.backend to allow for all strings (#43121)

2026-05-19 21:01:29 -04:00