liangel-02 6b5c389ee3 expose flex block size for batch invariant mode (#41252) ...

Signed-off-by: Angel Li <liangel@meta.com>

2026-05-13 14:11:57 -07:00

..

__init__.py

[Audio] Bundle get_generation_prompt() params into SpeechToTextParams (#36268)

2026-04-22 12:24:18 +08:00

attention.py

expose flex block size for batch invariant mode (#41252)

2026-05-13 14:11:57 -07:00

cache.py

[Feat] DeepSeek V4 Rebased (#40860)

2026-04-26 18:31:08 -07:00

compilation.py

[Performance][DSR1]: Fused RoPE+KVCache+q_concat for MLA (#40392)

2026-05-11 14:10:50 +00:00

device.py

platforms: add uses_cpu_device() hook to Platform for DeviceConfig (#42313)

2026-05-12 12:39:17 -07:00

ec_transfer.py

[Misc] Introduce ec_both role EC (encoder cache) connector (#34182)

2026-02-10 18:55:35 +00:00

kernel.py

[Model Runner V2] support qwen35 / mamba hybrid model (#35520)

2026-05-07 09:31:05 -07:00

kv_events.py

[Mypy] Better fixes for the mypy issues in vllm/config (#37902)

2026-03-25 06:14:43 -07:00

kv_transfer.py

[Misc] Set default kv_buffer_device in a better way (#36862)

2026-03-13 19:07:33 +00:00

load.py

[Performance] Make safetensors checkpoint prefetch settings configurable (#41499)

2026-05-10 15:55:15 +00:00

lora.py

[LoRA] Support dual CUDA streams-Linear Layer (#35721)

2026-04-13 10:57:07 +08:00

mamba.py

[Mamba] Flashinfer selective_state_update (#36162)

2026-04-14 15:10:58 -04:00

model_arch.py

[Misc] use model arch converter for bidi models identification (#40701)

2026-04-23 13:42:52 +00:00

model.py

[Quantization] Rework quantization_config to use QuantKey and allow for activation override (#41566)

2026-05-13 16:58:32 -04:00

multimodal.py

[Perf] FP8 FlashInfer Attn for ViT (#38065)

2026-04-27 13:44:15 +08:00

observability.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

offload.py

[offloader] v2: Hide weight onloading latency via prefetching (#29941)

2026-02-25 17:20:59 -08:00

parallel.py

[Bug] Fix status update address for non-MOE model within external dp mode (#40839)

2026-05-04 16:37:16 -07:00

pooler.py

feat: rename logit_bias/logit_scale to logit_mean/logit_sigma for affine score calibration (#39530)

2026-04-13 04:43:44 +00:00

profiler.py

Remove need for explicit \n in docstring lists for --help formatting (#38350)

2026-03-27 08:38:00 -07:00

quantization.py

[Quantization] Rework quantization_config to use QuantKey and allow for activation override (#41566)

2026-05-13 16:58:32 -04:00

reasoning.py

[Feature] Add auto-detection for reasoning_config when only reasoning_parser is set (#38214)

2026-04-10 01:36:26 +00:00

scheduler.py

[Refactor] Clean up log once scope="local" (#40540)

2026-04-22 16:42:43 -04:00

speculative.py

Remove verifier model type check in speculative config (#42536)

2026-05-13 18:14:39 +00:00

speech_to_text.py

support hotwords for FunASR model (#39674)

2026-04-22 02:25:06 -07:00

structured_outputs.py

Remove unused disable_fallback field (#36546)

2026-03-09 20:56:54 -07:00

utils.py

Remove need for explicit \n in docstring lists for --help formatting (#38350)

2026-03-27 08:38:00 -07:00

vllm.py

[Spec Decode] Support hybrid attention models in extract_hidden_states (#39949)

2026-05-13 10:45:53 -07:00

weight_transfer.py

[Feat][RL][2/2] Native Weight Syncing API: IPC (#34171)

2026-02-27 13:45:21 -07:00