vLLM/vllm/model_executor/models at ef014bdf06d4fd468e2bcef63aed98bddaeda123 - vLLM

transformers

feat: Add video support for the Transformers backend (#57441 )

2026-10-05 00:51:15 -07:00

__init__.py

[Bugfix][Model Runner V2] Restore multimodal draft capability detection (#50417 )

2026-08-03 14:18:14 -07:00

adapters.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

afmoe.py

[MoE] Use GateLinear for all MoE models (#58234 )

2026-09-23 05:40:13 +00:00

aimv2.py

[Mypy] Fix mypy typing for N/O models (#54142 )

2026-09-18 12:50:01 +01:00

apertus.py

[Model] Remove ten deprecated model architectures (#53608 )

2026-08-24 17:06:00 -07:00

aria.py

fix: return loaded parameters in Aria load_weights (#57476 )

2026-09-29 04:05:07 +00:00

audioflamingo3.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

AXK1.py

[MoE] Use GateLinear for all MoE models (#58234 )

2026-09-23 05:40:13 +00:00

bagel.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

bailing_moe_linear.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

bailing_moe_mtp.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

bailing_moe_v3_mtp.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

bailing_moe_v3_vl.py

[LoRA] Code cleanup (#60017 )

2026-10-05 09:15:53 +00:00

bailing_moe_v3.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

bailing_moe.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

bee.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

bert_with_rope.py

[Model] Migrate Glm, Arcee, CWM and Mellum to the Transformers modeling backend (#59679 )

2026-10-02 03:15:14 +00:00

bert.py

[Model] Make the BERT/RoBERTa embedding class a class attribute (#59348 )

2026-09-30 08:57:21 +00:00

blip2.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

blip.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

bloom.py

Fix weight tying (#51665 )

2026-08-20 10:31:55 +00:00

chatglm.py

[Mypy] Fix mypy typing for model interfaces and H/I models (#54079 )

2026-08-28 16:49:19 -04:00

clip.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

cohere2_moe.py

[MoE] Use GateLinear for all MoE models (#58234 )

2026-09-23 05:40:13 +00:00

cohere2_vision.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

cohere_asr.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

cohere_compass.py

[LoRA] Code cleanup (#60017 )

2026-10-05 09:15:53 +00:00

cohere_eagle.py

Reduce AutoWeightsLoader kwargs (#53106 )

2026-08-20 15:40:11 +00:00

colbert.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

colmodernvbert.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

colpali.py

[MM] Further cleanup _apply_hf_processor_main (#53610 )

2026-09-16 10:21:00 -07:00

colqwen3_5.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

colqwen3.py

[Model] Extend device-side mm normalization to Qwen3VL/Qwen3.5/Qwen4Next (#51289 )

2026-09-29 11:44:54 +08:00

commandr.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

config.py

[Model] Support EmbeddingGemma2 multimodal pooling architecture (#60254 )

2026-10-06 13:43:38 -04:00

conformer_encoder.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

cosmos3_edge.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

cosmos3.py

Cosmos3 FP8 ModelOpt/Diffusers remapping (#48952 )

2026-07-20 11:31:48 -07:00

dbrx.py

[MoE] Use GateLinear for all MoE models (#58234 )

2026-09-23 05:40:13 +00:00

deepencoder2.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

deepencoder.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

deepseek_eagle3.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

deepseek_eagle.py

Reduce AutoWeightsLoader kwargs (#53106 )

2026-08-20 15:40:11 +00:00

deepseek_mtp.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

deepseek_ocr2.py

[Security] Accept zero-sum DeepSeek-OCR pixel tensors (#59417 )

2026-10-02 09:17:12 +00:00

deepseek_ocr.py

[Security] Accept zero-sum DeepSeek-OCR pixel tensors (#59417 )

2026-10-02 09:17:12 +00:00

deepseek_v2.py

[KV-Offloading][TP] : Expand replicated_layout detection to multi-group MLA (#57652 )

2026-09-30 09:11:03 -04:00

deepseek_vl2.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

diffusion_gemma_sampler.py

[Perf] DiffusionGemma: one-pass sampler statistics kernel (#58226 )

2026-09-25 14:14:55 -04:00

diffusion_gemma.py

[Bugfix][DiffusionGemma] Read the causal mask as int32 and compile the sample step (#59992 )

2026-10-06 19:25:51 +08:00

dots_ocr.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

eagle2_5_vl.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

embedding_gemma2.py

[Bugfix][Model] Fix mypy safe-super error in EmbeddingGemma2Model (#60280 )

2026-10-06 15:10:00 -04:00

ernie45_moe.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

ernie45_vl_moe.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

ernie45_vl.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

ernie45.py

…

ernie_mtp.py

Fix weight tying (#51665 )

2026-08-20 10:31:55 +00:00

exaone4_5_mtp.py

[Mypy Fix] Mypy fix for "vllm/model_executor/models/[eE][fF]" (#53381 )

2026-08-22 15:41:27 -04:00

exaone4_5.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

exaone4.py

Fix weight tying (#51665 )

2026-08-20 10:31:55 +00:00

exaone_moe_mtp.py

[Mypy Fix] Mypy fix for "vllm/model_executor/models/[eE][fF]" (#53381 )

2026-08-22 15:41:27 -04:00

exaone_moe.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

exaone.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

extract_hidden_states.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

falcon_h1.py

[Bugfix] Fix Mamba page size AssertionError with spec decoding on GraniteMoeHybrid, FalconH1 and Zamba2 (#59975 )

2026-10-05 12:49:47 +00:00

falcon.py

[Mypy Fix] Mypy fix for "vllm/model_executor/models/[eE][fF]" (#53381 )

2026-08-22 15:41:27 -04:00

fireredasr2.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

funasr.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

funaudiochat.py

[Bugfix] Use the correct repository revision for secondary artifact loaders (#57461 )

2026-09-28 14:25:40 +00:00

gemma2.py

Fix weight tying (#51665 )

2026-08-20 10:31:55 +00:00

gemma3_mm.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

gemma3.py

Fix weight tying (#51665 )

2026-08-20 10:31:55 +00:00

gemma3n_audio_utils.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

gemma3n_mm.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

gemma3n.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

gemma4_dspark.py

[Spec Decode] Enable Gemma4 DSpark adaptive verification with FlashInfer (#57263 )

2026-09-26 17:01:17 +08:00

gemma4_mm.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

gemma4_mtp.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

gemma4_unified.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

gemma4.py

[Bugfix][Model] Gemma4: register aliased embedding scalars as buffers (#54213 )

2026-09-28 10:56:31 +00:00

gemma.py

[Mypy] Fix mypy typing for model interfaces and H/I models (#54079 )

2026-08-28 16:49:19 -04:00

glm4_1v.py

[Model] Extend device-side mm normalization to GLM4V/GLM5Next (#55389 )

2026-09-30 15:44:46 +08:00

glm4_moe_lite_mtp.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

glm4_moe_lite.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781 )

2026-09-12 00:36:47 -04:00

glm4_moe_mtp.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

glm4_moe.py

[MoE] Use GateLinear for all MoE models (#58234 )

2026-09-23 05:40:13 +00:00

glm4.py

Reduce AutoWeightsLoader kwargs (#53106 )

2026-08-20 15:40:11 +00:00

glm4v.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

glm_ocr_mtp.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

glm_ocr.py

[Model] Extend device-side mm normalization to GLM4V/GLM5Next (#55389 )

2026-09-30 15:44:46 +08:00

glmasr_utils.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

glmasr.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

gpt2.py

[XPU] Dispatch nn.LayerNorm to fused SYCL kernel via CustomOp (#57172 )

2026-09-30 12:19:33 +00:00

gpt_j.py

[XPU] Dispatch nn.LayerNorm to fused SYCL kernel via CustomOp (#57172 )

2026-09-30 12:19:33 +00:00

gpt_oss.py

[CPU][Zen] Add DA8W4 (W4A8) int4 support for dense and MoE layers (#54024 )

2026-10-01 15:18:25 +08:00

granite4_vision.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

granite_speech_plus.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

granite_speech.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

granite.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

granitemoe.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

granitemoehybrid.py

[Bugfix] Fix Mamba page size AssertionError with spec decoding on GraniteMoeHybrid, FalconH1 and Zamba2 (#59975 )

2026-10-05 12:49:47 +00:00

granitemoeshared.py

Fix weight tying (#51665 )

2026-08-20 10:31:55 +00:00

h2ovl.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

hrm_text.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

hy_v3_mtp.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

hy_v3.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

hyperclovax_vision_v2.py

[MM] Move get_dummy_processor_inputs into MM processor (#57967 )

2026-09-21 09:39:20 -07:00

hyperclovax.py

Fix weight tying (#51665 )

2026-08-20 10:31:55 +00:00

idefics2_vision_model.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

idefics3.py

[Bugfix] Count unsplit Idefics3 image patches (#48760 )

2026-09-24 11:36:26 -07:00

interfaces_base.py

[Mypy] Fix mypy typing for model interfaces and H/I models (#54079 )

2026-08-28 16:49:19 -04:00

interfaces.py

[LoRA] Code cleanup (#60017 )

2026-10-05 09:15:53 +00:00

intern_vit.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

internlm2.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

interns1_pro.py

[Model] Extend device-side mm normalization to Qwen3VL/Qwen3.5/Qwen4Next (#51289 )

2026-09-29 11:44:54 +08:00

interns1_vit.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

interns1.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

interns2_mobius.py

[Core] Remove deprecated mamba_cache_mode "all" (#58997 )

2026-10-01 02:59:37 -07:00

interns2_preview.py

Reduce AutoWeightsLoader kwargs (#53106 )

2026-08-20 15:40:11 +00:00

internvl.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

iquest_loopcoder.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

isaac.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

jamba.py

[MoE] Use GateLinear for all MoE models (#58234 )

2026-09-23 05:40:13 +00:00

jina_vl.py

[MM] Further cleanup _apply_hf_processor_main (#53610 )

2026-09-16 10:21:00 -07:00

jina.py

[Mypy] Fix typing for J models (#54130 )

2026-08-29 08:50:15 -04:00

k2_horizon.py

[MyPy] Fix mypy errors in vllm/model_executor/models/[kK]* (#59402 )

2026-10-01 19:32:27 +00:00

kanana_v.py

[MyPy] Fix mypy errors in vllm/model_executor/models/[kK]* (#59402 )

2026-10-01 19:32:27 +00:00

keye_vl1_5.py

[MyPy] Fix mypy errors in vllm/model_executor/models/[kK]* (#59402 )

2026-10-01 19:32:27 +00:00

keye.py

[MyPy] Fix mypy errors in vllm/model_executor/models/[kK]* (#59402 )

2026-10-01 19:32:27 +00:00

kimi_audio.py

[MyPy] Fix mypy errors in vllm/model_executor/models/[kK]* (#59402 )

2026-10-01 19:32:27 +00:00

kimi_k25_vit.py

[Model] Extend device-side mm normalization to Kimi K2.5 / K3 (#59278 )

2026-10-05 21:28:13 +08:00

kimi_k25.py

[Model] Extend device-side mm normalization to Kimi K2.5 / K3 (#59278 )

2026-10-05 21:28:13 +08:00

kimi_vl.py

[MyPy] Fix mypy errors in vllm/model_executor/models/[kK]* (#59402 )

2026-10-01 19:32:27 +00:00

laguna_dflash.py

[Core][MRV2] Support eagle3 spec decode with pipeline parallel (#50514 )

2026-09-05 11:45:34 +08:00

laguna.py

[MoE] Use GateLinear for all MoE models (#58234 )

2026-09-23 05:40:13 +00:00

lfm2_moe.py

[Core] Remove deprecated mamba_cache_mode "all" (#58997 )

2026-10-01 02:59:37 -07:00

lfm2_siglip2.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

lfm2_vl.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

lfm2.py

[Core] Remove deprecated mamba_cache_mode "all" (#58997 )

2026-10-01 02:59:37 -07:00

lightonocr.py

[CI] Bump Transformers version to 5.18.0 (#59621 )

2026-10-04 00:42:35 +00:00

lilicorr.py

[SpecDecode] Add LiLiCorr drafter (#57934 )

2026-09-25 10:08:28 -04:00

llama4_eagle.py

[Mypy] Fix mypy typing for L models (#54177 )

2026-09-04 07:50:43 -04:00

llama4.py

[MoE] Use GateLinear for all MoE models (#58234 )

2026-09-23 05:40:13 +00:00

llama_eagle3.py

[Bugfix][Spec Decode] Only create draft_id_to_target_id when draft vocab differs (#53458 )

2026-09-15 14:59:02 +00:00

llama_eagle.py

[Mypy] Fix mypy typing for L models (#54177 )

2026-09-04 07:50:43 -04:00

llama.py

[Core][MRV2] Support eagle3 spec decode with pipeline parallel (#50514 )

2026-09-05 11:45:34 +08:00

llava_next_video.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

llava_next.py

[MM] Further cleanup _apply_hf_processor_main (#53610 )

2026-09-16 10:21:00 -07:00

llava_onevision2.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

llava_onevision.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

llava.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

longcat_flash_mtp.py

[Model] LongCat-Flash: scale MLA norms while loading and drop the post-load sweep (#60080 )

2026-10-06 08:47:02 +00:00

longcat_flash_ngram.py

[CI] Bump Transformers version to 5.18.0 (#59621 )

2026-10-04 00:42:35 +00:00

longcat_flash.py

[Model] LongCat-Flash: scale MLA norms while loading and drop the post-load sweep (#60080 )

2026-10-06 08:47:02 +00:00

mamba2.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

mamba.py

[Mypy] Fix typing for M models (#54262 )

2026-09-01 11:26:00 -04:00

medusa.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

midashenglm.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

mimo_audio.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

mimo_mtp.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

mimo_v2_mtp.py

[Attention][Model] FP8 KV cache for Triton DiffKV and MiMo-V2.6-Flash (#58128 )

2026-10-05 21:18:29 -07:00

mimo_v2_omni.py

[Bugfix][MiMo] Declare embedding_fields so an EPD pair can serve images (#58938 )

2026-09-29 23:33:01 +08:00

mimo_v2.py

[Attention][Model] FP8 KV cache for Triton DiffKV and MiMo-V2.6-Flash (#58128 )

2026-10-05 21:18:29 -07:00

mimo.py

[Core][MRV2] Support eagle3 spec decode with pipeline parallel (#50514 )

2026-09-05 11:45:34 +08:00

minicpm3.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

minicpm_eagle.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

minicpm.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

minicpmo.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

minicpmv4_6.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

minicpmv.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

minimax_m2.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

mistral3.py

[Misc] Remove code paths for Transformers < 5.16.1 (#59762 )

2026-10-02 11:17:24 +00:00

mistral_eagle.py

[Mypy] Fix typing for M models (#54262 )

2026-09-01 11:26:00 -04:00

mistral_large_3_eagle.py

[Mypy] Fix typing for M models (#54262 )

2026-09-01 11:26:00 -04:00

mistral_large_3.py

[MISC] Cleanup deprecated parameters (#53559 )

2026-08-24 10:19:04 -07:00

mistral.py

[Mypy] Fix typing for M models (#54262 )

2026-09-01 11:26:00 -04:00

mixtral.py

[MoE] Use GateLinear for all MoE models (#58234 )

2026-09-23 05:40:13 +00:00

mllama4.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

mlp_speculator.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

modernbert.py

[Pooling] Preserve BERT-family heads for raw logits (#57664 )

2026-09-25 19:10:14 -04:00

module_mapping.py

[Mypy] Fix typing for M models (#54262 )

2026-09-01 11:26:00 -04:00

molmo2.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

molmo.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

moondream3.py

[MoE] Use GateLinear for all MoE models (#58234 )

2026-09-23 05:40:13 +00:00

moonvit.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

moss_audio.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

moss_transcribe_diarize.py

[MM] Move get_dummy_processor_inputs into MM processor (#57967 )

2026-09-21 09:39:20 -07:00

muse_glimmer.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

nano_nemotron_vl.py

[SpecDecode] Add LiLiCorr drafter (#57934 )

2026-09-25 10:08:28 -04:00

nemotron_h_mtp.py

[Bugfix] Load stacked expert weights for non-gated MoE (#59031 )

2026-10-05 15:26:55 +03:00

nemotron_h.py

[Bugfix] Load stacked expert weights for non-gated MoE (#59031 )

2026-10-05 15:26:55 +03:00

nemotron_nas.py

Fix weight tying (#51665 )

2026-08-20 10:31:55 +00:00

nemotron_parse.py

Revert "[Bugfix] Tie lm_head.weight for Nemotron Parse when checkpoint omits it" (#53020 ) (#59805 )

2026-10-02 10:19:25 -07:00

nemotron_vl.py

[MM] Enable device normalization for Llama Nemotron VL Embed/Rerank (#57928 )

2026-09-29 08:33:52 +00:00

nemotron.py

[XPU] Dispatch nn.LayerNorm to fused SYCL kernel via CustomOp (#57172 )

2026-09-30 12:19:33 +00:00

nvlm_d.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

olmo_hybrid.py

[Mypy] Fix mypy typing for N/O models (#54142 )

2026-09-18 12:50:01 +01:00

olmoe.py

[MoE] Use GateLinear for all MoE models (#58234 )

2026-09-23 05:40:13 +00:00

openai_privacy_filter.py

[Model] Add support for openai/privacy-filter (#41026 )

2026-06-28 16:18:22 -07:00

opencua.py

[Mypy] Fix mypy typing for N/O models (#54142 )

2026-09-18 12:50:01 +01:00

openpangu_mtp.py

[Mypy] Fix mypy typing for N/O models (#54142 )

2026-09-18 12:50:01 +01:00

openpangu_vl.py

[Bugfix] Fix the two multimodal root tests that fail on main (OpenPangu-VL embed merge, MiMo sink test fixture) (#58900 )

2026-09-28 04:52:51 +00:00

openpangu.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

openvla.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

opt.py

[XPU] Dispatch nn.LayerNorm to fused SYCL kernel via CustomOp (#57172 )

2026-09-30 12:19:33 +00:00

orion.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

ovis2_5.py

[BUGFIX] fix ovis2_5 multimodal tokens (#52623 )

2026-09-25 07:18:54 +08:00

ovis.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

paddleocr_vl.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

paligemma.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

parakeet.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

param2moe.py

[MoE] Use GateLinear for all MoE models (#58234 )

2026-09-23 05:40:13 +00:00

phi3.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

phi3v.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

phi4mm_audio.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

phi4mm_utils.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

phi4mm.py

[Mypy] Fix mypy typing for Ultravox and Unlimited-OCR models (#58239 )

2026-09-27 21:19:04 -04:00

phi4siglip.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

phimoe.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

pixtral.py

[MM][Mistral] Add compile support for Pixtral vision encoders (#57168 )

2026-09-30 20:27:12 +08:00

plamo3.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

qianfan_ocr.py

[Mypy] Fix mypy typing for Qwen and Qianfan models (#58046 )

2026-09-26 14:31:51 +00:00

qwen2_5_omni_thinker.py

[Mypy] Fix mypy typing for Qwen and Qianfan models (#58046 )

2026-09-26 14:31:51 +00:00

qwen2_5_vl.py

[Multimodal] Avoid extra d2d for encoder cudagraph with fused input norm (#56711 )

2026-09-28 21:04:01 +08:00

qwen2_audio.py

[Mypy] Fix mypy typing for Qwen and Qianfan models (#58046 )

2026-09-26 14:31:51 +00:00

qwen2_moe.py

[Mypy] Fix mypy typing for Qwen and Qianfan models (#58046 )

2026-09-26 14:31:51 +00:00

qwen2_rm.py

Remove unnecessary load_weights methods (#44589 )

2026-06-29 01:52:23 -07:00

qwen2_vl.py

[Bugfix][Multimodal] Fix flat/scoped mm_processor_kwargs merge and resolution (#56372 )

2026-09-29 03:58:39 +00:00

qwen2.py

[Mypy] Fix mypy typing for Qwen and Qianfan models (#58046 )

2026-09-26 14:31:51 +00:00

qwen3_5_mtp.py

[Core] Remove deprecated mamba_cache_mode "all" (#58997 )

2026-10-01 02:59:37 -07:00

qwen3_5.py

[Core] Remove deprecated mamba_cache_mode "all" (#58997 )

2026-10-01 02:59:37 -07:00

qwen3_asr_forced_aligner.py

[Mypy] Fix mypy typing for Qwen and Qianfan models (#58046 )

2026-09-26 14:31:51 +00:00

qwen3_asr_realtime.py

[Mypy] Fix mypy typing for Qwen and Qianfan models (#58046 )

2026-09-26 14:31:51 +00:00

qwen3_asr.py

[Model] Declare SupportsEagle3 on Qwen3ASRForConditionalGeneration (#52824 )

2026-10-05 09:23:47 +00:00

qwen3_dflash2.py

[SpecDecode] Add LiLiCorr drafter (#57934 )

2026-09-25 10:08:28 -04:00

qwen3_dflash.py

[ROCM][Perf] Add ROCM_SEGMENTED_ATTN attention-backend works across RDNA3/3.5/4 (#59132 )

2026-10-06 07:53:47 +00:00

qwen3_dspark.py

[Mypy] Fix mypy typing for Qwen and Qianfan models (#58046 )

2026-09-26 14:31:51 +00:00

qwen3_eagle3.py

[Mypy] Fix mypy typing for Qwen and Qianfan models (#58046 )

2026-09-26 14:31:51 +00:00

qwen3_moe.py

[Mypy] Fix mypy typing for Qwen and Qianfan models (#58046 )

2026-09-26 14:31:51 +00:00

qwen3_next_mtp.py

[Core] Remove deprecated mamba_cache_mode "all" (#58997 )

2026-10-01 02:59:37 -07:00

qwen3_next.py

[Core] Remove deprecated mamba_cache_mode "all" (#58997 )

2026-10-01 02:59:37 -07:00

qwen3_omni_moe_thinker.py

[Bugfix][Model] Fix Qwen3-Omni interleaved M-RoPE boundary positions (#59842 )

2026-10-06 03:35:53 +00:00

qwen3_vl_moe.py

[Model] Extend device-side mm normalization to Qwen3VL/Qwen3.5/Qwen4Next (#51289 )

2026-09-29 11:44:54 +08:00

qwen3_vl.py

[Bugfix][Multimodal] Fix flat/scoped mm_processor_kwargs merge and resolution (#56372 )

2026-09-29 03:58:39 +00:00

qwen3.py

[Mypy] Fix mypy typing for Qwen and Qianfan models (#58046 )

2026-09-26 14:31:51 +00:00

radio.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

registry.py

[Model] Support EmbeddingGemma2 multimodal pooling architecture (#60254 )

2026-10-06 13:43:38 -04:00

rnj1.py

Fix weight tying (#51665 )

2026-08-20 10:31:55 +00:00

roberta.py

[Model] Make the BERT/RoBERTa embedding class a class attribute (#59348 )

2026-09-30 08:57:21 +00:00

rvl.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

sarvam.py

[Model][Spec Decode] Enable EAGLE3/DSpark pipeline parallelism for Sarvam MLA (#55902 )

2026-10-02 04:28:19 +00:00

siglip2navit.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

siglip.py

[XPU] Dispatch nn.LayerNorm to fused SYCL kernel via CustomOp (#57172 )

2026-09-30 12:19:33 +00:00

skyworkr1v.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

smolvlm.py

[Bugfix] Standardize getting number of image patches/tokens (#34358 )

2026-02-12 20:47:01 -08:00

solar.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

stablelm.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

step1.py

Remove unnecessary load_weights methods (#44589 )

2026-06-29 01:52:23 -07:00

step3_text.py

[MoE] Use GateLinear for all MoE models (#58234 )

2026-09-23 05:40:13 +00:00

step3_vl.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

step3p5_mtp.py

[Bugfix][Spec Decode] Per-module LM heads for multi-layer MTP on Model Runner V2 (#58921 )

2026-10-01 01:09:14 -07:00

step3p5.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550 )

2026-09-24 14:14:10 +00:00

step3p7.py

[Mypy] Fix typing for R/S models (#54157 )

2026-09-10 09:43:08 -04:00

step_vl.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

telechat2.py

[Mypy Fix] Mypy fix for "vllm/model_executor/models/[tT]" (#53466 )

2026-08-26 14:12:11 +00:00

teleflm.py

[Refactor] Remove dead code multiple places (#58002 )

2026-09-22 16:36:03 -04:00

terratorch.py

[Multimodal] Type dummy options per modality (#57576 )

2026-09-18 17:29:11 +01:00

ultravox.py

[Mypy] Fix mypy typing for Ultravox and Unlimited-OCR models (#58239 )

2026-09-27 21:19:04 -04:00

unlimited_ocr.py

[Mypy] Fix mypy typing for Ultravox and Unlimited-OCR models (#58239 )

2026-09-27 21:19:04 -04:00

utils.py

[weight loader] add dtype equality validation between parameter and weight (#51792 )

2026-10-01 03:07:31 +00:00

vision.py

[Mypy] Fix mypy typing for Voxtral and vision models (#58251 )

2026-09-28 15:52:50 -04:00

voxtral_realtime.py

[Mypy] Fix mypy typing for Voxtral and vision models (#58251 )

2026-09-28 15:52:50 -04:00

voxtral.py

[Mypy] Fix mypy typing for Voxtral and vision models (#58251 )

2026-09-28 15:52:50 -04:00

voyage.py

[Model][LoRA] Enable LoRA support for VoyageQwen3BidirectionalEmbedModel (#57708 )

2026-09-20 09:50:00 +00:00

whisper_causal.py

[Mypy] Fix mypy typing for Whisper models (#58254 )

2026-09-29 17:10:28 +01:00

whisper_utils.py

…

whisper.py

[CPU][Whisper] Support W4A16 quantized Whisper on the CPU WNA16 kernel (#58268 )

2026-09-30 13:52:53 +08:00

zamba2.py

[Bugfix] Fix Mamba page size AssertionError with spec decoding on GraniteMoeHybrid, FalconH1 and Zamba2 (#59975 )

2026-10-05 12:49:47 +00:00