3 people 85b3a7264b [Bugfix][Model Runner V2] Order uniform decodes first so spec decodes aren't misclassified as prefills (#47381) ...

Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

2026-07-09 14:26:27 +01:00

..

transformers

Fix embed scaling + CUDA graphs in Transformers modelling backend (#48010)

2026-07-09 00:14:33 +01:00

__init__.py

…

adapters.py

[Bugfix][Pooling] Fix silent weight corruption with buffer-reusing iterators (#39650)

2026-04-13 19:37:27 +00:00

afmoe.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

aimv2.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

apertus.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

arcee.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

arctic.py

[MoE] Remove inplace fused experts mechanism (#43727)

2026-05-27 20:00:19 -07:00

aria.py

[Bugfix] Fix weight loading issues caused by #41184 (#45054)

2026-06-10 01:20:13 -04:00

audioflamingo3.py

[ROCm][CI] Gate incompatible HF references on Transformers v5 (#41532)

2026-06-16 20:34:11 +08:00

AXK1.py

Fix Transformers backend FP8 MoE and remove some boilerplate (#46820)

2026-06-27 00:16:05 +01:00

bagel.py

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

bailing_moe_linear.py

[Feature] Support MTP speculative decoding for Bailing hybrid models (#44880)

2026-07-06 10:38:50 +08:00

bailing_moe_mtp.py

[Feature] Support MTP speculative decoding for Bailing hybrid models (#44880)

2026-07-06 10:38:50 +08:00

bailing_moe.py

[Bugfix] fix wrong partial_rotary_factor calculation for bailing_moe model. (#43770)

2026-06-01 02:42:49 -07:00

bee.py

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

bert_with_rope.py

[MoE] Remove inplace fused experts mechanism (#43727)

2026-05-27 20:00:19 -07:00

bert.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

blip2.py

[Model] Fix missing maybe_prefix (#42280)

2026-05-11 09:04:06 +00:00

blip.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

bloom.py

[5/N][Attention] Finish eliminating vllm/attention folder (#32064)

2026-01-27 10:02:51 -05:00

chameleon.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

chatglm.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

cheers.py

[Model] Add support for Cheers multimodal model (#38788)

2026-04-02 21:01:40 +08:00

clip.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

cohere2_moe.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

cohere2_vision.py

fix(quantization): Fix AWQ dequantize on Intel XPU and refactor AutoAWQ config (#42727)

2026-06-18 20:12:28 +08:00

cohere_asr.py

[Model] Fix missing maybe_prefix (#42280)

2026-05-11 09:04:06 +00:00

cohere_eagle.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

colbert.py

Model/colbert autoweightsloader (#44999)

2026-06-09 23:58:50 -07:00

colmodernvbert.py

[Model] Update ColModernVBERT to support latest HF checkpoint (#39307)

2026-04-09 10:48:51 +08:00

colpali.py

[Model] Add ColPali late interaction model for multi-modal retrieval (#36818)

2026-03-13 02:18:57 +00:00

colqwen3_5.py

[Model] ColQwen3.5: fix retrieval correctness (bias + bidirectional) (#46108)

2026-06-22 17:25:54 +08:00

colqwen3.py

[Model] Consolidate score logic by introduce score_type (#36479)

2026-03-10 13:32:25 +00:00

commandr.py

Forward fix nightly errors from #44589 (#47151)

2026-06-30 14:02:34 +00:00

config.py

Add Triton Backend for Unlimited-OCR R-SWA (#47102)

2026-07-03 00:11:50 -07:00

conformer_encoder.py

[model] support FireRedLID (#39290)

2026-04-10 08:43:58 +00:00

cosmos3.py

Add Cosmos3 Reasoner model (#43356)

2026-05-28 09:43:55 -07:00

dbrx.py

[MoE Refactor] FusedMoE/MoERunner inversion refactor (#41184)

2026-06-08 10:42:58 -04:00

deepencoder2.py

[PluggableLayer][MM] Add PluggableLayer for CustomQwen2Decoder (#37293)

2026-03-20 06:24:07 +00:00

deepencoder.py

[PluggableLayer][MM] Add PluggableLayer for RelPosAttention (#33753)

2026-03-03 19:41:27 -08:00

deepseek_eagle3.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

deepseek_eagle.py

[Model] Fix missing maybe_prefix (#42280)

2026-05-11 09:04:06 +00:00

deepseek_mtp.py

[BugFix][Spec Decode] Compact shared topk indices buffer after first MTP draft step (#47238)

2026-07-01 21:38:51 -07:00

deepseek_ocr2.py

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

deepseek_ocr.py

[Model] Support Unlimited OCR (#46564)

2026-06-27 23:09:18 -07:00

deepseek_v2.py

[Bugfix][Model Runner V2] Order uniform decodes first so spec decodes aren't misclassified as prefills (#47381)

2026-07-09 14:26:27 +01:00

deepseek_vl2.py

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

diffusion_gemma.py

[Perf] Bound DiffusionGemma sampler transient via request-tiled logits (#45672)

2026-07-07 03:42:01 +00:00

dots_ocr.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

eagle2_5_vl.py

[2/3] Refactor InternVL-based processors (#37324)

2026-03-18 22:22:19 +08:00

ernie45_moe.py

Fix Transformers backend FP8 MoE and remove some boilerplate (#46820)

2026-06-27 00:16:05 +01:00

ernie45_vl_moe.py

[MoE Refactor] FusedMoE/MoERunner inversion refactor (#41184)

2026-06-08 10:42:58 -04:00

ernie45_vl.py

[Model] Use mm_features for Ernie-4.5 VL M-RoPE (#39753)

2026-04-14 01:11:52 -07:00

ernie45.py

…

ernie_mtp.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

exaone4_5_mtp.py

Fix EXAONE-4.5 to align with Transformers update (#42246)

2026-05-11 10:25:31 +00:00

exaone4_5.py

[Bugfix] Fix missing sequence_lengths in EXAONE-4.5 vision encoder (#45073)

2026-06-10 15:44:34 +01:00

exaone4.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

exaone_moe_mtp.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

exaone_moe.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

exaone.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

extract_hidden_states.py

[Spec Decode] Fix hidden-state extraction block size for hybrid verifiers (#46301)

2026-06-30 08:19:51 -07:00

fairseq2_llama.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

falcon_h1.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

falcon.py

[Misc] Cleanup more configs and processors (#37560)

2026-03-19 15:45:23 +00:00

fireredasr2.py

[Audio] Bundle get_generation_prompt() params into SpeechToTextParams (#36268)

2026-04-22 12:24:18 +08:00

fireredlid.py

[model] support FireRedLID (#39290)

2026-04-10 08:43:58 +00:00

flex_olmo.py

[MoE Refactor] Rename FusedMoE.make_expert_params_mapping to fused_moe_make_expert_params_mapping (#40671)

2026-04-23 11:22:34 -04:00

funasr.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

funaudiochat.py

Bump Transformers version to 5.10.4 (#41359)

2026-07-07 05:13:28 -07:00

gemma2.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

gemma3_mm.py

[CI] Fix various failures on main (#47197)

2026-07-01 10:35:34 +01:00

gemma3.py

Forward fix nightly errors from #44589 (#47151)

2026-06-30 14:02:34 +00:00

gemma3n_audio_utils.py

[Bugfix] Fix integer overflow in Gemma3n audio processing (#31657)

2026-01-10 17:52:53 +08:00

gemma3n_mm.py

Deprecate Transformers v4 support (#45161)

2026-06-11 11:04:01 +08:00

gemma3n.py

Remove KV cache scale boilerplate from model weight loading methods (#43167)

2026-06-05 05:19:04 -07:00

gemma4_mm.py

[Bugfix][Gemma4] Keep image bidirectional attention within the sliding window (#47217)

2026-07-02 19:57:41 -07:00

gemma4_mtp.py

[Bugfix] [Gemma4] Fix Gemma4 MTP draft model layers ignoring quant_config (#47091)

2026-07-06 14:04:00 +01:00

gemma4_unified.py

Remove boilerplate missed by #46820 (#46956)

2026-06-29 08:11:17 +08:00

gemma4.py

[Bugfix][Gemma4] Keep image bidirectional attention within the sliding window (#47217)

2026-07-02 19:57:41 -07:00

gemma.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

glm4_1v.py

[GLM4V] Avoid GLM4V processor init during startup metadata reads (#47155)

2026-07-03 15:03:16 -07:00

glm4_moe_lite_mtp.py

Fix Transformers backend FP8 MoE and remove some boilerplate (#46820)

2026-06-27 00:16:05 +01:00

glm4_moe_lite.py

Fix Transformers backend FP8 MoE and remove some boilerplate (#46820)

2026-06-27 00:16:05 +01:00

glm4_moe_mtp.py

[ROCm][Perf] Add Fused Shared Expert (FSE) support for GLM-4.5/6/7 (#44313)

2026-06-28 00:04:08 -07:00

glm4_moe.py

[ROCm][Perf] Add Fused Shared Expert (FSE) support for GLM-4.5/6/7 (#44313)

2026-06-28 00:04:08 -07:00

glm4.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

glm4v.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

glm_ocr_mtp.py

Fix Transformers backend FP8 MoE and remove some boilerplate (#46820)

2026-06-27 00:16:05 +01:00

glm_ocr.py

[bug-fix] GLM OCR Patch Merger context_dim (#37962)

2026-03-26 05:11:21 -07:00

glm.py

…

glmasr_utils.py

[Refactor] Remove dead private func _fp8_perm and _extract_mask_for_item (#35068)

2026-02-23 05:05:20 -08:00

glmasr.py

[Audio] Bundle get_generation_prompt() params into SpeechToTextParams (#36268)

2026-04-22 12:24:18 +08:00

gpt2.py

[Bugfix][Model] Fix GPT2ForSequenceClassification sub-module prefix (#43579)

2026-05-25 22:43:19 -07:00

gpt_j.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

gpt_neox.py

[5/N][Attention] Finish eliminating vllm/attention folder (#32064)

2026-01-27 10:02:51 -05:00

gpt_oss.py

[Feature] Support sequence parallel without the need for DP, 1.9%~5.0% E2E Throughput Improvement (#47070)

2026-07-05 05:41:30 -07:00

granite4_vision.py

[Model] Fix missing maybe_prefix (#42280)

2026-05-11 09:04:06 +00:00

granite_speech_plus.py

Add model support for granite speech plus (#43519)

2026-06-04 14:47:48 +00:00

granite_speech.py

Add model support for granite speech plus (#43519)

2026-06-04 14:47:48 +00:00

granite.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

granitemoe.py

Remove KV cache scale boilerplate from model weight loading methods (#43167)

2026-06-05 05:19:04 -07:00

granitemoehybrid.py

[MoE Refactor] FusedMoE/MoERunner inversion refactor (#41184)

2026-06-08 10:42:58 -04:00

granitemoeshared.py

[Bugfix] Fix GraniteMoeShared weight loading broken by #41184 (#47031)

2026-07-01 22:39:12 +08:00

gritlm.py

[Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9% E2E throughput improvement (#38139)

2026-03-29 18:12:50 +00:00

h2ovl.py

[Model] Remove Mono-InternVL (InternLM2VEForCausalLM) (#45129)

2026-06-12 10:41:09 +00:00

hrm_text.py

[Model] Add HrmTextForCausalLM (Hierarchical Reasoning Model — Text) (#43098)

2026-06-16 22:41:41 +08:00

hunyuan_v1.py

Fix Transformers backend FP8 MoE and remove some boilerplate (#46820)

2026-06-27 00:16:05 +01:00

hunyuan_vision.py

[Model][HunyuanVL] Use native transformers processor and adapt to transformers 5.13 (#47872)

2026-07-08 07:58:23 +00:00

hy_v3_mtp.py

[Bugfix][MoE] Fix fused MoE expert mapping helper call sites (#44897)

2026-06-08 13:35:04 -07:00

hy_v3.py

[Bugfix] Allocate HY V3 expert_bias in float32 to prevent silent downcasting (#47797)

2026-07-08 11:25:53 +00:00

hyperclovax_vision_v2.py

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

hyperclovax_vision.py

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

hyperclovax.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

idefics2_vision_model.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

idefics3.py

[Perf][4/n] Eliminate various GPU<->CPU syncs (#42347)

2026-05-19 10:35:54 -04:00

interfaces_base.py

[Model] Deprecate the score task (this will not affect users). (#37537)

2026-03-20 08:07:56 +00:00

interfaces.py

[Bugfix] Fix Qwen3-ASR transcription streaming postprocessing (#42478)

2026-07-09 00:33:27 -07:00

intern_vit.py

[Model] Add torch.compile support for InternVL vision encoder (#38049)

2026-03-25 23:52:29 -07:00

internlm2.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

interns1_pro.py

Fix Transformers backend FP8 MoE and remove some boilerplate (#46820)

2026-06-27 00:16:05 +01:00

interns1_vit.py

[MM] Align the prefix of MMEncoderAttention with Attention (#33750)

2026-02-04 04:07:30 +00:00

interns1.py

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

interns2_preview.py

[Model] Support InternS2 Preview (#42705)

2026-05-14 21:30:26 -07:00

internvl.py

fix(quantization): Fix AWQ dequantize on Intel XPU and refactor AutoAWQ config (#42727)

2026-06-18 20:12:28 +08:00

iquest_loopcoder.py

Remove KV cache scale boilerplate from model weight loading methods (#43167)

2026-06-05 05:19:04 -07:00

isaac.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

jais2.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

jamba.py

[MoE Refactor] Rename FusedMoE.make_expert_params_mapping to fused_moe_make_expert_params_mapping (#40671)

2026-04-23 11:22:34 -04:00

jina_vl.py

[Chore] Update type annotation of input_ids in model forward (#33063)

2026-01-26 06:02:10 -08:00

jina.py

Forward fix nightly errors from #44589 (#47151)

2026-06-30 14:02:34 +00:00

kanana_v.py

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

keye_vl1_5.py

[Model] Use mm_features for Keye-VL and Keye-1.5-VL M-RoPE (#39869)

2026-04-16 02:16:06 -07:00

keye.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

kimi_audio.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

kimi_k25_vit.py

Fix Kimi-K2.5 FlashInfer ViT metadata (#44493)

2026-06-04 08:14:35 +00:00

kimi_k25.py

[perf]Add fused Kimi image preprocessing (#47416)

2026-07-06 08:46:32 -07:00

kimi_linear.py

[mamba] unify KDA conv states into one cache to match 2-state SSM layout (#44539)

2026-06-04 20:38:05 +02:00

kimi_vl.py

[MM][Perf][CG] Support ViT full CUDA graph for Kimi-VL (#41992)

2026-06-17 12:14:01 +00:00

laguna_dflash.py

Add Laguna XS.2.1 DFlash drafter support (#46853)

2026-07-02 18:09:27 -07:00

laguna.py

Add Laguna XS.2.1 DFlash drafter support (#46853)

2026-07-02 18:09:27 -07:00

lfm2_moe.py

Fix Transformers backend FP8 MoE and remove some boilerplate (#46820)

2026-06-27 00:16:05 +01:00

lfm2_siglip2.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

lfm2_vl.py

[MM][Perf][CG] Support dual-path ViT full CUDA graph for DeepSeek-OCR (#43586)

2026-06-16 04:35:20 -07:00

lfm2.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

lightonocr.py

[Misc] Cleanup more configs and processors (#37560)

2026-03-19 15:45:23 +00:00

llama4_eagle.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

llama4.py

Fix Transformers backend FP8 MoE and remove some boilerplate (#46820)

2026-06-27 00:16:05 +01:00

llama_eagle3.py

[XPU] Fix Eagle3 initialization on XPU (#43957)

2026-07-06 08:46:05 +08:00

llama_eagle.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

llama.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

llava_next_video.py

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

llava_next.py

[Perf][4/n] Eliminate various GPU<->CPU syncs (#42347)

2026-05-19 10:35:54 -04:00

llava_onevision2.py

[Model] Add LLaVA-OneVision-2 (LlavaOnevision2ForConditionalGeneration) (#44785)

2026-07-02 16:41:49 +08:00

llava_onevision.py

[Perf][4/n] Eliminate various GPU<->CPU syncs (#42347)

2026-05-19 10:35:54 -04:00

llava.py

Remove mantis (#46806)

2026-07-01 07:13:58 +00:00

longcat_flash_mtp.py

[Chore] Update type annotation of input_ids in model forward (#33063)

2026-01-26 06:02:10 -08:00

longcat_flash.py

Refractor longcat loading to use AutoWeightsLoader (#41448)

2026-05-01 09:07:23 +00:00

mamba2.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

mamba.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

medusa.py

Add Medusa speculative decoding e2e test (#41396)

2026-06-30 18:02:22 +00:00

mellum.py

Fix Transformers backend FP8 MoE and remove some boilerplate (#46820)

2026-06-27 00:16:05 +01:00

midashenglm.py

Fix MiDashengLM TP>1 crash in audio encoder attention (#44408)

2026-06-09 09:29:14 -07:00

mimo_audio.py

[Model] Add MiMo-V2.5 support (#40967)

2026-04-27 13:26:51 +00:00

mimo_mtp.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

mimo_v2_mtp.py

[SpecDecoding] extend mtp support for mimo 2.5 (#41905)

2026-05-09 18:22:59 +00:00

mimo_v2_omni.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

mimo_v2.py

[Spec Decode] Support SWA + DFlash for MiMo (#46104)

2026-06-30 20:34:47 -07:00

mimo.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

minicpm3.py

[5/N][Attention] Finish eliminating vllm/attention folder (#32064)

2026-01-27 10:02:51 -05:00

minicpm_eagle.py

[Misc][Model][Refactor] Pass the prefix into Linear layers (#31669)

2026-01-05 20:03:18 +00:00

minicpm.py

[MoE] Remove inplace fused experts mechanism (#43727)

2026-05-27 20:00:19 -07:00

minicpmo.py

[Bugfix] Fixes MiniCPM-O resampler device placement to avoid tensor device mismatch (#42332)

2026-06-17 08:35:27 +00:00

minicpmv4_6.py

Bump Transformers version to 5.10.4 (#41359)

2026-07-07 05:13:28 -07:00

minicpmv.py

Bump Transformers version to 5.10.4 (#41359)

2026-07-07 05:13:28 -07:00

minimax_m2.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

mistral3.py

[Bugfix][Model] Fix Devstral Small 2 HF format weight loading (#39293)

2026-04-14 10:11:18 +00:00

mistral_eagle.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

mistral_large_3_eagle.py

[Bugfix] Initialize missing attributes in mistral eagle (#45217)

2026-06-12 08:21:01 +08:00

mistral_large_3.py

…

mistral.py

Remove unused logic in models/mistral.py (#33095)

2026-01-26 09:01:52 -08:00

mixtral.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

mllama4.py

Remove boilerplate missed by #46820 (#46956)

2026-06-29 08:11:17 +08:00

mlp_speculator.py

[Refactor] Remove unused dead code (#38842)

2026-04-06 11:52:05 -04:00

modernbert.py

[ROCm][CI] Stabilize ModernBERT token-classification parity against Hugging Face (#44040)

2026-06-09 16:52:36 +01:00

module_mapping.py

[Misc] Remove unused ModelKeys (#32608)

2026-01-19 17:34:59 +00:00

molmo2.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

molmo.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

moondream3.py

[Model] Add Moondream3 model support(only query and caption skills) (#32325)

2026-05-01 10:06:48 +08:00

moonvit.py

[Core] Ensure memory is pinned prior to async h2d copy (#45424)

2026-06-20 20:02:24 -07:00

moss_audio.py

[bugfix] fix MOSS-Audio deepstack_input_embeds initialization in PP (#47607)

2026-07-06 17:15:50 +08:00

moss_transcribe_diarize.py

[Model] Support MOSS-Transcribe-Diarize (#47729)

2026-07-08 04:05:45 -07:00

mpt.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

nano_nemotron_vl.py

Avoid silent weights corruption when loading Nemotron Nano VL with reusable-buffer loaders like runai distributed streaming (#42244)

2026-05-11 12:03:14 +00:00

nemotron_h_mtp.py

fix: ensure no double load of lm head in nemotron mtp (#47440)

2026-07-07 12:01:45 +00:00

nemotron_h.py

Fix Transformers backend FP8 MoE and remove some boilerplate (#46820)

2026-06-27 00:16:05 +01:00

nemotron_nas.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

nemotron_parse.py

[Bugfix] Fix LM detection for Nemotron Parse (#42641)

2026-05-14 23:42:10 +08:00

nemotron_vl.py

fix(quantization): Fix AWQ dequantize on Intel XPU and refactor AutoAWQ config (#42727)

2026-06-18 20:12:28 +08:00

nemotron.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

nvlm_d.py

[Model] Remove Mono-InternVL (InternLM2VEForCausalLM) (#45129)

2026-06-12 10:41:09 +00:00

olmo3.py

Migrate Olmo and Olmo2 to the Transformers modeling backend (#48100)

2026-07-09 05:00:23 -07:00

olmo_hybrid.py

[Attention] Mamba attention module refactor (#41126)

2026-05-22 17:13:12 +08:00

olmoe.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

openai_privacy_filter.py

[Model] Add support for openai/privacy-filter (#41026)

2026-06-28 16:18:22 -07:00

opencua.py

[Refactor] Define MM data parser in processing info instead of processor itself (#33260)

2026-01-29 13:55:17 +08:00

openpangu_mtp.py

[MoE Refactor] Rename FusedMoE.make_expert_params_mapping to fused_moe_make_expert_params_mapping (#40671)

2026-04-23 11:22:34 -04:00

openpangu_vl.py

[Quant] Consolidate GPTQ: rename gptq_marlin.py to auto_gptq.py (#38288)

2026-05-15 08:25:52 +08:00

openpangu.py

Fix Transformers backend FP8 MoE and remove some boilerplate (#46820)

2026-06-27 00:16:05 +01:00

openvla.py

[Model] Openvla support (#42654)

2026-05-19 08:17:42 -07:00

opt.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

orion.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

ouro.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

ovis2_5.py

[Model] Fix missing maybe_prefix (#42280)

2026-05-11 09:04:06 +00:00

ovis.py

[Model] Fix missing maybe_prefix (#42280)

2026-05-11 09:04:06 +00:00

paddleocr_vl.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

paligemma.py

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

parakeet.py

Bugfix: Parakeet: .conv.pointwise/depthwise_conv1/2.bias weigths can exist even if convolution_bias=False (#40007)

2026-04-16 23:22:05 +00:00

param2moe.py

Remove boilerplate missed by #46820 (#46956)

2026-06-29 08:11:17 +08:00

phi3.py

…

phi3v.py

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

phi4mm_audio.py

[Perf][4/n] Eliminate various GPU<->CPU syncs (#42347)

2026-05-19 10:35:54 -04:00

phi4mm_utils.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

phi4mm.py

[ROCm][CI] Fix ROCm multimodal Qwen2.5-VL activation compile and Phi4MM ragged image mask handling (#43647)

2026-05-26 19:53:34 -07:00

phi4siglip.py

[Model] Add Phi4ForCausalLMV for microsoft/Phi-4-reasoning-vision-15B (#38306)

2026-04-02 21:14:57 -07:00

phi.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

phimoe.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

pixtral.py

[BUGFIX] Fix Pixtral consolidated format vision weight loading (#39916)

2026-04-19 22:25:03 -07:00

plamo2.py

[Misc] Replace mamba_type string literals with MambaAttentionBackendEnum (#41188)

2026-05-11 03:59:36 +00:00

plamo3.py

Fix Plamo 2/3 & LFM2 for Transformers v5 (#38090)

2026-03-25 12:29:49 +00:00

qianfan_ocr.py

[Model] support Qianfan-OCR model (#40136)

2026-05-05 10:51:25 +00:00

qwen2_5_omni_thinker.py

[Perf][4/n] Eliminate various GPU<->CPU syncs (#42347)

2026-05-19 10:35:54 -04:00

qwen2_5_vl.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

qwen2_audio.py

[Perf][4/n] Eliminate various GPU<->CPU syncs (#42347)

2026-05-19 10:35:54 -04:00

qwen2_moe.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

qwen2_rm.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

qwen2_vl.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

qwen2.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

qwen3_5_mtp.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

qwen3_5.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

qwen3_asr_forced_aligner.py

[Feature] Add Qwen3-ForcedAligner support via token classification pooling (#35367)

2026-03-29 00:27:52 +00:00

qwen3_asr_realtime.py

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

qwen3_asr.py

[Bugfix] Fix Qwen3-ASR transcription streaming postprocessing (#42478)

2026-07-09 00:33:27 -07:00

qwen3_dflash.py

[Spec Decode] Support hybrid (SWA + full attention) DFlash drafters (#47914)

2026-07-08 11:12:45 -04:00

qwen3_dspark.py

[Spec Decode] DSpark speculators checkpoint support (#47093)

2026-07-01 17:32:27 -07:00

qwen3_eagle3.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

qwen3_moe.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

qwen3_next_mtp.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

qwen3_next.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

qwen3_omni_moe_thinker.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

qwen3_vl_moe.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

qwen3_vl.py

Bump Transformers version to 5.10.4 (#41359)

2026-07-07 05:13:28 -07:00

qwen3.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

radio.py

Fix Nano Nemotron VL regressions (#38655)

2026-04-03 15:22:06 +08:00

registry.py

Migrate Olmo and Olmo2 to the Transformers modeling backend (#48100)

2026-07-09 05:00:23 -07:00

rnj1.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

roberta.py

Move Roberta remaining nn.Embedding to VocabParallelEmbedding (#47452)

2026-07-03 09:47:50 +00:00

rvl.py

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

sarvam.py

Remove boilerplate missed by #46820 (#46956)

2026-06-29 08:11:17 +08:00

seed_oss.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

siglip2navit.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

siglip.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00

skyworkr1v.py

fix(quantization): Fix AWQ dequantize on Intel XPU and refactor AutoAWQ config (#42727)

2026-06-18 20:12:28 +08:00

smolvlm.py

[Bugfix] Standardize getting number of image patches/tokens (#34358)

2026-02-12 20:47:01 -08:00

solar.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

stablelm.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

step1.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

step3_text.py

[Bugfix] Fix weight loading issues caused by #41184 (#45054)

2026-06-10 01:20:13 -04:00

step3_vl.py

[Bugfix][MM][CG] Enable dual-path ViT CUDA graph for Step3-VL (#46034)

2026-06-28 00:06:43 -07:00

step3p5_mtp.py

[Bugfix] LoRA: extend expert base_layer loading to Qwen3.5 and Step3.x (#37114)

2026-04-21 14:17:03 +00:00

step3p5.py

Fix Transformers backend FP8 MoE and remove some boilerplate (#46820)

2026-06-27 00:16:05 +01:00

step3p7.py

[Model]Support Step-3.7-Flash (#43859)

2026-05-28 17:01:48 -07:00

step_vl.py

[MM][CG] Enable encoder Cudagraph for Step3VL (#42224)

2026-05-17 20:19:13 -07:00

telechat2.py

…

teleflm.py

…

terratorch.py

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

ultravox.py

Deprecate Transformers v4 support (#45161)

2026-06-11 11:04:01 +08:00

unlimited_ocr.py

Add Triton Backend for Unlimited-OCR R-SWA (#47102)

2026-07-03 00:11:50 -07:00

utils.py

Bump Transformers version to 5.10.4 (#41359)

2026-07-07 05:13:28 -07:00

vision.py

[Perf] FP8 FlashInfer Attn for ViT (#38065)

2026-04-27 13:44:15 +08:00

voxtral_realtime.py

[Bugfix][Voxtral Realtime] Fix token feedback timeout silent hang (#44461)

2026-07-05 05:42:36 -07:00

voxtral.py

Migrate Voxtral to mistral-common 1.11.5 audio API (#46705)

2026-06-26 11:06:31 -07:00

voyage.py

[Model] Use AutoWeightsLoader for Voyage (#42972)

2026-05-22 05:28:23 +00:00

whisper_causal.py

[Bugfix] Fix pooled Whisper encoder sliding-window kernel size (#47437)

2026-07-02 10:19:11 -07:00

whisper_utils.py

[Voxtral] Add new streaming arch (#32861)

2026-01-23 12:41:52 +01:00

whisper.py

Remove unnecessary load_weights methods (#44589)

2026-06-29 01:52:23 -07:00

zamba2.py

Remove more unnecessary load_weights methods (#47058)

2026-06-30 15:22:16 +01:00