Commit Graph
3252 Commits
Author SHA1 Message Date
Cyrus Leung 7853700d4c [MM] Move get_dummy_processor_inputs into MM processor (#57967)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
2026-09-21 09:39:20 -07:00
Hotragn PettuganiandClaude Opus 5 606d124b37 [Bugfix][Multimodal] Tolerate malformed EXIF in Molmo 2 image preprocessing (#57234)
Signed-off-by: hotragn <hotragn.pettugani_2024@woxsen.edu.in>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-09-21 06:27:40 -07:00
Oliver Holworthyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 9598487bc1 [Bugfix][Model] Mistral3: align placeholder grid with public processor (#53758)
Signed-off-by: Oliver Holworthy <1216955+oliverholworthy@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-21 06:36:59 +00:00
Tianyao Wu 59f1527280 [Bugfix] Fix Whisper engine crash on audio clips longer than 30s (#57769)
Signed-off-by: Tianyao Wu <rayroy31@gmail.com>
2026-09-21 05:44:40 +00:00
Matt MastracciClaude Fable 5.1Lucas Wilkinsonmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
ff0c885494 [Bugfix] DiffusionGemma: fix multimodal support (#57589)
Signed-off-by: Matt Mastracci <matthew@mastracci.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-21 00:05:24 -04:00
ZyannandAbatom 9b2f34cad4 [Feature] support bf16 MoE router and mxfp4 MoE for MiMo V2 (#57784)
Signed-off-by: Zyann7 <62597503+Zyann7@users.noreply.github.com>
Co-authored-by: Abatom <182586866+Abatom@users.noreply.github.com>
2026-09-20 13:25:56 +00:00
mahird3 0748d3bd57 [Model][LoRA] Enable LoRA support for VoyageQwen3BidirectionalEmbedModel (#57708)
Signed-off-by: Mahir Dursunoglu <142054011+mahird3@users.noreply.github.com>
2026-09-20 09:50:00 +00:00
0c90804c0b [Bugfix] DiffusionGemma: cast the self-conditioning soft embed to the buffer dtype (#57462)
Signed-off-by: Matt Mastracci <matthew@mastracci.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
2026-09-20 04:58:02 +00:00
5302d1fe40 [Model Runner V2] Support custom logits processors (#56497)
Signed-off-by: David Cheung <d7cheung@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
2026-09-19 17:46:49 +00:00
Cyrus Leung 751f6807d9 [Refactor] Use dynamic MM cache in processor (#57674)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
2026-09-19 15:38:00 +00:00
vllmellm 211e252d0b [Bugfix][Model] Fix MiMo-V2.5 fused fp8 qkv_proj sharding (pre-shard count is num_key_value_heads; MTP path too) (#57508)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
2026-09-19 06:05:00 -07:00
Jiang WuandJiang Wu 01c7bf8813 [Bugfix][Model] Fix Aria expert weight names and layout (#57487)
Signed-off-by: Jiang Wu <245355730+JiangLLM@users.noreply.github.com>
Co-authored-by: Jiang Wu <245355730+JiangLLM@users.noreply.github.com>
2026-09-18 21:06:30 -07:00
Matt MastracciandClaude Fable 5.1 63d9ad0a3a [Model] DiffusionGemma: honor logprob_token_ids on the converging step (#57417)
Signed-off-by: Matt Mastracci <matthew@mastracci.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-18 16:11:27 -04:00
Harry MellorandClaude Opus 5 8a5cf54387 [Multimodal] Type dummy options per modality (#57576)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-18 17:29:11 +01:00
Cyrus Leung dbf4b89cf2 [Misc] Remove unnecessary Transformers version guards (#57556)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
2026-09-18 15:01:35 +00:00
Julien DebacheandHarry Mellor 2bdae2a5a8 [fix] Mistral-Large-3 accuracy regression on main (#57563)
Signed-off-by: jdebache <jdebache@nvidia.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-09-18 14:19:16 +00:00
44dd18fe0b [Model][Gemma4] Load Weights with AutoWeightsLoader (#55911)
Signed-off-by: Josephasafg <ajgard7@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-18 12:07:30 +00:00
Taneem Ibrahim 2b8a5495a8 [Mypy] Fix mypy typing for N/O models (#54142)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
2026-09-18 12:50:01 +01:00
SunandCodex 42a33039eb [Perf] Fuse CohereASR relative attention score accumulation (#55190)
Signed-off-by: levius <2114377220@qq.com>
Co-authored-by: Codex <codex@openai.com>
2026-09-18 06:18:41 +00:00
Matt Mastracci 2c88fb131c [Bugfix] DiffusionGemma: hand out stashed logprobs only on the committing step (#57414) 2026-09-17 20:24:58 -04:00
Yan Ma 48f663c37f [XPU] Fix incorrect context-key normalization for Qwen DFlash-based models (#56431)
Signed-off-by: Yan Ma <yan.ma@intel.com>
2026-09-18 07:52:01 +08:00
Misha Goin db7a24c230 [Perf] Add fused DFlash2 grouped convolution (#55960)
Signed-off-by: mgoin <mgoin64@gmail.com>
2026-09-17 21:38:59 +00:00
Doug Brown 2b02c6c29b [Model] Add Cohere2MoE Eagle3 auxiliary hidden states (#49819)
Signed-off-by: Doug Brown <doug@github.douggo.com>
2026-09-17 20:09:36 +00:00
Taneem IbrahimandHarry Mellor e960ead0aa [Mypy] Fix mypy typing for Transformers models (#54320)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-09-17 12:11:31 -04:00
cjackal 403f182c02 [MM] Keep raw pixels through dp-sharded ViT path (#56872)
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
2026-09-16 18:47:27 +00:00
Harry MellorandClaude Opus 5 651a88c09a [CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-16 10:57:24 -07:00
Cyrus Leung 0b9e018fb9 [MM] Further cleanup _apply_hf_processor_main (#53610)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
2026-09-16 10:21:00 -07:00
Harry MellorandClaude Opus 5 8c1557a79c Add pydocstyle to the ruff rules (#52136)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Harry Mellor <hej.mellor@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-16 16:44:29 +00:00
linitra24 ca542ee154 [Model][LoRA] Enable LoRA support for ModernBertModel (#57148)
Signed-off-by: linitra24 <renshuang.zhou@daocloud.io>
2026-09-16 14:16:09 +00:00
Harry Mellormergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Claude Opus 5
ec4a3a5370 [CI] Bump Transformers version to 5.17.0 (#56108)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-09-16 06:34:16 -07:00
Harshit KediaandClaude Opus 5 6a2fdf9ac6 [Model] Optimize Sarvam MLA routing and preserve FP32 router logits (#56034)
Signed-off-by: Harshit Kedia <harshit@sarvam.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-16 20:02:47 +08:00
Adababyandshaolila ceb87de065 [Misc] Remove no-op self-assignments across vLLM (#55988)
Signed-off-by: shaolila <shaolila@buaa.edu.cn>
Co-authored-by: shaolila <shaolila@buaa.edu.cn>
2026-09-16 02:17:07 -07:00
35f6047c1a [XPU][Bugfix] Fix Qwen2-Audio ValueError on audio clips longer than 30s (#56912)
Signed-off-by: Jakub Byczkowski <jakub.byczkowski@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
2026-09-16 16:54:02 +08:00
danisereb a31ec3a68b [LoRA][Nemotron] Add LoRA support for Nemotron VL models (for the language model only) (#56231)
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
2026-09-15 21:20:28 -07:00
Marceli FylcekandKunshang Ji ccbaed5b91 [XPU] Route to fused_qk_rmsnorm_rope_gate triton kernel (#56096)
Signed-off-by: Marceli Fylcek <marceli.fylcek@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
2026-09-16 11:05:54 +08:00
Nick Hill f2aad6aa70 [MRV2] Buffer util simplifications (#56888)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
2026-09-15 20:36:51 +00:00
9446ea1680 [Bugfix][Spec Decode] Only create draft_id_to_target_id when draft vocab differs (#53458)
Signed-off-by: drslark <slarksblood@qq.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: GLM-5.3 <glm@z.ai>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
2026-09-15 14:59:02 +00:00
Abhinav VermaandClaude Opus 5 1e47ec00d2 [Bugfix][Gemma 4] Don't read fft_length when profiling unified audio (#56721)
Signed-off-by: Abhinav Verma <verma.abhinav275@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-09-15 14:57:32 +00:00
Junhao ShenClaude Opus 5Misha Goinmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
4bac767695 [Perf][Nemotron] Skip redundant latent-MoE all-reduce at TP>1 (~13% decode win) (#52301)
Signed-off-by: Junhao Shen <junshen@nvidia.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-15 07:33:51 -07:00
aoshen02 eb61707851 [Bugfix] Fix stale HPC QK-norm weights after weight refit (#56706)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
2026-09-14 21:34:41 -07:00
Nicolò LucchesiandJorge Gallego Feliciano 995e8581f4 [Model] Voxtral Realtime: add support for CUDAGraphMode.FULL_DECODE_ONLY (#51167)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: Jorge Gallego Feliciano <jorge.gallego@mistral.ai>
2026-09-14 19:16:39 +00:00
Samuel NordmannmgoinClaude Opus 4.8ElizaWszolaOpenAI Codexmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
03dc26e639 [Perf][Kernel][Quantization] Fuse ReLU2 with static FP8 activation quantization (#53793)
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: snordmann <snordmann@nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-14 10:26:15 -07:00
b3124a8237 [Model] Add support for Nanbeige4.2 (transformers backend) (#56071)
Signed-off-by: zqlcode <lizongqiang@kanzhun.com>
Signed-off-by: zql <37731799+zqlcode@users.noreply.github.com>
Co-authored-by: zqlcode <lizongqiang@kanzhun.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-09-14 15:06:01 +00:00
Orestis ZambounisBenjamin Chislettmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Claude Opus 5
c676e4930b [Spec Decode] Fix Qwen3 DSpark d2t requirement for padded-vocab drafts (#55133)
Signed-off-by: Orestis Zambounis <23146389+orestis-z@users.noreply.github.com>
Signed-off-by: Orestis Zambounis <orestis.zambounis@gmail.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-09-14 10:07:07 -04:00
linitra24 9d4d9aa5bc [LoRA][Refactor] Unify multimodal LoRA token count hooks (#55071)
Signed-off-by: linitra24 <renshuang.zhou@daocloud.io>
2026-09-14 13:19:15 +00:00
arkohutandHarry Mellor 6623fe5b4e [Bugfix] MiniCPM-V 4.6: fix ViT self-attn qkv weight loading (#49417)
Signed-off-by: arkohut <39525455+arkohut@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-09-14 13:18:55 +00:00
Ronald e0c04c7b4d [Bugfix][Models] Fix OpenPangu sleep mode with static sinks (#53696)
Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
2026-09-14 21:05:47 +08:00
Bugen Zhao cf1584f373 [Refactor] Normalize DeepSeek V4.1 model package naming (#56741)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-09-13 23:17:50 -07:00
YleanandCodex a987777755 [Bugfix][Gemma4] Keep image kwargs out of video preprocessing (#56652)
Signed-off-by: Ylean <61880605+Woolgathererer@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-13 09:07:12 +00:00
Taneem Ibrahim a0914ab7d0 [Nano-Nemotron] Fix Nano-Nemotron precomputed multimodal embeddings (#56398)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
2026-09-12 09:07:10 -04:00