 Nishant RevurandClaude
|
581692cc0f
|
[Bugfix][Spec Decode] Fix multimodal embedding merge in Llama 4 and Mistral Large 3 EAGLE drafters (#57633)
Signed-off-by: Nishant Revur <kumrfni@amazon.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-10-09 01:44:50 +00:00 |
|
|
|
9f3d70e081
|
[Quantization] Enable shared expert fusion compatibility with online shared_expert quantization (showcase: along Quark MXFP4 routed experts) (#55686)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Signed-off-by: fxmarty-amd <felmarty@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-10-08 12:04:46 -04:00 |
|
|
Harry MellorandClaude Opus 5.5
|
21d9758459
|
Remove Python 3.10 support now that it is EOL (#60402)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-08 02:30:52 -07:00 |
|
|
liuzhenweiandKunshang Ji
|
0004536dd0
|
[XPU][Graph] Replace boolean-mask assignment with torch.where (#60529)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-10-08 17:13:48 +08:00 |
|
|
|
775792f2d5
|
[Bugfix] Reland #53020: tie lm_head.weight for Nemotron Parse when checkpoint omits it (#60272)
Signed-off-by: Anish Kumar <aniskumar@nvidia.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-10-08 04:40:55 +00:00 |
|
|
Isotr0pyandShanshan Shen
|
8352b2427f
|
[Multimodal] Optimize encoder cudagraph padding logic (#58925)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-10-08 03:38:09 +00:00 |
|
|
|
b803edbc9f
|
[Model] Streamline EmbeddingGemma 2 config resolution and harmonize Triton prefill attention (#60289)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-10-07 14:56:40 -07:00 |
|
|
Misha GoinandClaude Opus 5.5
|
a982c81e3e
|
[Bugfix] Limit GlmMoeDsaForCausalLM fp8 KV cache default to SM100 (#60281)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 13:37:13 -07:00 |
|
|
|
e572e02d21
|
[UX] Skip checkpoint shards an MTP head does not load (#60152)
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 15:16:19 -04:00 |
|
|
Roger WangandKimi Code
|
bb87d227d4
|
[Bugfix][Model] Fix mypy safe-super error in EmbeddingGemma2Model (#60280)
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
|
2026-10-06 15:10:00 -04:00 |
|
|
Luciano MartinsandLuciano Martins
|
02b83919aa
|
[Model] Support EmbeddingGemma2 multimodal pooling architecture (#60254)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
|
2026-10-06 13:43:38 -04:00 |
|
|
Wentao Ye
|
fba31f31a9
|
[GLM5.3 Perf] Switch to fp8 kv cache by default for GLM, 2.3%~5.5% E2E Throughput Improvement (#60140)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-10-06 12:54:20 -04:00 |
|
|
Mia Ojeda
|
3313825983
|
[Bugfix][DiffusionGemma] Read the causal mask as int32 and compile the sample step (#59992)
Signed-off-by: ojeda-e <eojeda@league.com>
|
2026-10-06 19:25:51 +08:00 |
|
|
aoshen02andClaude Opus 5.5
|
31e2443c90
|
[Model] LongCat-Flash: scale MLA norms while loading and drop the post-load sweep (#60080)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-06 08:47:02 +00:00 |
|
|
|
edfccc9469
|
[ROCM][Perf] Add ROCM_SEGMENTED_ATTN attention-backend works across RDNA3/3.5/4 (#59132)
Signed-off-by: root <jeffaw99@hotmail.com>
Signed-off-by: big-yellow-duck <jeffaw99@hotmail.com>
Co-authored-by: Tan Pin Siang <1716735+tanpinsiang@users.noreply.github.com>
Co-authored-by: vllmellm <190700713+vllmellm@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-10-06 07:53:47 +00:00 |
|
|
|
21d93d0d8c
|
[Attention][Model] FP8 KV cache for Triton DiffKV and MiMo-V2.6-Flash (#58128)
Signed-off-by: Luca Motz <luca.motz@icloud.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
|
2026-10-05 21:18:29 -07:00 |
|
|
Tianyu GuoandOpenAI Codex
|
8c417a2dae
|
[Bugfix][Model] Fix Qwen3-Omni interleaved M-RoPE boundary positions (#59842)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-10-06 03:35:53 +00:00 |
|
|
Sohaib Ahmed
|
64cb683842
|
[Model] Add Nemotron 3.5 ASR transcription support (#59827)
Signed-off-by: Sohaib-Ahmed21 <sohaibahmed1919@gmail.com>
|
2026-10-05 16:28:09 +00:00 |
|
|
cjackal
|
0e468adb43
|
[Model] Extend device-side mm normalization to Kimi K2.5 / K3 (#59278)
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
|
2026-10-05 21:28:13 +08:00 |
|
|
Vadim GimpelsonandClaude
|
d0d6e5f3a2
|
[Bugfix] Fix Mamba page size AssertionError with spec decoding on GraniteMoeHybrid, FalconH1 and Zamba2 (#59975)
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-10-05 12:49:47 +00:00 |
|
|
roikoren755andmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
51eeb0c58f
|
[Bugfix] Load stacked expert weights for non-gated MoE (#59031)
Signed-off-by: Roi Koren <roik@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-05 15:26:55 +03:00 |
|
|
Ian Eavesandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
b1f229fb75
|
[Model] Declare SupportsEagle3 on Qwen3ASRForConditionalGeneration (#52824)
Signed-off-by: Ian Eaves <ian.k.eaves@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-05 09:23:47 +00:00 |
|
|
Jee Jee Li
|
e3af5bf3ce
|
[LoRA] Code cleanup (#60017)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-10-05 09:15:53 +00:00 |
|
|
|
34051ad714
|
feat: Add video support for the Transformers backend (#57441)
pre-commit / pre-run-check (push) Canceled after 0s
pre-commit / pre-commit (push) Canceled after 0s
Signed-off-by: Harshal Janjani <harshaljanjani@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-10-05 00:51:15 -07:00 |
|
|
Harry Mellor
|
9e0b6fcf77
|
[CI] Bump Transformers version to 5.18.0 (#59621)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-10-04 00:42:35 +00:00 |
|
|
C
|
44198f577f
|
[Bugfix][Model] Fix M-RoPE offset double-count in Qwen3-Omni (#58890)
Signed-off-by: C1ves <3121985758@qq.com>
|
2026-10-03 09:00:51 +08:00 |
|
|
Thang NguyenandClaude Opus 5.5
|
7cfd233538
|
Revert "[Bugfix] Tie lm_head.weight for Nemotron Parse when checkpoint omits it" (#53020) (#59805)
Signed-off-by: Thang Nguyen <thangnguyenvn647@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 10:19:25 -07:00 |
|
|
Harry MellorandClaude Opus 5.5
|
6e4efafc6e
|
[Model] Migrate GPT-NeoX, Phi, Seed-OSS and Jais2 to the Transformers modeling backend (#59701)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 11:18:35 +00:00 |
|
|
Harry MellorandClaude Opus 5.5
|
5d20979fc9
|
[Misc] Remove code paths for Transformers < 5.16.1 (#59762)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 11:17:24 +00:00 |
|
|
|
af2a582d5c
|
[Bugfix][Spec Decode] Qualify Transformers backend attention layer names with the model prefix (#59293)
Signed-off-by: Farhad Al-Amin <99006654+Legend-2727@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-10-02 11:21:20 +01:00 |
|
|
Juan Pérez de Algaba
|
c15672cfb4
|
[Security] Accept zero-sum DeepSeek-OCR pixel tensors (#59417)
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com>
|
2026-10-02 09:17:12 +00:00 |
|
|
|
0cbac6cd13
|
[Model][Spec Decode] Enable EAGLE3/DSpark pipeline parallelism for Sarvam MLA (#55902)
Signed-off-by: mohit-sarvam <mohit@sarvam.ai>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-10-02 04:28:19 +00:00 |
|
|
Harry MellorandClaude Opus 5.5
|
8faacd707f
|
[Model] Migrate Glm, Arcee, CWM and Mellum to the Transformers modeling backend (#59679)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 03:15:14 +00:00 |
|
|
Harry MellorandClaude Opus 5.5
|
7b44aad5db
|
[MyPy] Fix mypy errors in vllm/model_executor/models/[kK]* (#59402)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-01 19:32:27 +00:00 |
|
|
aniskumar-nvandCyrus Leung
|
83cadd65d9
|
[Bugfix] Tie lm_head.weight for Nemotron Parse when checkpoint omits it (#53020)
Signed-off-by: Anish Kumar <aniskumar@nvidia.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-10-01 09:26:33 -07:00 |
|
|
|
cb6458c5ce
|
[Core] Remove deprecated mamba_cache_mode "all" (#58997)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>
|
2026-10-01 02:59:37 -07:00 |
|
|
|
c4fc3c7d32
|
[Bugfix][Spec Decode] Per-module LM heads for multi-layer MTP on Model Runner V2 (#58921)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: chanh <channguyen@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-01 01:09:14 -07:00 |
|
|
|
e12291d733
|
[CPU][Zen] Add DA8W4 (W4A8) int4 support for dense and MoE layers (#54024)
Signed-off-by: R <Ganesh.R@amd.com>
Signed-off-by: Ganesh R <Ganesh.R@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-01 15:18:25 +08:00 |
|
|
Ning Xie
|
a37c402f32
|
[weight loader] add dtype equality validation between parameter and weight (#51792)
Signed-off-by: Andy Xie <andy.xning@gmail.com>
|
2026-10-01 03:07:31 +00:00 |
|
|
Andrii SkliarandAndrii Skliar
|
deb148e730
|
[Mamba] Add FlashInfer ReplaySSM support for MTP (#52928)
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>
|
2026-09-30 21:41:17 +00:00 |
|
|
Varun Sundar Rabindranath
|
5463fe4962
|
[KV-Offloading][TP] : Expand replicated_layout detection to multi-group MLA (#57652)
|
2026-09-30 09:11:03 -04:00 |
|
|
|
effdea9a53
|
[MM][Mistral] Add compile support for Pixtral vision encoders (#57168)
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@mistral.ai>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-30 20:27:12 +08:00 |
|
|
|
df5668e5c9
|
[XPU] Dispatch nn.LayerNorm to fused SYCL kernel via CustomOp (#57172)
Signed-off-by: Michal Ganczarenko <michal.ganczarenko@intel.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-30 12:19:33 +00:00 |
|
|
Avishek GoswamiandAvishek Goswami
|
fb91712b38
|
[Model] Make the BERT/RoBERTa embedding class a class attribute (#59348)
Signed-off-by: Avishek Goswami <avishek.goswami@ibm.com>
Signed-off-by: Avishek Goswami <86944690+GOavi101@users.noreply.github.com>
Co-authored-by: Avishek Goswami <avishek.goswami@ibm.com>
|
2026-09-30 08:57:21 +00:00 |
|
|
Alexandra Sidorova
|
b81984879a
|
[K2 Horizon] fold partial-RoPE permutation into q/k (and norm) weights (#55335)
Signed-off-by: Alexandra Sidorova <asidorov@amd.com>
|
2026-09-30 16:03:37 +08:00 |
|
|
cjackal
|
0a30bc3f9a
|
[Model] Extend device-side mm normalization to GLM4V/GLM5Next (#55389)
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
|
2026-09-30 15:44:46 +08:00 |
|
|
|
5faf81a429
|
[CPU][Whisper] Support W4A16 quantized Whisper on the CPU WNA16 kernel (#58268)
Signed-off-by: Harshal Adhav <harshal.adhav@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-09-30 13:52:53 +08:00 |
|
|
Fabian Joswigandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
1117140edb
|
[Bugfix][Model] Fix DiffusionGemma silently freezing attention mask under CUDA graph replay (#51994)
Signed-off-by: Fabian Joswig <fjosw@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-30 05:34:26 +00:00 |
|
|
|
a8e069f81b
|
[Bugfix][MiniMax M3] Share target embeddings with MTP under PP (#58648)
Signed-off-by: Peiyuan Zhou <peiyuanzhou1994@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-09-29 20:04:10 -07:00 |
|
|
|
9a190f142c
|
[Mypy] Fix mypy typing for Zamba2 models (#58255)
Signed-off-by: Ashraf Bhuiyan <mbhuiyan@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-29 18:13:52 +00:00 |
|