 Robert ShawandClaude Code
|
283d76d56a
|
[Bugfix] Widen ep_gather output offset to int64 (#58373)
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Claude Code <noreply@anthropic.com>
|
2026-10-07 01:45:04 +00:00 |
|
|
|
5ab4e4445b
|
[Perf][MoE] Skip padded work in block-FP8 DeepGEMM experts (#59128)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-06 18:49:57 -05:00 |
|
|
|
d1f3d8b870
|
[Quantization] Prefer Humming before Marlin backends on SM90 (#56997)
Signed-off-by: jinzhen.ljz <jinzhen.ljz@antgroup.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-06 12:31:35 -07:00 |
|
|
Roger WangandKimi Code
|
bb87d227d4
|
[Bugfix][Model] Fix mypy safe-super error in EmbeddingGemma2Model (#60280)
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
|
2026-10-06 15:10:00 -04:00 |
|
|
|
3403e0f176
|
[Bugfix] Persist FlashInfer autotune cache per rank to fix the rank-0-only cache-hit deadlock (#57635)
Signed-off-by: Madhav Jivrajani <madhav.jiv@gmail.com>
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>
|
2026-10-06 17:51:01 +00:00 |
|
|
Luciano MartinsandLuciano Martins
|
02b83919aa
|
[Model] Support EmbeddingGemma2 multimodal pooling architecture (#60254)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
|
2026-10-06 13:43:38 -04:00 |
|
|
Wentao Ye
|
fba31f31a9
|
[GLM5.3 Perf] Switch to fp8 kv cache by default for GLM, 2.3%~5.5% E2E Throughput Improvement (#60140)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-10-06 12:54:20 -04:00 |
|
|
|
f8d92cae41
|
[Quantization] Layer re-quantization for linear layers through online quantization API (MXFP8 -> FP8 PTPC showcase) (#55684)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Signed-off-by: Tan Pin Siang <tanpinsiang@gmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Tan Pin Siang <tanpinsiang@gmail.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-10-06 11:38:18 -05:00 |
|
|
Chris LeonardandShengqi Chen
|
cc73cca9c8
|
[Build] Migrate vendored DeepGEMM from pybind to TORCH_LIBRARY (abi3) (#48962)
Signed-off-by: Chris Leonard <chleonar@redhat.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
|
2026-10-06 08:39:04 -07:00 |
|
|
Samuel NordmannandMisha Goin
|
4a99ca40d6
|
[Perf][MoE] Eliminate staging from NCCL symmetric reduce-scatter (#49194)
Signed-off-by: samnordmann <snordmann@nvidia.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-10-06 07:37:01 -07:00 |
|
|
Matthias Gehre
|
b267fe4881
|
[ROCm][Perf] W4A16: pad gfx11 weight and activation strides (#56301)
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
|
2026-10-06 08:22:33 -05:00 |
|
|
Mia Ojeda
|
3313825983
|
[Bugfix][DiffusionGemma] Read the causal mask as int32 and compile the sample step (#59992)
Signed-off-by: ojeda-e <eojeda@league.com>
|
2026-10-06 19:25:51 +08:00 |
|
|
aoshen02andClaude Opus 5.5
|
31e2443c90
|
[Model] LongCat-Flash: scale MLA norms while loading and drop the post-load sweep (#60080)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-06 08:47:02 +00:00 |
|
|
roikoren755andzjy0516
|
e11962fc1c
|
[Feat][Mamba2] Enable internal prefill checkpoints (#57329)
Signed-off-by: Roi Koren <roik@nvidia.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
|
2026-10-06 07:53:51 +00:00 |
|
|
|
edfccc9469
|
[ROCM][Perf] Add ROCM_SEGMENTED_ATTN attention-backend works across RDNA3/3.5/4 (#59132)
Signed-off-by: root <jeffaw99@hotmail.com>
Signed-off-by: big-yellow-duck <jeffaw99@hotmail.com>
Co-authored-by: Tan Pin Siang <1716735+tanpinsiang@users.noreply.github.com>
Co-authored-by: vllmellm <190700713+vllmellm@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-10-06 07:53:47 +00:00 |
|
|
|
40c86ae1ce
|
[Kernel] Enable OAI Triton MXFP4 MoE on SM12x (#58877)
Signed-off-by: lazymio <mio@lazym.io>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
|
2026-10-06 01:49:13 -04:00 |
|
|
|
21d93d0d8c
|
[Attention][Model] FP8 KV cache for Triton DiffKV and MiMo-V2.6-Flash (#58128)
Signed-off-by: Luca Motz <luca.motz@icloud.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
|
2026-10-05 21:18:29 -07:00 |
|
|
Tianyu GuoandOpenAI Codex
|
8c417a2dae
|
[Bugfix][Model] Fix Qwen3-Omni interleaved M-RoPE boundary positions (#59842)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-10-06 03:35:53 +00:00 |
|
|
|
b2863c0de9
|
[Kimi-K3] Use the fused K/V pack kernel on the decode-context-parallel prefill path (#56881)
Signed-off-by: Brandon Zhang <31413216+brandonfzhang@users.noreply.github.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>
|
2026-10-06 00:13:55 +00:00 |
|
|
MasonandYongye Zhu
|
6dd813e0b7
|
[Bugfix][MoE] Allow MiniMax2 routing in TRTLLM BF16 monolithic backend (#59571)
Signed-off-by: Mason Pitt <bradley.b.pitt@gmail.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
|
2026-10-05 16:24:14 -07:00 |
|
|
akii96
|
182247257f
|
[ROCm][Perf] Use a stacked hipBLASLt GEMM for the bf16x3 router (#52668)
Signed-off-by: Aakif Nawaz <aakif.nawaz@amd.com>
|
2026-10-05 17:28:07 +00:00 |
|
|
Sohaib Ahmed
|
64cb683842
|
[Model] Add Nemotron 3.5 ASR transcription support (#59827)
Signed-off-by: Sohaib-Ahmed21 <sohaibahmed1919@gmail.com>
|
2026-10-05 16:28:09 +00:00 |
|
|
Nicolò Lucchesi
|
30d4032363
|
[Model][GLM-5.3-Flash] Support DCP for the kpool sparse indexer (#59211)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-10-05 16:44:14 +02:00 |
|
|
Jee Jee Li
|
f9c9e8ac24
|
[LoRA] Remove tensorizer (#60024)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-10-05 07:01:56 -07:00 |
|
|
cjackal
|
0e468adb43
|
[Model] Extend device-side mm normalization to Kimi K2.5 / K3 (#59278)
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
|
2026-10-05 21:28:13 +08:00 |
|
|
Vadim GimpelsonandClaude
|
d0d6e5f3a2
|
[Bugfix] Fix Mamba page size AssertionError with spec decoding on GraniteMoeHybrid, FalconH1 and Zamba2 (#59975)
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-10-05 12:49:47 +00:00 |
|
|
roikoren755andmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
51eeb0c58f
|
[Bugfix] Load stacked expert weights for non-gated MoE (#59031)
Signed-off-by: Roi Koren <roik@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-05 15:26:55 +03:00 |
|
|
Stefano CastagnettaandThien Tran
|
55b80221ed
|
[Perf][Qwen4Exp] Keep the HC up projection on the skinny GEMM path (#60027)
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-10-05 20:09:36 +08:00 |
|
|
Ian Eavesandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
b1f229fb75
|
[Model] Declare SupportsEagle3 on Qwen3ASRForConditionalGeneration (#52824)
Signed-off-by: Ian Eaves <ian.k.eaves@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-05 09:23:47 +00:00 |
|
|
Jee Jee Li
|
e3af5bf3ce
|
[LoRA] Code cleanup (#60017)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-10-05 09:15:53 +00:00 |
|
|
|
34051ad714
|
feat: Add video support for the Transformers backend (#57441)
pre-commit / pre-run-check (push) Canceled after 0s
pre-commit / pre-commit (push) Canceled after 0s
Signed-off-by: Harshal Janjani <harshaljanjani@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-10-05 00:51:15 -07:00 |
|
|
|
155488d853
|
[Bugfix][Determinism] Preserve output dtype in batch-invariant mean (#59106)
Signed-off-by: Prudhvivuda <prudhvi12042001@gmail.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-04 17:07:46 +00:00 |
|
|
Harry Mellor
|
9e0b6fcf77
|
[CI] Bump Transformers version to 5.18.0 (#59621)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-10-04 00:42:35 +00:00 |
|
|
Markus Hartikainen
|
b0e21b3083
|
[ROCm][Kimi-K3] Add opt-in gfx942 MXFP4-to-int4 conversion (#51274)
Signed-off-by: Markus Hartikainen <markus.hartikainen@amd.com>
Signed-off-by: Hartikainen <mahartik@amd.com>
|
2026-10-03 14:28:02 +08:00 |
|
|
C
|
44198f577f
|
[Bugfix][Model] Fix M-RoPE offset double-count in Qwen3-Omni (#58890)
Signed-off-by: C1ves <3121985758@qq.com>
|
2026-10-03 09:00:51 +08:00 |
|
|
Julien Debache
|
111f71a6db
|
[feat] FlashInfer CuteDSL MegaMoE integration (#54049)
Signed-off-by: jdebache <jdebache@nvidia.com>
|
2026-10-02 15:43:33 -04:00 |
|
|
jackLeiandMisha Goin
|
10f6ab01a9
|
[Perf] Use value-only reduction for native per-token FP8 quantization (#59800)
Signed-off-by: jackLei0901 <841747318@qq.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-10-02 18:37:17 +00:00 |
|
|
Thang NguyenandClaude Opus 5.5
|
7cfd233538
|
Revert "[Bugfix] Tie lm_head.weight for Nemotron Parse when checkpoint omits it" (#53020) (#59805)
Signed-off-by: Thang Nguyen <thangnguyenvn647@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 10:19:25 -07:00 |
|
|
|
9cf087fd14
|
[Perf] Tune MoE weighted-sum kernel launch configuration (#59731)
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-10-02 17:09:29 +00:00 |
|
|
|
4c4003bb5f
|
[Bugfix] Bind routed-experts capture to the MoE layer, not the kernel (#59455)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 15:50:38 +00:00 |
|
|
aoshen02andClaude Opus 5.5
|
c91dccc080
|
[Bugfix][Quark] Pass grouped-routing arguments to OCP MX monolithic kernels (#59752)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 13:46:48 +00:00 |
|
|
|
e4294144a8
|
[Perf] Keep non-speculative GDN decode on the standard path (#59735)
Signed-off-by: DimensionSTP <65501090+DimensionSTP@users.noreply.github.com>
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Kimi Code <noreply@moonshot.ai>
|
2026-10-02 13:44:53 +00:00 |
|
|
|
24df2d3fc7
|
[Model] Add Qwen4Exp to the Qwen GDN Triton warmup (#56742)
Signed-off-by: lesj0610 <lesj0610@users.noreply.github.com>
Co-authored-by: lesj0610 <lesj0610@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-10-02 21:38:15 +08:00 |
|
|
Rajeev Warrierandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
30e956fad3
|
[Docs] Fix stale W4A16 NVFP4 default kernel in ModelOpt docs (#59135)
Signed-off-by: Rajeev Warrier <warrier.rajeev.95@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-02 13:21:43 +00:00 |
|
|
pmanczakandPawel Manczak
|
bdfb02674f
|
[XPU][Kernel] Tune Triton W8A8 block-FP8 GEMM for Intel B70 (#56063)
Signed-off-by: Pawel Manczak <203671809+pmanczak@users.noreply.github.com>
Co-authored-by: Pawel Manczak <203671809+pmanczak@users.noreply.github.com>
|
2026-10-02 12:56:11 +01:00 |
|
|
Harry MellorandClaude Opus 5.5
|
6e4efafc6e
|
[Model] Migrate GPT-NeoX, Phi, Seed-OSS and Jais2 to the Transformers modeling backend (#59701)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 11:18:35 +00:00 |
|
|
Harry MellorandClaude Opus 5.5
|
5d20979fc9
|
[Misc] Remove code paths for Transformers < 5.16.1 (#59762)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 11:17:24 +00:00 |
|
|
Simon Danielssonandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
98b29aa99a
|
[ROCm][Perf][GLM-5.3-Flash] Add AITER topk backend for decodes (#58167)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-02 11:47:41 +01:00 |
|
|
|
af2a582d5c
|
[Bugfix][Spec Decode] Qualify Transformers backend attention layer names with the model prefix (#59293)
Signed-off-by: Farhad Al-Amin <99006654+Legend-2727@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-10-02 11:21:20 +01:00 |
|
|
Juan Pérez de Algaba
|
c15672cfb4
|
[Security] Accept zero-sum DeepSeek-OCR pixel tensors (#59417)
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com>
|
2026-10-02 09:17:12 +00:00 |
|