|
c4fc3c7d32
|
[Bugfix][Spec Decode] Per-module LM heads for multi-layer MTP on Model Runner V2 (#58921)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: chanh <channguyen@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-01 01:09:14 -07:00 |
|
|
Wentao Ye
|
4d6874d137
|
[GLM 5.3 Perf] Skip qlnorm calculation for MHA, 4.4~7.7% E2E TTFT Improvement (#58845)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-10-01 15:13:57 +08:00 |
|
|
Shuolei WangandThien
|
c9578f10ab
|
[Qwen3.8-Flash-Next] Fuse main QK-norm/RoPE/gate and KV-cache write into the QSA pre-indexer launch (#57097)
Signed-off-by: Shuolei Wang <shuoleiwang123@gmail.com>
Signed-off-by: Thien <thien@inferact.ai>
Co-authored-by: Thien <thien@inferact.ai>
|
2026-10-01 14:21:06 +08:00 |
|
|
Juntian LiuandClaude Opus 5.5
|
4c2d277643
|
[Perf][DSv4.1] Faster Engram host lookups: sorted rows, inline big lookups (#59327)
Signed-off-by: Juntian Liu <Juntianl777@gmail.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-01 11:54:44 +08:00 |
|
|
namgyu-younandThien Tran
|
4ed438b79c
|
[Perf][Qwen4Exp] Add SM100 low-latency decode GEMM plans (#59214)
Signed-off-by: namgyu-youn <namgyu.dev@gmail.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-10-01 03:40:55 +00:00 |
|
|
|
766b4ae54c
|
[Kimi-K3] Add FlashInfer speculative KDA backend (#54255)
Signed-off-by: Duncan Moss <dmoss@nvidia.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-10-01 02:28:50 +00:00 |
|
|
VenkyandClaude Opus 5.5
|
42f0c17ea7
|
[Bugfix][PP][Spec Decode] MiniMax-M3 EAGLE3 aux-state relay at PP > 1 and per-stage FlashInfer autotune (#57197)
Signed-off-by: venkywonka <23023424+venkywonka@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-01 01:14:24 +04:00 |
|
|
|
84f738f187
|
[Perf][MiniMax-M3] Triton indexer: decode grid retune + SM12.0 split-K (#56151)
Signed-off-by: venkywonka <23023424+venkywonka@users.noreply.github.com>
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: Zijing Liu <liuzijing2014@gmail.com>
Co-authored-by: Kyle Liang <199154931+kyleliang-nv@users.noreply.github.com>
|
2026-09-30 23:33:23 +04:00 |
|
|
|
8f24ab30a3
|
[ROCm][Kimi-K3][Perf] Fuse MLA decode KV-cache write and Q-prep via AITER (#57640)
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-30 12:20:05 -05:00 |
|
|
Eldar Kurtić
|
c32513b99d
|
Add support for unquantized ngram in CT format (#59431)
|
2026-09-30 16:08:31 +00:00 |
|
|
Yida WengandGrok
|
17e9295dd5
|
[BugFix][Multimodal] Pick worst-case DeepSeek-V4 VL dummy image size (#59271) (#59373)
Signed-off-by: Yida Weng <84164537+YidaWeng@users.noreply.github.com>
Co-authored-by: Grok <grok@x.ai>
|
2026-09-30 15:09:11 +00:00 |
|
|
Varun Sundar Rabindranath
|
5463fe4962
|
[KV-Offloading][TP] : Expand replicated_layout detection to multi-group MLA (#57652)
|
2026-09-30 09:11:03 -04:00 |
|
|
|
df5668e5c9
|
[XPU] Dispatch nn.LayerNorm to fused SYCL kernel via CustomOp (#57172)
Signed-off-by: Michal Ganczarenko <michal.ganczarenko@intel.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-30 12:19:33 +00:00 |
|
|
Mathew Oddenandopencode+glm-5.3+vllm
|
91dab0eb7f
|
[ROCm][Perf] Allocate the pinned PLE prefetch buffer lazily (#58797)
Signed-off-by: Mathew Odden <modden@redhat.com>
Co-authored-by: opencode+glm-5.3+vllm <opencode+glm-5.3+vllm@example.com>
|
2026-09-30 17:43:16 +08:00 |
|
|
Simon Danielsson
|
3627a6a124
|
[ROCm][Perf][GLM-5.3-Flash] Stride-aware decode KDA (#57979)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-09-30 08:16:29 +00:00 |
|
|
cjackal
|
0a30bc3f9a
|
[Model] Extend device-side mm normalization to GLM4V/GLM5Next (#55389)
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
|
2026-09-30 15:44:46 +08:00 |
|
|
Zheng Gong
|
8ee4069033
|
[ROCm][DSv4.1][Perf] Use the shared prefill chunk plan in the ROCm sparse prefill (#58539)
Signed-off-by: Zheng Gong <zgong@amd.com>
|
2026-09-30 15:31:51 +08:00 |
|
|
Zheng GongandCursor
|
fcd317cf33
|
[ROCm][DSv4][Perf] Use the shared prefill chunk plan in the ROCm sparse prefill (#58405)
Signed-off-by: Zheng Gong <zgong@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-30 15:26:57 +08:00 |
|
|
|
a8e069f81b
|
[Bugfix][MiniMax M3] Share target embeddings with MTP under PP (#58648)
Signed-off-by: Peiyuan Zhou <peiyuanzhou1994@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-09-29 20:04:10 -07:00 |
|
|
|
c37f86e572
|
[Bugfix] GLM-5.3-Flash: fp8 plan dtype on SM90 sparse MLA, and right-size the indexer prefill workspace (#55222)
Signed-off-by: Mikhail Kostryukov <mike@triptrack.net>
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: Mikhail Kostryukov <drakosha81@proton.me>
Co-authored-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-09-29 22:36:39 +00:00 |
|
|
|
ac7f3e11ea
|
[Bugfix] Profile maximum DeepSeek V4.1 vision features (#57898)
Signed-off-by: ahmed xijiaat <52128022+xijiaat@users.noreply.github.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-29 15:21:27 +00:00 |
|
|
Chauncey
|
3e2a7e74a5
|
[Feat][Model] Enable KDA prefill checkpoints for GLM-5.3-Flash (#56960)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-09-29 09:14:30 +00:00 |
|
|
Yifan QiaoandClaude Fable 5.1
|
4b2e1cfa7b
|
[Model] Decoder-side SWA bounded replay for DeepSeek-V4.1 (#58132)
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-29 08:25:46 +00:00 |
|
|
|
77d9cda688
|
[ROCm][Model][Bugfix] Fix GLM-5.2 shared-expert fusion and MTP on the ROCm DSA path (#58904)
Signed-off-by: Jin Tao <jin.tao@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-09-29 07:57:23 +00:00 |
|
|
Juntian LiuandClaude Opus 5.5
|
30f5c01d4e
|
[DSv4.1] Avoid runtime recompiles of _ring_slot_mapping_kernel (#59119)
Signed-off-by: Juntian Liu <Juntianl777@gmail.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-09-29 07:31:30 +00:00 |
|
|
|
65ed0a2642
|
[Bugfix][GLM-5.3-Flash] Take video placeholder timestamps from the pixel path's frame sampler (#55647)
Signed-off-by: NNNtrance <232268405+NNNtrance@users.noreply.github.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: NNNtrance <232268405+NNNtrance@users.noreply.github.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-29 06:45:29 +00:00 |
|
|
|
63b9931b73
|
[ROCm][DSv4.1] Paged MXFP4 sparse indexer on aiter's MQA-logits kernel (#58671)
Signed-off-by: Mehmet Cagri Kaymak <mehmet.kaymak@amd.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-09-29 14:37:57 +08:00 |
|
|
cjackalandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
491f44adfa
|
[Model] Extend device-side mm normalization to Qwen3VL/Qwen3.5/Qwen4Next (#51289)
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-29 11:44:54 +08:00 |
|
|
Muhammad Ahmed
|
0af34418e9
|
[ROCm][DSv4.1][Perf] Run the delayed mHC seams through aiter's fused Triton kernel (#58655)
Signed-off-by: Ahmed <Muhammad.Ahmed@amd.com>
|
2026-09-29 10:19:10 +08:00 |
|
|
Mehmet Cagri
|
70ae0b7435
|
[ROCm][MLA] Enable sparse MLA Gluon kernel from Aiter (#53492)
Signed-off-by: Mehmet Cagri Kaymak <mehmet.kaymak@amd.com>
Signed-off-by: Mehmet Cagri <mehmet.kaymak@amd.com>
|
2026-09-29 09:08:18 +08:00 |
|
|
|
e03875f4d2
|
[Minimax M3] Enable fp8 indexer cache on triton indexer for non-SM100 architectures. (#59081)
Signed-off-by: Jarrel Seah <jarrel@harrison.ai>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Rajas Mhaskar <rmhaskar@nvidia.com>
Co-authored-by: Jarrel Seah <jarrel@harrison.ai>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-28 19:21:13 -04:00 |
|
|
Oxana KorzhandClaude Opus 5.5
|
94d1462924
|
[Bugfix][Kimi-K3] Refresh DSpark context KV cache pointers after the KV cache is re-bound (#58814)
Signed-off-by: Oxana Korzh <okorzh@amd.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-09-28 11:05:10 -05:00 |
|
|
xaguilar-amdandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
a7ff44355c
|
[ROCm][Perf] Kimi-K3 Enable sharded latent MoE up-projection under EP (#54956)
Signed-off-by: Xavier Aguilar <xavier.aguilarfruto@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-28 10:31:29 -04:00 |
|
|
Shanshan Shen
|
7ba3df63cb
|
[ROCm][Refactor] Move DeepSeek-V4/V4.1 multi-stream overlap gate to ROCm platform (#58983)
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
|
2026-09-28 05:46:28 -07:00 |
|
|
Jiangyun ZhuandOpenAI Codex
|
20b52e9f5b
|
[Perf][Qwen3.8] Reduce PLE metadata construction overhead (#58114)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-28 20:46:22 +08:00 |
|
|
BaoYunkai
|
f6877f563c
|
[Bugfix][Spec Decode] Implement get_top_tokens() on the ROCm DeepSeek V4 MTP drafter (#57568)
Signed-off-by: BaoYunkai <ybao@amd.com>
|
2026-09-28 20:16:38 +08:00 |
|
|
Thien Tran
|
d6cce94fd4
|
[Perf][Qwen4Exp] Fuse HC down projection and SiLU on NVIDIA (#58957)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-09-28 18:51:38 +08:00 |
|
|
|
a2be4d3cc7
|
[Bugfix][Qwen4Exp] Release the profiling KV cache held by QSA key views (#58961)
Signed-off-by: Zihua Wu <13583761+lucifer1004@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-28 08:11:46 +00:00 |
|
|
Thien TranandCodex
|
55de40a2fc
|
[Minimax-M3] Add Encoder CUDA graph support (#58673)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Codex <codex@openai.com>
|
2026-09-28 04:17:36 +00:00 |
|
|
Shanshan Shen
|
44af287ebe
|
[ROCm][Perf] Enable layer-aware CSA2 multi-stream overlap for DeepSeek-V4.1-Flash (#57407)
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
|
2026-09-27 23:48:01 +08:00 |
|
|
Juntian LiuandClaude Opus 5.5
|
a9eafde59c
|
[Perf][DSv4.1] Fuse small-batch WO-A with inverse RoPE and MXFP8 quant on SM100/SM103 (#58634)
Signed-off-by: Juntian Liu <Juntianl777@gmail.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-09-26 21:16:12 -07:00 |
|
|
Thien Tran
|
7a877ae34d
|
[Qwen3.8-Flash-Next] Avoid memory fragmentation in QSA indexer logits workspace (#57105)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-09-27 10:11:52 +08:00 |
|
|
Yongye ZhuandClaude Opus 5.5
|
77871126f9
|
[Kernel][DSV4.1] Fuse MoE finalize into the TP all-reduce + mHC boundary (#58586)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-27 03:08:36 +08:00 |
|
|
Kevin H. Luu
|
7d8c5fe9a9
|
[Bugfix][DSV4.1] Avoid host sync in ViT CUDA graph replay metadata (#58499)
|
2026-09-26 11:37:36 -04:00 |
|
|
Wentao Ye
|
3576691c42
|
[GLM5.3 Bug] Fix sparse indexer attn topk backend selection (#58594)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-09-26 11:35:28 -04:00 |
|
|
|
a4eb3f25d6
|
[Spec Decode] Enable Gemma4 DSpark adaptive verification with FlashInfer (#57263)
Signed-off-by: zixi-qi <zixi@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-09-26 17:01:17 +08:00 |
|
|
xiao-llmandCursor
|
5840d95284
|
[Bugfix][ROCm] AMD-Quark mixed-precision DeepSeek-V4.1 support (#57071)
Signed-off-by: Xiao Yu <xiao.yu.dc@outlook.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-25 20:51:18 -05:00 |
|
|
Shuolei Wang
|
4bb804cc5b
|
[Perf][DSv4.1] Shard the Engram wkv projection across TP ranks (#58678)
Signed-off-by: Shuolei Wang <shuoleiwang123@gmail.com>
|
2026-09-26 01:15:57 +00:00 |
|
|
|
1417022c3d
|
[ROCm][Kimi-K3] Optimize low-concurrency speculative KDA (#58045)
Signed-off-by: jiacao-amd <jiahui.cao@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-25 12:33:30 -05:00 |
|
|
|
2617fe9383
|
[Bugfix][GLM-5.3-Flash] kpool corruption with speculative decoding (#58454)
Signed-off-by: Matt Mastracci <matthew@mastracci.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-25 12:51:34 -04:00 |
|