Commit Graph
1259 Commits
Author SHA1 Message Date
kiroxuandOpenAI Codex 07ef21bc69 [Kernel][Perf] Enable fused QK-norm + partial MRoPE + gate for Qwen3.6 (#52676)
Signed-off-by: kiroxu <148877251+BabyDrangoner@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-24 18:28:49 -07:00
Guan-Ming Chiu 6a9c69fa85 [Attention][Spec Decode] Support varlen trtllm-gen decode for adaptive verification (#52157)
Signed-off-by: Guan-Ming (Wesley) Chiu <105915352+guan404ming@users.noreply.github.com>
2026-08-24 14:43:57 -04:00
Andreas Karatzas 30b34171b1 [ROCm][CI] Restore attention coverage after KV-cache layout refactor (#53351)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
2026-08-22 20:00:25 -05:00
Lucas Wilkinson 8bdc70ec7b [6/N][KV-Cache Layout Refactor] Standardize KV cache layout (#51718)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
2026-08-21 17:47:49 -07:00
stefankoncarevic f37d5868b9 [CI/Build][ROCm] Run the TileLang HIP symbol checks in their own interpreter (#53117)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
2026-08-21 16:17:42 -05:00
Divakar Verma 29b7c2f7d4 [ROCm][CI] aiter kernel ops - enable rope test (#52854)
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
2026-08-21 15:17:34 -05:00
Andreas Karatzas a0af854f5d [ROCm][CI] Stabilize MI355 FlyDSL MoE accuracy test (#53024)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
2026-08-21 13:17:18 -07:00
Divakar Verma b5f7fcc79d [ROCm][CI] Add float16 dtype and unsupported head size tests for paged attention (#53177)
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
2026-08-21 15:16:45 -05:00
Andreas Karatzas 88eb946cb1 [ROCm][CI] Stabilize MI355 FusedMoE test group (#53025)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
2026-08-21 13:15:25 -07:00
Wentao Ye e6f35d3c69 [DSv4 Perf] Adaptive topk width for dsv4, making #50004 back (#52823)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
2026-08-21 12:11:45 -07:00
vllm-agentandvllm-ci-failure-analyzer ba53da60bb Revert "[Bugfix][MoE] Tune FlashInfer experts to scheduler token limit" (#52989) (#53186)
Co-authored-by: vllm-ci-failure-analyzer <kevin@inferact.ai>
2026-08-21 12:39:28 -06:00
Fangzhou Ai fe76112ff2 [ROCm][Perf] Optimize DeepSeek V4 C4A top-k with AITER (#52882) 2026-08-21 10:00:39 -07:00
Luke Alonsoandmgoin 2740c817ff [Kernel] Add b12x FP4 MoE backend (#52018)
Signed-off-by: Luke Alonso <lalonso@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
2026-08-21 08:04:36 -07:00
Wei ZhaoandOpenAI Codex f8e0602713 Support kimi k3 nvfp4 checkpoint (#53132)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-21 05:59:44 +00:00
2785c72a14 [Kimi-K3] Extend GEMM-RS to GEMM-AR (#53053)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: wzhao18 <wzhao18.sz@gmail.com>
2026-08-21 03:44:15 +00:00
Misha GoinandOpenAI Codex bfb6c13499 [Bugfix][MoE] Tune FlashInfer experts to scheduler token limit (#52989)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-20 16:26:24 -04:00
stefankoncarevic 3b829cf176 [CI/Build][ROCm] Keep the CUDA-only kernel tests out of the ROCm run (#53113)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
2026-08-20 13:40:33 -05:00
kyleliang-nv 7c8b68b9ce [Bugfix][MiniMax-M3] Keep FP8 query allocation stable across CUDA graph replay (#51203)
Signed-off-by: Kyle Liang <kylliang@nvidia.com>
2026-08-20 10:45:28 -07:00
SeonjinandMisha Goin bd8865a299 [Kernel] Add FlashInfer TRTLLM MXFP8 linear backend (#52204)
Signed-off-by: seonjinn <sna@nvidia.com>
Signed-off-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
2026-08-20 10:07:22 -04:00
Andreas Karatzas 6b68db441e [ROCm] Fix DeepSeek V4 indexer numerics and coverage (#50803)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
2026-08-20 09:34:00 +00:00
pmanczak 44cf3f0466 [XPU][Tests] Make tests device-agnostic (#51968)
Signed-off-by: pmanczak <pawel.manczak@intel.com>
2026-08-20 02:25:41 -07:00
Sage Moore 5bf0dbd6fd [Bugfix] vLLM crashes at startup when DeepEP v2 is used with --enforce-eager wiht TRTLLM Bf16 (#51824) 2026-08-19 20:18:47 -04:00
Andreas Karatzas 480d4f0d15 [ROCm][CI] Enable modular OAI Triton MoE tests (#46434)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
2026-08-19 13:46:12 -05:00
xuebwang-amd c676232313 [Bugfix][Quantization] Fix OCP MX MoE emulation silently skipping mxfp6 activation QDQ (#52704)
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
2026-08-19 11:29:29 -05:00
akii96 583a00257d [ROCm] [Bugfix] Fix Triton fused shared expert alignment (#51632)
Signed-off-by: Aakif Nawaz <aakif.nawaz@amd.com>
2026-08-20 00:14:52 +08:00
Dinesh Chitlangia 525b7bbb3a [Bugfix][CPU] Enable C++ causal_conv1d GDN path and float32 SSM cache on non-AMX AVX-512BF16 CPUs (#49688)
Signed-off-by: Dinesh Chitlangia <dineshchitlangia@gmail.com>
2026-08-19 10:50:59 -05:00
Andreas Karatzas 17dbd42930 [ROCm] Add UE8M0 scale packing for Triton silu_mul_quant (#37835)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
2026-08-19 10:20:05 -05:00
Andreas Karatzas 160f7f0840 [ROCm][CI] Extended Fused MoE and FP8 MoE test support (#41100)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
2026-08-19 10:19:42 -05:00
Woosuk Kwon b09bd69b5b [Model][NVIDIA] Route DSA models to the CUDA non-compiled path (#52861) 2026-08-19 00:13:52 -07:00
Li, Jiang e4d61d0d22 [CPU] Add AMX-only high-performance MLA backend for DeepSeek V2/V3/R1 (#52616)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
2026-08-19 10:28:52 +08:00
Woosuk KwonandOpenAI Codex f1178f3a06 Revert DSv4 eager workspace reuse (#52836)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-18 17:02:59 -07:00
Summer Yang 5f7a20b316 [nv] add pcp support in dsv3.2 (#52046)
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
2026-08-18 14:59:08 -07:00
stefankoncarevic 6066bb3d50 [ROCM][CI] Attention test speedup (#52763)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
2026-08-18 16:40:30 -05:00
yinfengLiuandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 5d8a4cf976 [ROCm] Pad non-aligned AITER MLA heads (#51647)
Signed-off-by: Liuyinfeng01 <yinfeliu@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-18 16:37:10 -05:00
yimdevandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> eab1cff5b0 Harden DeepSeek V3.2 fused kernel grids (#52381)
Signed-off-by: yimdev <5779256+yimdev@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-18 01:43:12 -07:00
Jee Jee Li 2687fec6ef Replicated embedding and norm fusion for DSV3 flat model (#48484)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
2026-08-18 14:53:21 +08:00
Andreas KaratzasandOpenAI Codex 5fa8ca971a [ROCm][CI] Move ROCm AITER quantization tests (#40938)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-18 14:50:35 +08:00
ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 d5f5de7a7d [Bugfix] Fix DeepSeek V4 mHC broadcast buffer for weight sync (#52626)
Signed-off-by: Hollow Man <hollowman@opensuse.org>
2026-08-18 10:55:37 +08:00
kiroxu cdb8545a91 [Kernel][Perf] Support Qwen head ratios in fused GDN MTP (#52539)
Signed-off-by: kiroxu <148877251+BabyDrangoner@users.noreply.github.com>
2026-08-17 18:17:40 -07:00
Bo Liandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> c296851a7d [MoE] Refine FlashInfer one-sided All2All integration (#51924)
Signed-off-by: Bo Li <22713281+bobboli@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-18 00:18:14 +00:00
Divakar Verma 49fb2ee348 [ROCm][CI] add Aiter ops tests (#52208)
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
2026-08-17 18:33:22 -05:00
Micah Williamson 8878ebd8fd [ROCm][CI] Expand AITER W4A4 MoE Coverage (#52647)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
2026-08-17 15:46:22 -05:00
Andreas Karatzasandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> c1e438728c [ROCm][CI] Restore Torch defaults and type DSV4 scratch buffers (#52566)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-17 18:32:04 +00:00
Misha Goin 4ab5e5012a [Refactor] Simplify B12X linear kernels and warmup (#52368)
Signed-off-by: mgoin <mgoin64@gmail.com>
2026-08-17 09:45:45 -07:00
qli88 1d3a8b9e22 [ROCm][Bugfix] Fix Triton W4A16 bug in determining if transpose is required for GPTQ/AutoGPTQ (#48998)
Signed-off-by: Qiang Li <qiang.li2@amd.com>
2026-08-17 12:26:05 +00:00
ef43e3101b [ROCm][DSV4][Perf] Optimize Triton sparse-MLA decode on gfx950 (#52212)
Signed-off-by: Fangzhou Ai <fangzhou.ai@amd.com>
Signed-off-by: fai <fangzhouai@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Cursor Grok 4.6 <cursoragent@cursor.com>
2026-08-16 12:16:46 -07:00
Wentao Ye 7d7b6f26f4 [Refactor] Remove dead code for quantization (#52221)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
2026-08-16 13:10:16 -04:00
edd4c8176c [Bugfix][DSv4] Revert adaptive C128A metadata packing (#51318)
Signed-off-by: tobymao <toby.mao@gmail.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-15 18:39:23 -07:00
Gabriel Wu 97388c44f9 [Bugfix] Make DSV4 sparse MLA work end-to-end for plain decode, MTP, and DSpark (#51538) 2026-08-15 07:01:32 -07:00
Guanxin LiandClaude Opus 5 925ea7e60f [CI][Test] Seed the DeepEP v2 MoE workers, not just the parent (#50589)
Signed-off-by: Guanxin Li <guanxinl@nvidia.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-14 16:01:24 -04:00