 Yunxiao NingandOpenAI Codex
|
19c018ec05
|
[Bugfix][DCP] Materialize prefill keys on non-owner ranks (#54908)
Signed-off-by: 云挚 <ningyunxiao.nyx@antgroup.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-04 02:12:07 +00:00 |
|
|
|
2cf82bcdd1
|
[Bugfix][DCP] Fix NVIDIA DeepSeek-V3.2 / GLM-5.2 fused attention (#50005)
Signed-off-by: 云挚 <ningyunxiao.nyx@antgroup.com>
Signed-off-by: Mikhail Kostryukov <mike@triptrack.net>
Co-authored-by: Mikhail Kostryukov <mike@triptrack.net>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
|
2026-08-31 00:30:45 -07:00 |
|
|
Lucas Wilkinson
|
5707355209
|
[Bugfix][MLA] Fix BLHNC addressing for FlashInfer sparse MLA (#54465)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
|
2026-08-31 01:13:42 +00:00 |
|
|
Matthew BonanniandOpenAI Codex
|
de9250ac9e
|
[Attention] Enable masked MHA for GLM-5 head dimensions (#53785)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-27 21:17:12 +00:00 |
|
|
Woosuk KwonandOpenAI Codex
|
c0233fcf01
|
[Model] Remove unused DeepseekV32Indexer forward (#53021)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-19 19:39:52 -07:00 |
|
|
Summer YangandWoosuk Kwon
|
58e5ee0158
|
[refactor] consolidate cp attn ops (#52839)
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-08-19 18:04:11 -07:00 |
|
|
Woosuk Kwon
|
b09bd69b5b
|
[Model][NVIDIA] Route DSA models to the CUDA non-compiled path (#52861)
|
2026-08-19 00:13:52 -07:00 |
|
|
Summer Yang
|
5f7a20b316
|
[nv] add pcp support in dsv3.2 (#52046)
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
|
2026-08-18 14:59:08 -07:00 |
|
|
Woosuk KwonandOpenAI Codex
|
01e56caaf2
|
[Bugfix][MLA] Do not use Dense MHA for GLM-5.2 (#52512)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-18 11:20:48 -07:00 |
|
|
fxmarty-amd
|
88b2bff2c6
|
[MOE] Standardize and abstract fused shared expert optimization selection (#51695)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
|
2026-08-18 12:56:56 -04:00 |
|
|
yimdevandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
eab1cff5b0
|
Harden DeepSeek V3.2 fused kernel grids (#52381)
Signed-off-by: yimdev <5779256+yimdev@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-18 01:43:12 -07:00 |
|
|
Jee Jee Li
|
2687fec6ef
|
Replicated embedding and norm fusion for DSV3 flat model (#48484)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-08-18 14:53:21 +08:00 |
|
|
|
7b544ecb52
|
[Spec Decode][Perf] Fuse the MTP trailing all-reduce; local-argmax draft tokens (#49793)
Signed-off-by: Peiyuan Zhou <peiyuanzhou1994@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-14 17:07:07 -07:00 |
|
|
Woosuk Kwon
|
e644c8cd8c
|
[Perf] Optimize DeepSeek V3.2 sequence parallelism (#51434)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-08-07 16:51:01 -07:00 |
|
|
Woosuk Kwon
|
46b5864054
|
[Perf] Narrow DeepSeek V3.2 eager CUDA graph region (#51425)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-08-07 14:37:43 -07:00 |
|
|
Wentao Ye
|
4a11ed5bc4
|
[DSv32/GLM Perf] Skip short prefill topk for dense mha layer, 97.9% kernel level latency reduction (#51298)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-07 20:30:42 +00:00 |
|
|
Wentao Ye
|
ad5280255b
|
[GLM Perf] DSv32/glm use skip topk for MTP case, 2.0x kernel performance improvement (#50904)
|
2026-08-06 01:48:36 -07:00 |
|
|
|
2dfb8ba590
|
[Perf][CUDA] Programmatic dependent launch for the DSA decode kernels (#50230)
Signed-off-by: Peiyuan Zhou <peiyuanzhou1994@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-06 00:53:17 -07:00 |
|
|
xiaozhoupyandClaude
|
3756bf1e2b
|
[Kernel][SM100] Add a CuTeDSL fused query kernel (#49792)
Signed-off-by: Peiyuan Zhou <peiyuanzhou1994@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-04 15:23:06 -07:00 |
|
|
|
c810937573
|
[Kernel] Extend CuTe DSL skinny GEMM to GLM-5.2 (#49791)
Signed-off-by: Peiyuan Zhou <peiyuanzhou1994@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-08-03 16:49:41 -07:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
f7097a92fd
|
[Bugfix][CI] Prevent common ops imports from initializing CUDA (#50639)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-01 00:13:29 -04:00 |
|
|
Jee Jee Li
|
92643d68f5
|
K3 DSpark AR fusion (#50242)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-07-31 11:12:03 +00:00 |
|
|
|
e2efe79695
|
[ROCm]Migrating Deepseek V3.2 to vllm/models/deepseek_v32/ (#47207)
Signed-off-by: sroberts-amd <sroberts@amd.com>
Signed-off-by: Stacy Roberts <sroberts@amd.com>
Co-authored-by: Elvir Crncevic <elvircrn@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-30 08:37:43 -05:00 |
|
|
Yiliu DongandOpenAI Codex
|
ba702e978e
|
[Attention] Skip sparse indexer scoring for dense short prefills (#48407)
Signed-off-by: Yiliu Dong <91178480+qianlihuang@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-07-28 16:17:22 +00:00 |
|
|
Wentao Ye
|
7fe6d3c76b
|
[Perf] Fix moe reduce_scatter perf regression by removing additional comm, 5% E2E throughput gain back. (#48763)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-07-25 16:36:19 +00:00 |
|
|
Woosuk Kwon
|
213f681f81
|
Revert "[Perf][GLM-5.2] Blackwell decode optimizations" (#49768)
|
2026-07-24 16:04:59 -07:00 |
|
|
|
dd72658e7d
|
[Perf][GLM-5.2] Blackwell decode optimizations (#48597)
Signed-off-by: Peiyuan Zhou <peiyuanzhou1994@gmail.com>
Signed-off-by: zhou <zhou@zhoudeMacBook-Pro.local>
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Giancarlo Delfin <32987265+TheEpicDolphin@users.noreply.github.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: zhou <zhou@zhoudeMacBook-Pro.local>
Co-authored-by: stefankoncarevic <Stefan.Koncarevic@amd.com>
|
2026-07-23 21:36:27 -07:00 |
|
|
aoshen02andaoshen02
|
ba18929079
|
[Bugfix][SpecDecode] Scope MTP completeness checks outside bucketed updates (#49178)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
|
2026-07-21 18:56:39 -07:00 |
|
|
Wentao Yeandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
4238b011a7
|
[Feature] Migrate moe sp support to non-torch compiled path for GLM5.2 (#47881)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-15 23:33:15 +00:00 |
|
|
Wentao Ye
|
1ff9429655
|
[CI Bug] Fully solve accuracy issue for DSv3.2 + MTP + Sequence Parallel (#48036)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-07-14 10:00:24 -04:00 |
|
|
Wei ZhaoandYongye Zhu
|
2afa3f7e95
|
[Perf] Minimax M3 - Support cross-layer allreduce-norm fusion (#47631)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
|
2026-07-07 21:16:32 -07:00 |
|
|
Jee Jee Li
|
5d23ca47ab
|
[Kernel] Applies routed_scaling_factor internally (#47408)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-07-07 02:00:54 -07:00 |
|
|
xiaozhoupy
|
d039c17114
|
[Bugfix] Recycle post-final-norm hidden in GLM MTP (single norm) (#47448)
|
2026-07-06 01:07:56 -07:00 |
|
|
Giancarlo Delfin
|
d63c8e9444
|
[BugFix][Spec Decode] Compact shared topk indices buffer after first MTP draft step (#47238)
|
2026-07-01 21:38:51 -07:00 |
|
|
|
c5200d3565
|
[Attention][DSA] support dcp for FLASHINFER_MLA_SPARSE (#46076)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Jingyi Yang <girasoleyang@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: GirasoleY <girasoleyang@gmail.com>
Co-authored-by: Jingyi Yang <girasoleyang@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-01 00:32:20 -04:00 |
|
|
Woosuk Kwon
|
f098ee70c7
|
[GLM5] Support FlashMLA FP8 KV cache (Hopper & Blackwell) (#47090)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-06-30 18:13:21 -07:00 |
|
|
Wentao Ye
|
75698e60b3
|
[Bug] Fix sparse attention issue for GLM5.2 non-torch compile path (#47083)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-06-29 15:45:53 -07:00 |
|
|
Harry Mellor
|
311ad689ad
|
Remove boilerplate missed by #46820 (#46956)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-06-29 08:11:17 +08:00 |
|
|
Woosuk Kwon
|
4b643c463e
|
[GLM5] Fix minor typo (#46961)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-06-28 08:37:00 -07:00 |
|
|
Woosuk Kwon
|
89876b0c54
|
[GLM5] Implement op fusion for GLM5/DSV3.2 (#46876)
|
2026-06-28 08:17:39 -07:00 |
|
|
Woosuk Kwon
|
65e655d295
|
[GLM-5] Add DSV3.2/GLM5 to vllm/models/ (#46808)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-06-26 14:09:05 -07:00 |
|