Commit Graph
20824 Commits
Author SHA1 Message Date
Will EatonandBugen Zhao 2db1c4dc31 [Rust Frontend] Support --lora-modules for static adapter loading (#54837)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Will Eaton <weaton@redhat.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-09-03 19:12:45 +00:00
Bugen Zhaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 21a2211040 [Rust Frontend] Use token-attributed text in reasoning and unified parsers (#54884)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-09-04 02:05:05 +08:00
Fangzhou Ai 8bf39632b8 [ROCm][Perf] Add low-M FP32 router GEMM for gfx950 (#54845) 2026-09-03 10:42:25 -07:00
b7624069ff [Fusion] Manual ActivationQuantFusionPass initial application (#51415)
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: ElizaWszola <ewszola@redhat.com>
2026-09-03 13:37:31 -04:00
sychen52andVadim Gimpelson d4d703caf9 [Bugfix][Model] Fix FP8 PLE loading in mixed ModelOpt checkpoints (#54882)
Signed-off-by: Shiyang Chen <shiychen@nvidia.com>
Co-authored-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>
2026-09-03 21:09:39 +04:00
Bolin SunandClaude Fable 5 d410fc12f3 [Kernel] Enable Kimi-K3 SiTU on the CuteDSL MoE backend and the SM107 low-latency GEMM plan (#54606)
Signed-off-by: Bolin Sun <bolins@nvidia.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-09-03 16:49:31 +00:00
Jiangyun Zhu 98ed0856f3 [Model] add GLM-5.3-Flash support (#53906) 2026-09-03 09:40:35 -07:00
Yifan Jiang da8ec28268 [Bugfix][KV Offload] Do not let a recurrent group's unhashed block truncate the load boundary (#52807)
Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
2026-09-03 19:08:46 +03:00
mevince 4ae6228284 [Bugfix][KV Connector] Populate SimpleCPUOffload BlockStored metadata (#54325) 2026-09-03 15:58:07 +00:00
Nick Hill e55b93f296 [Core] Deprecate "all" mamba cache mode (#55041)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
2026-09-03 08:56:59 -07:00
Jeff (Junze) MaandOpenAI Codex 31e9c13685 [Bugfix][KV Connector] Safely fill circular buffers in DecodeBench (#54879)
Signed-off-by: Jeff Ma <jeffjma@umich.edu>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-09-03 15:16:22 +00:00
bhsueh_NV edc0fb7e03 Optimize PLE MTP metadata transfers (#55054) 2026-09-03 08:02:59 -07:00
Nick Hillandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> bf95f58d10 [Core] Triton kernel for small-batch top-p only masking (#54651)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-03 07:52:47 -07:00
JasonCohereandCursor bb363db9a5 feat: Add support for reasoning_token_count to reasoning parser (#54982)
Signed-off-by: Jason Ozuzu <jasonozuzu@cohere.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-03 05:02:49 -07:00
SunandCodex 848ab131bc [Perf] Accumulate Conformer attention scores with baddbmm (#55062)
Signed-off-by: levius <2114377220@qq.com>
Co-authored-by: Codex <codex@openai.com>
2026-09-03 04:17:52 -07:00
Taneem Ibrahim 758c79e1c5 [Bugfix] Retain vocab embeddings during replacement (#55083)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
2026-09-03 04:17:38 -07:00
ee0a4c46ae [Bugfix] Account for PCP in multi-node world size validation (#55111)
Signed-off-by: DebugSy <532151398@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-09-03 10:52:42 +00:00
Giancarlo Delfin facd9a74a1 [Model Runner V2][Spec Decode] Skip DP sync for all speculator uniform decodes (#54856) 2026-09-03 10:32:33 +00:00
djramic 0d3ede3e3b [Bugfix][Model] Enable torch.compile for StableLM (#54969)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
2026-09-03 03:21:54 -07:00
Zupeng WangOpenAImergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
c21751c90b [Kernel] Warm up Qwen GDN gated RMSNorm (#54251)
Signed-off-by: Zupeng Wang <71580390+zupengwang@users.noreply.github.com>
Co-authored-by: OpenAI <support@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-03 18:19:48 +08:00
Andreas Karatzas 4cc0cb6f76 [CI][AMD] Avoid expandable segments in LoRA TP tests (#55094)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
2026-09-03 09:55:10 +00:00
Harry Mellor e6eb9074e9 [CI] Bump Transformers version to 5.16.1 (#53905)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-09-03 02:12:43 -07:00
Andreas Karatzas 096d8e8ce6 [ROCm][CI] Add MiniMax reduce RMS kernel coverage (#55057)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
2026-09-03 04:07:59 -05:00
Bowen Tan 1f76efaa21 [Model] Add K2-Horizon model support (#55063) 2026-09-03 01:17:08 -07:00
092334c828 [Bugfix] Wait for offload keys before storing chunks (#52923)
Signed-off-by: chuanzhisongshu <49055103+982945902@users.noreply.github.com>
Co-authored-by: lishuo121 <lishuo121@jd.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
2026-09-03 11:07:35 +03:00
Derek WeitzelandClaude Fable 5.1 859dd39512 [Bugfix][Core] Wait for the previous PP tensor sends before the next forward pass (#54962)
Signed-off-by: Derek Weitzel <djw8605@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-03 08:01:36 +00:00
Clinton ThomasandLucas Bourtoule ee17d0d869 Use server-generated keys for late-interaction query caches (#51445)
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com>
2026-09-03 07:15:58 +00:00
waizuichougouandNick Hill 3f1af35e01 [Bugfix][Multimodal] Handle prefix-covered items in SHM worker cache (#54994)
Signed-off-by: waizuichougou <2082431897@qq.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
2026-09-03 06:39:34 +00:00
Taneem Ibrahim 27a94d1ce4 [CI] Fix DeepSeek-V4 registry platform guard (#55042)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
2026-09-03 03:27:01 +00:00
Zhaodong BingTJianZhaodong BingCursormergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Zhaodong Bing
5d09eb2cf3 [Bugfix][MoE] Preserve unquantized weight storage on ROCm (#46009)
Signed-off-by: bingzhaodong <aaab8b@gmail.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Zhaodong Bing <zhaobing@smc300x-ccs-aus-gpuf2c5.prov.aus.ccs.cpe.ice.amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Zhaodong Bing <zhaobing@smc300x-ccs-aus-gpuf2a0.prov.aus.ccs.cpe.ice.amd.com>
2026-09-03 11:06:09 +08:00
Giuseppe GrossiandAndreas Karatzas e47356c63e [ROCm][Installation] Add mooncake package to image using public wheels (#55002)
Signed-off-by: Giuseppe Grossi <ggrossi@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-09-02 21:48:36 -05:00
Kevin H. Luu 5e4e927b5e [CI] Force HTTP/1.1 for runtime Git installs (#55044)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
2026-09-03 10:14:22 +08:00
Woosuk Kwon 0e14198a63 [Skills] Add kernel benchmark sanity references (#54995)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
2026-09-02 17:58:55 -07:00
Bugen Zhao ad127d9a0f [Perf][Rust Frontend] Coalesce decoded chunks per engine update (#55012)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-09-02 15:44:23 -07:00
Woosuk KwonandOpenAI Codex 443febe723 [Agents] Expose Triton kernel-writing skill to Claude (#55028)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 15:36:12 -07:00
Woosuk KwonandOpenAI Codex cf3263d571 [Agents] Add Triton kernel-writing skill (#55019)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 15:29:16 -07:00
Kevin H. LuuandKimi Code 6c6376a09e [CI] Remove deleted nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 and its arch aliases (#55026)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
2026-09-02 15:18:46 -07:00
a0d3e5c16e [XPU] Add fused GemmaRMSNorm path for eager execution (#53678)
Signed-off-by: Huanxing <huanxing.shen@intel.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
2026-09-03 06:11:20 +08:00
Kevin H. Luu 963054ed58 [CI] Exclude nightly-dev tags from nightly DockerHub cleanup (#55023)
Signed-off-by: khluu <khluu000@gmail.com>
2026-09-02 15:09:18 -07:00
Micah Williamson e3e1241003 [ROCm][CI] Extend Multimodal Processor Shard timeout on AMD CI (#55011)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
2026-09-02 21:11:46 +00:00
Reid 60857baa53 [Bugfix][Rust Frontend][Renderer] Align DeepSeek V4 historical developer message handling (#54854)
Signed-off-by: reidliu41 <reid201711@gmail.com>
2026-09-02 20:43:57 +00:00
Wentao Ye a56654d6de [K3 Perf] Enable DSV3 GEMM for inner-contiguous and row-strided tensors, 12%~81% kernel performance improvement (#54565)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
2026-09-02 12:22:40 -07:00
Sheral KumarandAndreas Karatzas 0e3ac4907d [ROCm][CI] Fix false multi-node detection on native CI (#54989)
Signed-off-by: Sheral Kumar <shekumar@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-09-02 13:53:07 -05:00
Luke Alonso 1945a94575 [Bugfix][Tests] Stabilize B12X linear kernel checks (#54996)
Signed-off-by: Luke Alonso <lalonso@gmail.com>
2026-09-02 18:46:08 +00:00
stefankoncarevic 9b38e3ad53 [CI][MoE] Moe kernels test cleanup (#54954)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
2026-09-02 13:31:36 -05:00
stefankoncarevic 3e9d364ff7 [CI/Build][ROCm] Guard the two CUDA-only tests in test_bf16_skinny_gemm (#54984)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
2026-09-02 13:21:18 -05:00
stefankoncarevic 2691c6cc53 [Bugfix][CI] Set cudagraph_mode=FULL for the Ernie4.5-VL ViT cudagraph test (#54957)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
2026-09-02 13:18:56 -05:00
bf7a14d307 [CI][ROCm] Add DSpark evals (#54852)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 13:14:32 -05:00
Isotr0py 1356635d83 [New model][Multimodal] Add DeepSeek-V4-Flash-Vision-Exp support (#54566)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
2026-09-02 11:09:09 -07:00
fxmarty-amd 488e6fd53c [CI] Revert flaky test_quark_int8_w8a8_moe (#54991)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
2026-09-02 13:58:14 -04:00