Commit Graph
7673 Commits
Author SHA1 Message Date
Fangzhou Ai 8bf39632b8 [ROCm][Perf] Add low-M FP32 router GEMM for gfx950 (#54845) 2026-09-03 10:42:25 -07:00
b7624069ff [Fusion] Manual ActivationQuantFusionPass initial application (#51415)
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: ElizaWszola <ewszola@redhat.com>
2026-09-03 13:37:31 -04:00
sychen52andVadim Gimpelson d4d703caf9 [Bugfix][Model] Fix FP8 PLE loading in mixed ModelOpt checkpoints (#54882)
Signed-off-by: Shiyang Chen <shiychen@nvidia.com>
Co-authored-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>
2026-09-03 21:09:39 +04:00
Jiangyun Zhu 98ed0856f3 [Model] add GLM-5.3-Flash support (#53906) 2026-09-03 09:40:35 -07:00
Yifan Jiang da8ec28268 [Bugfix][KV Offload] Do not let a recurrent group's unhashed block truncate the load boundary (#52807)
Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
2026-09-03 19:08:46 +03:00
mevince 4ae6228284 [Bugfix][KV Connector] Populate SimpleCPUOffload BlockStored metadata (#54325) 2026-09-03 15:58:07 +00:00
Nick Hill e55b93f296 [Core] Deprecate "all" mamba cache mode (#55041)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
2026-09-03 08:56:59 -07:00
Jeff (Junze) MaandOpenAI Codex 31e9c13685 [Bugfix][KV Connector] Safely fill circular buffers in DecodeBench (#54879)
Signed-off-by: Jeff Ma <jeffjma@umich.edu>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-09-03 15:16:22 +00:00
Nick Hillandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> bf95f58d10 [Core] Triton kernel for small-batch top-p only masking (#54651)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-03 07:52:47 -07:00
JasonCohereandCursor bb363db9a5 feat: Add support for reasoning_token_count to reasoning parser (#54982)
Signed-off-by: Jason Ozuzu <jasonozuzu@cohere.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-03 05:02:49 -07:00
SunandCodex 848ab131bc [Perf] Accumulate Conformer attention scores with baddbmm (#55062)
Signed-off-by: levius <2114377220@qq.com>
Co-authored-by: Codex <codex@openai.com>
2026-09-03 04:17:52 -07:00
Taneem Ibrahim 758c79e1c5 [Bugfix] Retain vocab embeddings during replacement (#55083)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
2026-09-03 04:17:38 -07:00
ee0a4c46ae [Bugfix] Account for PCP in multi-node world size validation (#55111)
Signed-off-by: DebugSy <532151398@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-09-03 10:52:42 +00:00
Zupeng WangOpenAImergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
c21751c90b [Kernel] Warm up Qwen GDN gated RMSNorm (#54251)
Signed-off-by: Zupeng Wang <71580390+zupengwang@users.noreply.github.com>
Co-authored-by: OpenAI <support@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-03 18:19:48 +08:00
Andreas Karatzas 096d8e8ce6 [ROCm][CI] Add MiniMax reduce RMS kernel coverage (#55057)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
2026-09-03 04:07:59 -05:00
Bowen Tan 1f76efaa21 [Model] Add K2-Horizon model support (#55063) 2026-09-03 01:17:08 -07:00
092334c828 [Bugfix] Wait for offload keys before storing chunks (#52923)
Signed-off-by: chuanzhisongshu <49055103+982945902@users.noreply.github.com>
Co-authored-by: lishuo121 <lishuo121@jd.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
2026-09-03 11:07:35 +03:00
Derek WeitzelandClaude Fable 5.1 859dd39512 [Bugfix][Core] Wait for the previous PP tensor sends before the next forward pass (#54962)
Signed-off-by: Derek Weitzel <djw8605@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-03 08:01:36 +00:00
Clinton ThomasandLucas Bourtoule ee17d0d869 Use server-generated keys for late-interaction query caches (#51445)
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com>
2026-09-03 07:15:58 +00:00
waizuichougouandNick Hill 3f1af35e01 [Bugfix][Multimodal] Handle prefix-covered items in SHM worker cache (#54994)
Signed-off-by: waizuichougou <2082431897@qq.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
2026-09-03 06:39:34 +00:00
Taneem Ibrahim 27a94d1ce4 [CI] Fix DeepSeek-V4 registry platform guard (#55042)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
2026-09-03 03:27:01 +00:00
Zhaodong BingTJianZhaodong BingCursormergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Zhaodong Bing
5d09eb2cf3 [Bugfix][MoE] Preserve unquantized weight storage on ROCm (#46009)
Signed-off-by: bingzhaodong <aaab8b@gmail.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Zhaodong Bing <zhaobing@smc300x-ccs-aus-gpuf2c5.prov.aus.ccs.cpe.ice.amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Zhaodong Bing <zhaobing@smc300x-ccs-aus-gpuf2a0.prov.aus.ccs.cpe.ice.amd.com>
2026-09-03 11:06:09 +08:00
Kevin H. LuuandKimi Code 6c6376a09e [CI] Remove deleted nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 and its arch aliases (#55026)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
2026-09-02 15:18:46 -07:00
Wentao Ye a56654d6de [K3 Perf] Enable DSV3 GEMM for inner-contiguous and row-strided tensors, 12%~81% kernel performance improvement (#54565)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
2026-09-02 12:22:40 -07:00
Luke Alonso 1945a94575 [Bugfix][Tests] Stabilize B12X linear kernel checks (#54996)
Signed-off-by: Luke Alonso <lalonso@gmail.com>
2026-09-02 18:46:08 +00:00
stefankoncarevic 9b38e3ad53 [CI][MoE] Moe kernels test cleanup (#54954)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
2026-09-02 13:31:36 -05:00
stefankoncarevic 3e9d364ff7 [CI/Build][ROCm] Guard the two CUDA-only tests in test_bf16_skinny_gemm (#54984)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
2026-09-02 13:21:18 -05:00
stefankoncarevic 2691c6cc53 [Bugfix][CI] Set cudagraph_mode=FULL for the Ernie4.5-VL ViT cudagraph test (#54957)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
2026-09-02 13:18:56 -05:00
bf7a14d307 [CI][ROCm] Add DSpark evals (#54852)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 13:14:32 -05:00
Isotr0py 1356635d83 [New model][Multimodal] Add DeepSeek-V4-Flash-Vision-Exp support (#54566)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
2026-09-02 11:09:09 -07:00
fxmarty-amd 488e6fd53c [CI] Revert flaky test_quark_int8_w8a8_moe (#54991)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
2026-09-02 13:58:14 -04:00
Hung Hoang (黄兴)andCyrus Leung 3b45d053b4 [Bugfix][Model] Fix CohereASR streaming audio-token estimate (unit + subsampling) (#53829)
Signed-off-by: hungh <hungh@nvidia.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
2026-09-02 08:55:16 -07:00
Ilia Yastrebov 41848caa63 [NIXL] Use int32 array for indices to avoid intermediate conversion (#51952)
Signed-off-by: Ilia Yastrebov <iyastrebov@nvidia.com>
2026-09-02 16:30:16 +02:00
waizuichougou c6bca6e585 [Bugfix][Multimodal] Scope cache hash kwargs by modality (#54918)
Signed-off-by: waizuichougou <2082431897@qq.com>
2026-09-02 14:20:26 +00:00
Misha GoinandOpenAI Codex 872084fb77 [CI] Add Kimi-K3-pruned75-DSpark-TP4 gsm8k eval (#54817)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-09-02 10:18:38 -04:00
drakoshaandClaude ba6c60e98f [Bugfix][KV Offload] Scale UniformTypeKVCacheSpecs groups by DCP (#50883)
Signed-off-by: Mikhail Kostryukov <mike@triptrack.net>
Co-authored-by: Claude <noreply@anthropic.com>
2026-09-02 17:11:48 +03:00
AlexHuangandOpenAI Codex 35faf957d6 [Bugfix][KV Offload] Ignore stale async lookup results (#54872)
Signed-off-by: Alex <jihui.huang@daocloud.io>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-09-02 17:10:26 +03:00
Tomasz Zielinskimergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Claude Opus 5Harry Mellor
ffe3bb3c72 [Hardware][XPU] Register matmul and linear batch-invariant kernels for XPU (#49209)
Signed-off-by: tzielinski-habana <tomasz.zielinski@intel.com>
Signed-off-by: Tomasz Zielinski <85164140+tzielinski-habana@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-09-02 13:31:38 +00:00
fxmarty-amd 7894394b07 [Online quantization] Add targeted online quantization configuration based on user patterns (#51285) 2026-09-02 08:55:15 -04:00
Cheng RuiandCodex 2a4e3cc3db [Bugfix][KV Offload] Ensure tracker progress for oversized offers (#54759)
Signed-off-by: Cheng Rui <286040359@qq.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-02 14:09:29 +03:00
Nicolò Lucchesiandcjackal f81eb41934 [Bugfix] adjust_dcp_kv_cache_interleave_size for NixlConnector only (#54803)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: cjackal <44624812+cjackal@users.noreply.github.com>
2026-09-02 12:31:14 +02:00
Kevin H. Luu 76ba32160a [CI] Shard CPU jobs above the 24h P90 threshold (#54751)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
2026-09-02 02:16:05 -07:00
jackLeiandOpenAI Codex 584e8f0dda [Model] Fix GLM-OCR MTP weight loading (#49869)
Signed-off-by: jackLei0901 <42642542+jackLei0901@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 08:38:36 +00:00
Andreas KaratzasandOpenAI Codex 87deddc7a4 [CI][Spec Decode] Add MTP placeholder-token regression coverage (#54893)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 03:29:38 -05:00
Andreas KaratzasandOpenAI Codex c6005000d3 [CI][ROCm] Prefetch safetensors weights in AMD CI (#54898)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 03:28:39 -05:00
stefankoncarevic 62588e0592 [CI] Batch the swap_blocks verification instead of copying block by block (#54558)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
2026-09-02 03:12:40 -05:00
Kevin H. Luu 1b4b2a18b8 [CI] Shard H100 MoE refactor integration tests (#52352)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
2026-09-02 01:10:14 -07:00
Itay EtelisItay EtelisOr Ozerimergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
df09c76735 [KV Connector][Offloading] Look through UniformTypeKVCacheSpecs in the canonical portability gate (#51690)
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-02 10:43:26 +03:00
Yusuke OdaandChauncey 798b557e06 [Frontend] Add site-packages support for reasoning/tool parser plugins (#45241)
Signed-off-by: odashi <yusuke.oda@predicate.jp>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
2026-09-02 07:41:13 +00:00
Thien Tran f4e6136146 [Kimi-K3] Bump FlashKDA to fix unstable inverse (#54859)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
2026-09-02 00:16:29 -07:00