Commit Graph
20807 Commits
Author SHA1 Message Date
Giancarlo Delfin facd9a74a1 [Model Runner V2][Spec Decode] Skip DP sync for all speculator uniform decodes (#54856) 2026-09-03 10:32:33 +00:00
djramic 0d3ede3e3b [Bugfix][Model] Enable torch.compile for StableLM (#54969)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
2026-09-03 03:21:54 -07:00
Zupeng WangOpenAImergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
c21751c90b [Kernel] Warm up Qwen GDN gated RMSNorm (#54251)
Signed-off-by: Zupeng Wang <71580390+zupengwang@users.noreply.github.com>
Co-authored-by: OpenAI <support@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-03 18:19:48 +08:00
Andreas Karatzas 4cc0cb6f76 [CI][AMD] Avoid expandable segments in LoRA TP tests (#55094)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
2026-09-03 09:55:10 +00:00
Harry Mellor e6eb9074e9 [CI] Bump Transformers version to 5.16.1 (#53905)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-09-03 02:12:43 -07:00
Andreas Karatzas 096d8e8ce6 [ROCm][CI] Add MiniMax reduce RMS kernel coverage (#55057)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
2026-09-03 04:07:59 -05:00
Bowen Tan 1f76efaa21 [Model] Add K2-Horizon model support (#55063) 2026-09-03 01:17:08 -07:00
092334c828 [Bugfix] Wait for offload keys before storing chunks (#52923)
Signed-off-by: chuanzhisongshu <49055103+982945902@users.noreply.github.com>
Co-authored-by: lishuo121 <lishuo121@jd.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
2026-09-03 11:07:35 +03:00
Derek WeitzelandClaude Fable 5.1 859dd39512 [Bugfix][Core] Wait for the previous PP tensor sends before the next forward pass (#54962)
Signed-off-by: Derek Weitzel <djw8605@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-03 08:01:36 +00:00
Clinton ThomasandLucas Bourtoule ee17d0d869 Use server-generated keys for late-interaction query caches (#51445)
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com>
2026-09-03 07:15:58 +00:00
waizuichougouandNick Hill 3f1af35e01 [Bugfix][Multimodal] Handle prefix-covered items in SHM worker cache (#54994)
Signed-off-by: waizuichougou <2082431897@qq.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
2026-09-03 06:39:34 +00:00
Taneem Ibrahim 27a94d1ce4 [CI] Fix DeepSeek-V4 registry platform guard (#55042)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
2026-09-03 03:27:01 +00:00
Zhaodong BingTJianZhaodong BingCursormergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Zhaodong Bing
5d09eb2cf3 [Bugfix][MoE] Preserve unquantized weight storage on ROCm (#46009)
Signed-off-by: bingzhaodong <aaab8b@gmail.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Zhaodong Bing <zhaobing@smc300x-ccs-aus-gpuf2c5.prov.aus.ccs.cpe.ice.amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Zhaodong Bing <zhaobing@smc300x-ccs-aus-gpuf2a0.prov.aus.ccs.cpe.ice.amd.com>
2026-09-03 11:06:09 +08:00
Giuseppe GrossiandAndreas Karatzas e47356c63e [ROCm][Installation] Add mooncake package to image using public wheels (#55002)
Signed-off-by: Giuseppe Grossi <ggrossi@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-09-02 21:48:36 -05:00
Kevin H. Luu 5e4e927b5e [CI] Force HTTP/1.1 for runtime Git installs (#55044)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
2026-09-03 10:14:22 +08:00
Woosuk Kwon 0e14198a63 [Skills] Add kernel benchmark sanity references (#54995)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
2026-09-02 17:58:55 -07:00
Bugen Zhao ad127d9a0f [Perf][Rust Frontend] Coalesce decoded chunks per engine update (#55012)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-09-02 15:44:23 -07:00
Woosuk KwonandOpenAI Codex 443febe723 [Agents] Expose Triton kernel-writing skill to Claude (#55028)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 15:36:12 -07:00
Woosuk KwonandOpenAI Codex cf3263d571 [Agents] Add Triton kernel-writing skill (#55019)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 15:29:16 -07:00
Kevin H. LuuandKimi Code 6c6376a09e [CI] Remove deleted nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 and its arch aliases (#55026)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
2026-09-02 15:18:46 -07:00
a0d3e5c16e [XPU] Add fused GemmaRMSNorm path for eager execution (#53678)
Signed-off-by: Huanxing <huanxing.shen@intel.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
2026-09-03 06:11:20 +08:00
Kevin H. Luu 963054ed58 [CI] Exclude nightly-dev tags from nightly DockerHub cleanup (#55023)
Signed-off-by: khluu <khluu000@gmail.com>
2026-09-02 15:09:18 -07:00
Micah Williamson e3e1241003 [ROCm][CI] Extend Multimodal Processor Shard timeout on AMD CI (#55011)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
2026-09-02 21:11:46 +00:00
Reid 60857baa53 [Bugfix][Rust Frontend][Renderer] Align DeepSeek V4 historical developer message handling (#54854)
Signed-off-by: reidliu41 <reid201711@gmail.com>
2026-09-02 20:43:57 +00:00
Wentao Ye a56654d6de [K3 Perf] Enable DSV3 GEMM for inner-contiguous and row-strided tensors, 12%~81% kernel performance improvement (#54565)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
2026-09-02 12:22:40 -07:00
Sheral KumarandAndreas Karatzas 0e3ac4907d [ROCm][CI] Fix false multi-node detection on native CI (#54989)
Signed-off-by: Sheral Kumar <shekumar@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-09-02 13:53:07 -05:00
Luke Alonso 1945a94575 [Bugfix][Tests] Stabilize B12X linear kernel checks (#54996)
Signed-off-by: Luke Alonso <lalonso@gmail.com>
2026-09-02 18:46:08 +00:00
stefankoncarevic 9b38e3ad53 [CI][MoE] Moe kernels test cleanup (#54954)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
2026-09-02 13:31:36 -05:00
stefankoncarevic 3e9d364ff7 [CI/Build][ROCm] Guard the two CUDA-only tests in test_bf16_skinny_gemm (#54984)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
2026-09-02 13:21:18 -05:00
stefankoncarevic 2691c6cc53 [Bugfix][CI] Set cudagraph_mode=FULL for the Ernie4.5-VL ViT cudagraph test (#54957)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
2026-09-02 13:18:56 -05:00
bf7a14d307 [CI][ROCm] Add DSpark evals (#54852)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 13:14:32 -05:00
Isotr0py 1356635d83 [New model][Multimodal] Add DeepSeek-V4-Flash-Vision-Exp support (#54566)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
2026-09-02 11:09:09 -07:00
fxmarty-amd 488e6fd53c [CI] Revert flaky test_quark_int8_w8a8_moe (#54991)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
2026-09-02 13:58:14 -04:00
Shengqi Chen 605c3ddcba [BUILD] Bump cutlass to v4.7.1 (#54190)
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
2026-09-02 10:17:41 -07:00
Harry MellorandClaude Opus 5 d539de1c5d [Docs] Add missing return annotations flagged by griffe (#54980)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-02 09:56:07 -07:00
Hung Hoang (黄兴)andCyrus Leung 3b45d053b4 [Bugfix][Model] Fix CohereASR streaming audio-token estimate (unit + subsampling) (#53829)
Signed-off-by: hungh <hungh@nvidia.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
2026-09-02 08:55:16 -07:00
Ilia Yastrebov 41848caa63 [NIXL] Use int32 array for indices to avoid intermediate conversion (#51952)
Signed-off-by: Ilia Yastrebov <iyastrebov@nvidia.com>
2026-09-02 16:30:16 +02:00
waizuichougou c6bca6e585 [Bugfix][Multimodal] Scope cache hash kwargs by modality (#54918)
Signed-off-by: waizuichougou <2082431897@qq.com>
2026-09-02 14:20:26 +00:00
Misha GoinandOpenAI Codex 872084fb77 [CI] Add Kimi-K3-pruned75-DSpark-TP4 gsm8k eval (#54817)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-09-02 10:18:38 -04:00
drakoshaandClaude ba6c60e98f [Bugfix][KV Offload] Scale UniformTypeKVCacheSpecs groups by DCP (#50883)
Signed-off-by: Mikhail Kostryukov <mike@triptrack.net>
Co-authored-by: Claude <noreply@anthropic.com>
2026-09-02 17:11:48 +03:00
AlexHuangandOpenAI Codex 35faf957d6 [Bugfix][KV Offload] Ignore stale async lookup results (#54872)
Signed-off-by: Alex <jihui.huang@daocloud.io>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-09-02 17:10:26 +03:00
Tomasz Zielinskimergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Claude Opus 5Harry Mellor
ffe3bb3c72 [Hardware][XPU] Register matmul and linear batch-invariant kernels for XPU (#49209)
Signed-off-by: tzielinski-habana <tomasz.zielinski@intel.com>
Signed-off-by: Tomasz Zielinski <85164140+tzielinski-habana@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-09-02 13:31:38 +00:00
fxmarty-amd 7894394b07 [Online quantization] Add targeted online quantization configuration based on user patterns (#51285) 2026-09-02 08:55:15 -04:00
Cheng RuiandCodex 2a4e3cc3db [Bugfix][KV Offload] Ensure tracker progress for oversized offers (#54759)
Signed-off-by: Cheng Rui <286040359@qq.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-02 14:09:29 +03:00
Nicolò Lucchesiandcjackal f81eb41934 [Bugfix] adjust_dcp_kv_cache_interleave_size for NixlConnector only (#54803)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: cjackal <44624812+cjackal@users.noreply.github.com>
2026-09-02 12:31:14 +02:00
Tarun Kumar 3140531773 Include chat template fallbacks in package_data (#53762)
Signed-off-by: Tarun Kumar <takumar@redhat.com>
2026-09-02 09:44:06 +00:00
Kevin H. Luu 76ba32160a [CI] Shard CPU jobs above the 24h P90 threshold (#54751)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
2026-09-02 02:16:05 -07:00
Simon DanielssonAndreas Karatzasmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
b205750fe0 [Bugfix][ROCm][Build] fix profiler hang due to queue interposition bug (#54171)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-02 08:59:23 +00:00
Isotr0py 1c26e57d3c [Bugfix] Raise for unavailable piecewise CUDA graphs (#54782)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
2026-09-02 08:52:24 +00:00
jackLeiandOpenAI Codex 584e8f0dda [Model] Fix GLM-OCR MTP weight loading (#49869)
Signed-off-by: jackLei0901 <42642542+jackLei0901@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 08:38:36 +00:00