Commit Graph
20795 Commits
Author SHA1 Message Date
Zhaodong BingTJianZhaodong BingCursormergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Zhaodong Bing
5d09eb2cf3 [Bugfix][MoE] Preserve unquantized weight storage on ROCm (#46009)
Signed-off-by: bingzhaodong <aaab8b@gmail.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Zhaodong Bing <zhaobing@smc300x-ccs-aus-gpuf2c5.prov.aus.ccs.cpe.ice.amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Zhaodong Bing <zhaobing@smc300x-ccs-aus-gpuf2a0.prov.aus.ccs.cpe.ice.amd.com>
2026-09-03 11:06:09 +08:00
Giuseppe GrossiandAndreas Karatzas e47356c63e [ROCm][Installation] Add mooncake package to image using public wheels (#55002)
Signed-off-by: Giuseppe Grossi <ggrossi@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-09-02 21:48:36 -05:00
Kevin H. Luu 5e4e927b5e [CI] Force HTTP/1.1 for runtime Git installs (#55044)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
2026-09-03 10:14:22 +08:00
Woosuk Kwon 0e14198a63 [Skills] Add kernel benchmark sanity references (#54995)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
2026-09-02 17:58:55 -07:00
Bugen Zhao ad127d9a0f [Perf][Rust Frontend] Coalesce decoded chunks per engine update (#55012)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-09-02 15:44:23 -07:00
Woosuk KwonandOpenAI Codex 443febe723 [Agents] Expose Triton kernel-writing skill to Claude (#55028)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 15:36:12 -07:00
Woosuk KwonandOpenAI Codex cf3263d571 [Agents] Add Triton kernel-writing skill (#55019)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 15:29:16 -07:00
Kevin H. LuuandKimi Code 6c6376a09e [CI] Remove deleted nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 and its arch aliases (#55026)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
2026-09-02 15:18:46 -07:00
a0d3e5c16e [XPU] Add fused GemmaRMSNorm path for eager execution (#53678)
Signed-off-by: Huanxing <huanxing.shen@intel.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
2026-09-03 06:11:20 +08:00
Kevin H. Luu 963054ed58 [CI] Exclude nightly-dev tags from nightly DockerHub cleanup (#55023)
Signed-off-by: khluu <khluu000@gmail.com>
2026-09-02 15:09:18 -07:00
Micah Williamson e3e1241003 [ROCm][CI] Extend Multimodal Processor Shard timeout on AMD CI (#55011)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
2026-09-02 21:11:46 +00:00
Reid 60857baa53 [Bugfix][Rust Frontend][Renderer] Align DeepSeek V4 historical developer message handling (#54854)
Signed-off-by: reidliu41 <reid201711@gmail.com>
2026-09-02 20:43:57 +00:00
Wentao Ye a56654d6de [K3 Perf] Enable DSV3 GEMM for inner-contiguous and row-strided tensors, 12%~81% kernel performance improvement (#54565)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
2026-09-02 12:22:40 -07:00
Sheral KumarandAndreas Karatzas 0e3ac4907d [ROCm][CI] Fix false multi-node detection on native CI (#54989)
Signed-off-by: Sheral Kumar <shekumar@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-09-02 13:53:07 -05:00
Luke Alonso 1945a94575 [Bugfix][Tests] Stabilize B12X linear kernel checks (#54996)
Signed-off-by: Luke Alonso <lalonso@gmail.com>
2026-09-02 18:46:08 +00:00
stefankoncarevic 9b38e3ad53 [CI][MoE] Moe kernels test cleanup (#54954)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
2026-09-02 13:31:36 -05:00
stefankoncarevic 3e9d364ff7 [CI/Build][ROCm] Guard the two CUDA-only tests in test_bf16_skinny_gemm (#54984)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
2026-09-02 13:21:18 -05:00
stefankoncarevic 2691c6cc53 [Bugfix][CI] Set cudagraph_mode=FULL for the Ernie4.5-VL ViT cudagraph test (#54957)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
2026-09-02 13:18:56 -05:00
bf7a14d307 [CI][ROCm] Add DSpark evals (#54852)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 13:14:32 -05:00
Isotr0py 1356635d83 [New model][Multimodal] Add DeepSeek-V4-Flash-Vision-Exp support (#54566)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
2026-09-02 11:09:09 -07:00
fxmarty-amd 488e6fd53c [CI] Revert flaky test_quark_int8_w8a8_moe (#54991)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
2026-09-02 13:58:14 -04:00
Shengqi Chen 605c3ddcba [BUILD] Bump cutlass to v4.7.1 (#54190)
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
2026-09-02 10:17:41 -07:00
Harry MellorandClaude Opus 5 d539de1c5d [Docs] Add missing return annotations flagged by griffe (#54980)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-02 09:56:07 -07:00
Hung Hoang (黄兴)andCyrus Leung 3b45d053b4 [Bugfix][Model] Fix CohereASR streaming audio-token estimate (unit + subsampling) (#53829)
Signed-off-by: hungh <hungh@nvidia.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
2026-09-02 08:55:16 -07:00
Ilia Yastrebov 41848caa63 [NIXL] Use int32 array for indices to avoid intermediate conversion (#51952)
Signed-off-by: Ilia Yastrebov <iyastrebov@nvidia.com>
2026-09-02 16:30:16 +02:00
waizuichougou c6bca6e585 [Bugfix][Multimodal] Scope cache hash kwargs by modality (#54918)
Signed-off-by: waizuichougou <2082431897@qq.com>
2026-09-02 14:20:26 +00:00
Misha GoinandOpenAI Codex 872084fb77 [CI] Add Kimi-K3-pruned75-DSpark-TP4 gsm8k eval (#54817)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-09-02 10:18:38 -04:00
drakoshaandClaude ba6c60e98f [Bugfix][KV Offload] Scale UniformTypeKVCacheSpecs groups by DCP (#50883)
Signed-off-by: Mikhail Kostryukov <mike@triptrack.net>
Co-authored-by: Claude <noreply@anthropic.com>
2026-09-02 17:11:48 +03:00
AlexHuangandOpenAI Codex 35faf957d6 [Bugfix][KV Offload] Ignore stale async lookup results (#54872)
Signed-off-by: Alex <jihui.huang@daocloud.io>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-09-02 17:10:26 +03:00
Tomasz Zielinskimergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Claude Opus 5Harry Mellor
ffe3bb3c72 [Hardware][XPU] Register matmul and linear batch-invariant kernels for XPU (#49209)
Signed-off-by: tzielinski-habana <tomasz.zielinski@intel.com>
Signed-off-by: Tomasz Zielinski <85164140+tzielinski-habana@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-09-02 13:31:38 +00:00
fxmarty-amd 7894394b07 [Online quantization] Add targeted online quantization configuration based on user patterns (#51285) 2026-09-02 08:55:15 -04:00
Cheng RuiandCodex 2a4e3cc3db [Bugfix][KV Offload] Ensure tracker progress for oversized offers (#54759)
Signed-off-by: Cheng Rui <286040359@qq.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-02 14:09:29 +03:00
Nicolò Lucchesiandcjackal f81eb41934 [Bugfix] adjust_dcp_kv_cache_interleave_size for NixlConnector only (#54803)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: cjackal <44624812+cjackal@users.noreply.github.com>
2026-09-02 12:31:14 +02:00
Tarun Kumar 3140531773 Include chat template fallbacks in package_data (#53762)
Signed-off-by: Tarun Kumar <takumar@redhat.com>
2026-09-02 09:44:06 +00:00
Kevin H. Luu 76ba32160a [CI] Shard CPU jobs above the 24h P90 threshold (#54751)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
2026-09-02 02:16:05 -07:00
Simon DanielssonAndreas Karatzasmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
b205750fe0 [Bugfix][ROCm][Build] fix profiler hang due to queue interposition bug (#54171)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-02 08:59:23 +00:00
Isotr0py 1c26e57d3c [Bugfix] Raise for unavailable piecewise CUDA graphs (#54782)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
2026-09-02 08:52:24 +00:00
jackLeiandOpenAI Codex 584e8f0dda [Model] Fix GLM-OCR MTP weight loading (#49869)
Signed-off-by: jackLei0901 <42642542+jackLei0901@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 08:38:36 +00:00
Andreas KaratzasandOpenAI Codex 87deddc7a4 [CI][Spec Decode] Add MTP placeholder-token regression coverage (#54893)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 03:29:38 -05:00
Andreas KaratzasandOpenAI Codex c6005000d3 [CI][ROCm] Prefetch safetensors weights in AMD CI (#54898)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 03:28:39 -05:00
Andreas KaratzasandOpenAI Codex e52407ef4c [ROCm][CI] Add MTP and other spec-decode acceptance coverage (#53399)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 03:27:05 -05:00
Fabian JoswigandYifan Qiao 8052102c21 [Bugfix] Fix cross-batch buffer race corrupting DiskBackend loads (#51667)
Signed-off-by: Fabian Joswig <fjosw@users.noreply.github.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
2026-09-02 08:18:41 +00:00
Andreas KaratzasandOpenAI Codex 01eeb798b6 [CI][AMD] Preserve diagnostics for unwritable checkouts (#53437)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 03:18:27 -05:00
Kevin H. Luu f5711fa138 [CI] Shard LoRA TP distributed tests (#52350)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
2026-09-02 01:16:44 -07:00
Chauncey b2558f8da3 [Bugfix] Fix launch render hanging on shutdown (#54913)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
2026-09-02 08:15:35 +00:00
Zeyu YangandYikun Jiang c23e15be9f [CI][Fix] Resolved the Ascend NPU test build image fail and add file dependencies (#50504)
Signed-off-by: yangzeyu <yangzeyu7@huawei.com>
Co-authored-by: Yikun Jiang <yikunkero@gmail.com>
2026-09-02 08:14:00 +00:00
Kevin H. Luu 878ec4bfee [CI] Shard entrypoints API-server tests (#52344)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
2026-09-02 01:13:38 -07:00
stefankoncarevic 62588e0592 [CI] Batch the swap_blocks verification instead of copying block by block (#54558)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
2026-09-02 03:12:40 -05:00
Kevin H. Luu 1b4b2a18b8 [CI] Shard H100 MoE refactor integration tests (#52352)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
2026-09-02 01:10:14 -07:00
Itay EtelisItay EtelisOr Ozerimergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
df09c76735 [KV Connector][Offloading] Look through UniformTypeKVCacheSpecs in the canonical portability gate (#51690)
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-02 10:43:26 +03:00