Commit Graph
20767 Commits
Author SHA1 Message Date
AlexHuangandOpenAI Codex 35faf957d6 [Bugfix][KV Offload] Ignore stale async lookup results (#54872)
Signed-off-by: Alex <jihui.huang@daocloud.io>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-09-02 17:10:26 +03:00
Tomasz Zielinskimergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Claude Opus 5Harry Mellor
ffe3bb3c72 [Hardware][XPU] Register matmul and linear batch-invariant kernels for XPU (#49209)
Signed-off-by: tzielinski-habana <tomasz.zielinski@intel.com>
Signed-off-by: Tomasz Zielinski <85164140+tzielinski-habana@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-09-02 13:31:38 +00:00
fxmarty-amd 7894394b07 [Online quantization] Add targeted online quantization configuration based on user patterns (#51285) 2026-09-02 08:55:15 -04:00
Cheng RuiandCodex 2a4e3cc3db [Bugfix][KV Offload] Ensure tracker progress for oversized offers (#54759)
Signed-off-by: Cheng Rui <286040359@qq.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-02 14:09:29 +03:00
Nicolò Lucchesiandcjackal f81eb41934 [Bugfix] adjust_dcp_kv_cache_interleave_size for NixlConnector only (#54803)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: cjackal <44624812+cjackal@users.noreply.github.com>
2026-09-02 12:31:14 +02:00
Tarun Kumar 3140531773 Include chat template fallbacks in package_data (#53762)
Signed-off-by: Tarun Kumar <takumar@redhat.com>
2026-09-02 09:44:06 +00:00
Kevin H. Luu 76ba32160a [CI] Shard CPU jobs above the 24h P90 threshold (#54751)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
2026-09-02 02:16:05 -07:00
Simon DanielssonAndreas Karatzasmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
b205750fe0 [Bugfix][ROCm][Build] fix profiler hang due to queue interposition bug (#54171)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-02 08:59:23 +00:00
Isotr0py 1c26e57d3c [Bugfix] Raise for unavailable piecewise CUDA graphs (#54782)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
2026-09-02 08:52:24 +00:00
jackLeiandOpenAI Codex 584e8f0dda [Model] Fix GLM-OCR MTP weight loading (#49869)
Signed-off-by: jackLei0901 <42642542+jackLei0901@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 08:38:36 +00:00
Andreas KaratzasandOpenAI Codex 87deddc7a4 [CI][Spec Decode] Add MTP placeholder-token regression coverage (#54893)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 03:29:38 -05:00
Andreas KaratzasandOpenAI Codex c6005000d3 [CI][ROCm] Prefetch safetensors weights in AMD CI (#54898)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 03:28:39 -05:00
Andreas KaratzasandOpenAI Codex e52407ef4c [ROCm][CI] Add MTP and other spec-decode acceptance coverage (#53399)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 03:27:05 -05:00
Fabian JoswigandYifan Qiao 8052102c21 [Bugfix] Fix cross-batch buffer race corrupting DiskBackend loads (#51667)
Signed-off-by: Fabian Joswig <fjosw@users.noreply.github.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
2026-09-02 08:18:41 +00:00
Andreas KaratzasandOpenAI Codex 01eeb798b6 [CI][AMD] Preserve diagnostics for unwritable checkouts (#53437)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 03:18:27 -05:00
Kevin H. Luu f5711fa138 [CI] Shard LoRA TP distributed tests (#52350)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
2026-09-02 01:16:44 -07:00
Chauncey b2558f8da3 [Bugfix] Fix launch render hanging on shutdown (#54913)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
2026-09-02 08:15:35 +00:00
Zeyu YangandYikun Jiang c23e15be9f [CI][Fix] Resolved the Ascend NPU test build image fail and add file dependencies (#50504)
Signed-off-by: yangzeyu <yangzeyu7@huawei.com>
Co-authored-by: Yikun Jiang <yikunkero@gmail.com>
2026-09-02 08:14:00 +00:00
Kevin H. Luu 878ec4bfee [CI] Shard entrypoints API-server tests (#52344)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
2026-09-02 01:13:38 -07:00
stefankoncarevic 62588e0592 [CI] Batch the swap_blocks verification instead of copying block by block (#54558)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
2026-09-02 03:12:40 -05:00
Kevin H. Luu 1b4b2a18b8 [CI] Shard H100 MoE refactor integration tests (#52352)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
2026-09-02 01:10:14 -07:00
Itay EtelisItay EtelisOr Ozerimergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
df09c76735 [KV Connector][Offloading] Look through UniformTypeKVCacheSpecs in the canonical portability gate (#51690)
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-02 10:43:26 +03:00
Yusuke OdaandChauncey 798b557e06 [Frontend] Add site-packages support for reasoning/tool parser plugins (#45241)
Signed-off-by: odashi <yusuke.oda@predicate.jp>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
2026-09-02 07:41:13 +00:00
Thien Tran f4e6136146 [Kimi-K3] Bump FlashKDA to fix unstable inverse (#54859)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
2026-09-02 00:16:29 -07:00
Francisco Javier Arceo c00091e026 [Frontend] Gate scale-out endpoints behind opt-in flag (#54579)
Signed-off-by: Francisco Javier Arceo <farceo@redhat.com>
2026-09-02 14:31:14 +08:00
Flora Feng 300f688321 [Bugfix] Implicitly close DeepSeek DSML parameters (#54838)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
2026-09-02 14:13:36 +08:00
Kevin H. Luu 3976eada8b [CI] Use PR head label for Buildkite branch to avoid main collision (#54895)
Signed-off-by: khluu <khluu000@gmail.com>
2026-09-01 23:09:50 -07:00
Qiming Zhang aae36577fb [XPU][UT] skip fp8_per_channel test on XPU (#54861)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
2026-09-02 13:17:10 +08:00
Giuseppe GrossiandAndreas Karatzas 56b5495377 [ROCm][AMD][Installation] Add mooncake build to rocm base image (#52650)
Signed-off-by: Giuseppe Grossi <ggrossi@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-09-02 00:14:58 -05:00
xiangdong ad76610c40 [XPU][CI] Move heavy jobs to nightly test in Intel GPU CI (#54863)
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
2026-09-02 13:11:01 +08:00
Andreas KaratzasandOpenAI Codex 73029d4244 [CI][ROCm] Calibrate AMD test timeouts from nightly runtimes (#54695)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-01 23:53:12 -05:00
Thien TranandCodex f870b92976 [Qwen3.8-Flash-Next] Fuse Qwen4Exp PLE kernels (#54517)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Codex <codex@openai.com>
2026-09-02 12:32:16 +08:00
Kevin H. Luu 05201d8ecf [CI] Shard basic model initialization tests (#54753)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
2026-09-02 04:31:57 +00:00
Gabriel WuandKimi Code 396c5a5632 [Bugfix] Lazy-import FlashInfer PCIe IPC all-reduce in kernel_warmup (#54869)
Signed-off-by: Zihua Wu <13583761+lucifer1004@users.noreply.github.com>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
2026-09-02 04:31:03 +00:00
Harry Huang 1e300895ac [Qwen4] validate FP8 PLE weight scale after loading (#54722)
Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
2026-09-02 04:30:58 +00:00
ee3c00bbf4 [Performance] Register Triton W4A16 GEMM as a custom op (#51453)
Signed-off-by: giuseppegrossi <ggrossi@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-09-01 22:55:34 -05:00
Isotr0py 1d8d7a3965 [Bugfix] Fix RoPE construction for deepseek-v4 sparse SWA layers (#54815)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
2026-09-01 20:48:50 -07:00
Nick Hillandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> a566ea7e8f [Perf] Avoid more h2d copies from non-pinned tensors (#54660)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-01 20:37:09 -07:00
Yongye ZhuandOpenAI Codex 3ba9907a1d [Kimi-K3] Overlap low-M TP8 KDA projections (#54697)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-02 03:35:28 +00:00
12b9573c98 [Bugfix][KV Offloading] Fix eager SimpleCPUOffload cache registration and final flush (#53532)
Signed-off-by: maithilijoshi20 <maithilijoshi2003@gmail.com>
Signed-off-by: maithilijoshi20 <97733343+maithilijoshi20@users.noreply.github.com>
Co-authored-by: maithilijoshi20 <maithilijoshi2003@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
2026-09-02 03:23:09 +00:00
Divakar VermaandAndreas Karatzas dbf1a044ea [Bugfix] Fix ColQwen3.5 pooler projector initialization (#54847)
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-09-02 10:35:43 +08:00
46c8a161f4 [Bugfix] Handle padded routes in CUTLASS MoE permutations (#54747)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
2026-09-01 19:08:17 -07:00
Thien Tran 003e34341a [Qwen3.8-Flash-Next] Separate prefill and decode paths for QSA indexer (#54513)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
2026-09-02 09:08:10 +08:00
Bugen ZhaoandCodex 80389cfedd [CI/Build] Gate PR title check on ready PRs & use slim runners (#54827)
Co-authored-by: Codex <codex@openai.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-09-01 23:12:00 +00:00
Andreas Karatzas e01d4acbb1 [ROCm][CI] Handle tied experts in softplus sqrt top-k test (#52679)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
2026-09-01 18:04:14 -05:00
Kevin H. Luu 3b6c0bdae9 [CI] Shard long kernel test groups (#54754)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
2026-09-01 15:58:27 -07:00
Kevin H. Luu 96031b8623 [CI] Shard distributed model jobs above the 24h P90 threshold (#54752)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
2026-09-01 15:32:11 -07:00
Kevin H. Luu e90b608c42 [CI] Split nightly MTP acceptance tests (#52353)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
2026-09-01 15:29:33 -07:00
Bugen Zhao b911fe85c4 [Rust Frontend] Attribute decoded text to tokens (#52910)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-09-01 22:25:31 +00:00
mingg26andOpenAI Codex 259a209bfa [Kimi-K3][Perf] Prefetch ll_bf16 router weights for M=1 (#53524)
Signed-off-by: ming <ming@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-01 21:40:19 +00:00