Commit Graph
21233 Commits
Author SHA1 Message Date
Isotr0py 533dbe424b [Misc] Clean up fast loader daemon quant method verification (#55656)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
2026-09-12 20:16:39 -07:00
Roberto L. CastroandCodex e52be1a62d [9/N][warmup][DSv4] Migrate MHC TileLang kernels (#50178)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: Codex <codex@openai.com>
2026-09-12 17:25:23 -07:00
aed894c190 [6/N][warmup][DSv4] Migrate sampling, and DFlash JIT kernels (#56323)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-12 17:24:24 -07:00
e19a3e172e [5/N] Share HiSparse host cache across TP ranks (reopens #52760) (#56629)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Chao Lei <leichao139636@163.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Chao Lei <leichao139636@163.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-09-12 19:48:25 -04:00
ebe1dec2da [PCP][DCP] Enable PCP+DCP on sparse-MLA models (#56157)
Signed-off-by: patryk.saffer <patryk.saffer@blc-login-1.blc1.mistralcompute.ai>
Signed-off-by: patryk.saffer <patryk.saffer@blc-login-0.blc1.mistralcompute.ai>
Signed-off-by: PatrykSaffer <patryk.saffer@mistral.ai>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: patryk.saffer <patryk.saffer@blc-login-1.blc1.mistralcompute.ai>
Co-authored-by: patryk.saffer <patryk.saffer@blc-login-0.blc1.mistralcompute.ai>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Patryk Saffer <PatrykSaffer@users.noreply.github.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-12 23:24:44 +00:00
MattandClaude Opus 4.8 72d4d83157 [ROCm][Bugfix] Fix elastic EP scaling deadlock (#56610)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-09-12 23:09:19 +00:00
7ee8a6dd01 [watermarking] Dual-key gumbel-max watermarking for speculative decoding support (#56122)
Signed-off-by: Raphael Rialland <raphael.rialland@mistral.ai>
Signed-off-by: Simon Veitner <sveitner@redhat.com>
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Simon Veitner <sveitner@redhat.com>
Co-authored-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
2026-09-12 18:42:01 +00:00
Kevin H. LuuandOpenAI Codex 1ee4be4dbc [CI] Update DeepSeek V4.1 MegaMoE routing test (#56599)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-12 11:31:13 -07:00
Kevin H. LuuandOpenAI Codex fd7cd4b883 [CI] Fix Qwen3 Omni DSpark load test config (#56600)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-12 11:29:58 -07:00
Ayushman Singhandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 7bcca16729 [Bugfix] Fix DeepGEMM FP8 warmup coverage (#56452)
Signed-off-by: Ayushman Singh <40520701+ayush1399@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-12 14:20:38 -04:00
29332cf936 [4/N] Expose HiSparse cache metrics via KV connector stats (#56061)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-12 10:47:55 -07:00
Zeyu Yang dff76bc3e8 [Bugfix][CI] skip conftest for NPU compatibility test (#55799)
Signed-off-by: yangzeyu <532183776@qq.com>
2026-09-13 01:03:28 +08:00
jcotant-inferactandClaude 3bb23e2def [CI/Build] Add DSv4.1 auto-label rules and narrow DSv4 (#56332)
Signed-off-by: Joe Cotant <joe@inferact.ai>
Co-authored-by: Claude <noreply@anthropic.com>
2026-09-12 09:50:16 -07:00
Artem Perevedentsev 9d3e991ece Add @arpera to CODEOWNERS of Structured Output (#56501)
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
2026-09-12 09:32:12 -07:00
Roberto L. Castro c377114636 [Bugfix][CI] Update CuTeDSL indexer Q sentinel test for migrated wrappers (#56594)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
2026-09-12 09:12:58 -07:00
Clinton ThomasandLucas Bourtoule 22f6e4eccb [Frontend][Rust] Reject empty structured-output values (#54821)
Signed-off-by: Clinton Thomas <1033162+KernelClint@users.noreply.github.com>
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com>
2026-09-12 19:12:25 +04:00
Itay Alroy 658c8131c7 [Elastic EP] Reuse CUDA graphs across reconfiguration (#54985) 2026-09-12 10:26:39 -04:00
Woosuk Kwon 13e221f830 [Perf] Fuse DSV4.1 input metadata preparation with Triton (#56562) 2026-09-12 07:20:04 -07:00
liuzhenwei 2f59050eda [XPU][CI] Skip ROCm test on non-ROCm platforms (#56555)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
2026-09-12 21:26:55 +08:00
JartX 986e2f870a [Refactor][ROCm] Migrate the RDNA3 W4A16 MoE to the oracle/experts pa… (#55522)
Signed-off-by: JartX <sagformas@epdcenter.es>
2026-09-12 21:20:26 +08:00
Taneem Ibrahim 1b29c508bc [Bugfix] Initialize data parser in Nano-Nemotron audio test (#56401)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
2026-09-12 09:07:20 -04:00
Taneem Ibrahim a0914ab7d0 [Nano-Nemotron] Fix Nano-Nemotron precomputed multimodal embeddings (#56398)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
2026-09-12 09:07:10 -04:00
Kunshang Ji bde4feb061 [XPU][CI] Remove pip install dependency in test yaml files (#55171)
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
2026-09-12 20:03:12 +08:00
Kevin H. LuuandOpenAI Codex d86257e283 [CI/Build] Give the Torch ABI audit time to start (#56596)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-12 03:29:22 -07:00
Srijan KeshriandShengqi Chen 6b153463a8 [Build] Define _USE_MATH_DEFINES for FlashMLA targets (#54007)
Signed-off-by: arcusbuilds <srijankeshri007@gmail.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
2026-09-12 02:45:32 -07:00
Kevin H. LuuandCodex 33fa95a0cf [CI] Sample GPU utilization and memory alongside test timelines (#56541)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-12 02:41:54 -07:00
Walter Beller-MoralesandFlora Feng 756794a9a7 [Frontend] create unified Cohere parser (#56392)
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
2026-09-12 04:04:46 -04:00
Andreas KaratzasandOpenAI Codex d406f09eb8 [ROCm][CI] Stage F gating (#55252)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-12 00:40:14 -07:00
Isotr0py 30118ba27d [DSV4.1] Remove compressor-aware image sentinel token padding (#56554)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
2026-09-12 00:07:36 -07:00
junuxyz 372477d2d9 [Bugfix][Examples] Launch prefill and decode concurrently in NixlPushConnector demo (#55088)
Signed-off-by: junuxyz <216036880+junuxyz@users.noreply.github.com>
2026-09-12 06:22:34 +00:00
Canlin GuoandCodex dca96bf97b [Bugfix][Spec Decode] Avoid fastsafetensors deadlock for PP draft models (#54416)
Signed-off-by: Canlin <canlinguosdu@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-12 14:22:30 +08:00
Bugen Zhao eed1f3d0c6 [Rust Frontend] Support generation blocks in HF chat template (#56378)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-09-12 04:56:55 +00:00
d43bb2f37f [3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Matthew Bonanni <matthew@neuralmagic.com>
Signed-off-by: Nicolò Lucchesi <nicolo.lucchesi@mistral.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@mistral.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
2026-09-12 00:36:47 -04:00
Roberto L. CastroandCodex 120ec4ebd2 [5/N][warmup][DSv4] Migrate NVIDIA CuTeDSL attention kernels (#53566)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Co-authored-by: Codex <codex@openai.com>
2026-09-12 00:05:59 -04:00
Bugen ZhaoandCodex 485421b1c3 [Rust Frontend] Honor HF revisions, offline mode, and cache directory (#56386)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-12 03:39:17 +00:00
Woosuk Kwon 5f3e4b7447 Revert "[Agents] Link Triton skill to JIT kernel warmup guide" (#56546) 2026-09-11 20:15:02 -07:00
Jiangyun ZhuandCodex ec6b0494fe [CI] Bump CUTLASS DSL to 4.7 (#54927)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Codex <codex@openai.com>
2026-09-11 20:11:29 -07:00
31759ccb6d [Rust Frontend][Multimodal] Accept preprocessed multimodal gRPC features (#55047)
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-12 02:29:49 +00:00
liuzhenwei a0844fa6c6 [XPU][CI] skip DeepSeek-V4.1-Flash in test_tensor_schema.py (#56463)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
2026-09-12 09:24:30 +08:00
Divakar Verma 06e57f622c [ROCm][Kimi-K3] Fix non-contiguous state_indices crash and GPU-sync assert in fused KDA/MLA prefill (#56526)
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
2026-09-11 20:17:39 -05:00
Tahsin Tunan 80650454dc [CI] Give every Buildkite step an explicit key, and a hook to enforce it (#56329)
Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
2026-09-11 18:08:05 -07:00
Yizheng Jiao 56d7270138 [Bugfix][NIXL] Don't evict a remote engine a transfer is still reading from (#54689)
Signed-off-by: Yizheng Jiao <jyizheng@gmail.com>
2026-09-11 18:06:09 -07:00
Fangzhou AiandFangzhou Ai 46d2b23ac5 [ROCm][DSV4.1][Perf] Use AITER mHC for the delayed pre block (#56503)
Signed-off-by: Fangzhou Ai <fangzhou@semianalysis.ai>
Co-authored-by: Fangzhou Ai <fangzhou@semianalysis.ai>
2026-09-12 00:35:48 +00:00
Wei Zhao 9d88ceb026 [KDA] Update flashKDA to support bf16 checkpoint state (#56485)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
2026-09-11 23:53:24 +00:00
AlecandCodex 988d9b6777 [Rust Frontend][gRPC] Surface engine generation errors (#56405)
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-11 15:31:55 -07:00
Micah Williamson bbaa1b9340 [ROCm][CI] Extend timeout for Basic Models (other) (#56522)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
2026-09-11 22:11:59 +00:00
amd-xavierwang 2d75e586fc [ROCm][Kernel][DSV4] Remove tl.constexpr to avoid cold-compile churn in indexer gather kernel (#56153)
Signed-off-by: xawang <xawang@amd.com>
2026-09-11 21:34:17 +00:00
Giancarlo Delfin 9dcf6bf344 [BugFix] Fix DP token padding in dflash attention metadata (#56181)
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
2026-09-11 14:33:53 -07:00
mevinceandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> c1b69aa0d4 [Bugfix][KV Connector] Only enforce disk block alignment for O_DIRECT (#55424)
Signed-off-by: Vincent <vincexxchan@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-11 13:12:59 -07:00
Nick HillandAndreas Karatzas cc5dd0a857 [MRV1] Scope breakable cudagraphs to the piecewise path only (#56312)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-09-11 19:55:34 +00:00