Commit Graph
21521 Commits
Author SHA1 Message Date
MattandClaude Opus 5 8be3ca35f3 [ROCm][CI] Fix AMD CI pipeline upload rejected by an invalid block-step key (#57375)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-17 20:52:02 +08:00
Kevin H. Luu f46968cb6e [CI] Make ci-clean-log.sh portable to macOS/BSD sed (#57367)
Signed-off-by: khluu <khluu000@gmail.com>
2026-09-17 12:42:59 +00:00
Martín el CheikhandClaude 2e50824766 [Bugfix] Fall back to native sampling when FlashInfer cannot target the GPU (#48956)
Signed-off-by: martin el cheikh <martinelcheikh@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
2026-09-17 12:27:54 +00:00
Laura Lopez-RealLaura López Realmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
a85dd55177 Fix Laguna patch mutating flat RoPE parameters (#57189)
Signed-off-by: Laura López Real <laulopezreal@users.noreply.github.com>
Co-authored-by: Laura López Real <laulopezreal@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-17 12:22:57 +00:00
Wentao Ye 91a4c40b45 [Compile] Fix compile warning #177-D (#56609)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
2026-09-17 05:04:56 -07:00
Simon Danielsson 667b26e50b [Bugfix][ROCm][GLM-5.3-Flash] Apply deferred tilelang.jit already on attribute access (#57192)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
2026-09-17 12:02:39 +00:00
Yan MaandKunshang Ji da3c07bf7d [XPU][CI] skip test_hybrid_prefix_cache_hit_rate (#57301)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
2026-09-17 19:57:22 +08:00
aoshen02andaoshen02 9ff08f9493 [Bugfix] Honor skip_reading_prefix_cache for KV connector hits (#57269)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
2026-09-17 03:46:28 -07:00
0d72627565 [Perf][EPD] Batch image requests per encoder (#57095)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Signed-off-by: Zhou ziheng <jiaranran2@gmail.com>
Co-authored-by: Zhou ziheng <jiaranran2@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-17 03:45:52 -07:00
Kevin H. LuuandKimi 99ea5f525d [CI] Raise DSv4-Flash disaggregated engine readiness timeout to 1800s (#57334)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Kimi <noreply@moonshot.cn>
2026-09-17 03:34:00 -07:00
Kevin H. LuuandKimi 683f6c8edf [CI] Raise H200 LM Eval Large Models timeout to 120 min (#57335)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Kimi <noreply@moonshot.cn>
2026-09-17 03:33:44 -07:00
Itay EtelisandOr Ozeri b6e7c1f1f0 [kv_offload] Skip scratch groups (#57145)
Signed-off-by: Itay Etelis <92247226+Etelis@users.noreply.github.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
2026-09-17 13:22:49 +03:00
40b40d1d39 [Bugfix][KV Offload] Register the offload region in chunks (#51081)
Signed-off-by: Mikhail Kostryukov <mike@triptrack.net>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Colton Ottley <coltonottley@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
2026-09-17 13:19:56 +03:00
08633cb5cd [Qwen3.8-Flash-Next] Enable FP8 TP with FlashInfer TRTLLM MoE (#55867)
Signed-off-by: Canlin <canlinguosdu@gmail.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
2026-09-17 08:56:28 +00:00
f1c2f6ada8 [ROCm][CI] Stage H gating and MI355 test reallocation (#57080)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-09-17 01:44:11 -07:00
Tianmu LiOpenAI CodexLi, Jiang <jiang1.li@intel.com>
23cd0346ce [CPU] Align scheduler and NIXL CPU affinity per local rank (#53636)
Signed-off-by: Li, Tianmu <tianmu.li@intel.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
2026-09-17 16:43:08 +08:00
coderfornowandLi, Jiang <jiang1.li@intel.com> 88afb77700 [CPU][s390x] Pin protobuf to 7.36.1 and drop C++ extension removal workaround (#54978)
Signed-off-by: coderfornow <Ritik.Dhiranan@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
2026-09-17 16:35:17 +08:00
jiangkuaixue123andCodex de24e51908 [MM][V2] Enable encoder-only ViT CUDA graph capture (#56922)
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-17 16:12:17 +08:00
Jiahan Chang (Cyrus)andOpenAI Codex 4e5ffda19d [Bugfix] Isolate supplemental FlashInfer BF16 autotuning (#57285)
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-17 07:38:58 +00:00
528fa835fd [ROCm] Stage large pageable H2D copies instead of registering them (#56343)
Signed-off-by: JohnQinAMD <yanyuan.qin@amd.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
2026-09-17 07:14:43 +00:00
leoandOpenAI Codex b3079e6e46 [Perf][DSpark] Stack DeepSeek V4 context WKV projections (#54674)
Signed-off-by: liuyao0322 <yaoliu548926@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-17 00:04:53 -07:00
Shuolei WangandRoger Wang 7bbce752b8 [Perf][Model] Qwen4Exp QSA: sm_90 tuning table for _select_config (#57273)
Signed-off-by: Shuolei Wang <shuoleiwang123@gmail.com>
Signed-off-by: Shuolei Wang <948904026@qq.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
2026-09-17 07:02:24 +00:00
Lucas Wilkinson bd2d7ae7c1 [Perf] Reuse MoE workspace for DeepGEMM warmup (#57268)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
2026-09-17 03:01:19 -04:00
Shanshan Shen fdcd42350b [ROCm][Perf] Enable HCA dual-stream overlap for DeepSeek-V4 (#56853)
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
2026-09-17 06:46:00 +00:00
aoshen02 b978df3299 Revert "[Frontend] Omit absent fields from /inference/v1/generate stream chunks" (#57302) 2026-09-16 23:31:59 -07:00
aoshen02andClaude Fable 5.1 8538017f4b [Frontend] Omit absent fields from /inference/v1/generate stream chunks (#57264)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-17 05:58:56 +00:00
Qiming Zhang e6b1a5e5e3 [XPU] Enable XPU eplb (#44987)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
Signed-off-by: Qiming Zhang <qiming1.zhang@intel.com>
2026-09-17 13:19:13 +08:00
2743dc4f92 [Feature][Multimodal] Add cross-encoder caching to Mooncake P2P (#56242)
Signed-off-by: Zhou ziheng <jiaranran2@gmail.com>
Co-authored-by: Tianyu Guo <guoty@inferact.ai>
Co-authored-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-17 13:16:41 +08:00
Matt 2d8a5c5741 [ROCm][Bugfix] Reduce CUDA graph divergences (#57229)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
2026-09-17 05:12:13 +00:00
Kevin H. Luu 0bfc7a15d0 [CI] Fix ruff docstring violations in EC connector files (#57283)
Signed-off-by: khluu <khluu000@gmail.com>
2026-09-16 21:13:15 -07:00
Robert ShawandRobert Shaw c38f92aae7 [A2A] Allow EPLB + SharedExpert Overlap + DeepEPv2 (#57236)
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
2026-09-17 04:02:39 +00:00
MattandClaude Code 68f2c7e74f [ROCm][CI] Fix Nixl+Offloading PD edge cases on TheRock image (#57249)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Claude Code <noreply@anthropic.com>
2026-09-16 22:56:13 -05:00
Alec d2a2a82954 [Rust Frontend] Bump vllm-proto to 0.3.0 (#57233)
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
2026-09-17 03:41:55 +00:00
Itay EtelisandOr Ozeri 9854b580df [Bugfix][KV Offload] Compact canonical MLA rows (#56799)
Signed-off-by: Itay Etelis <92247226+Etelis@users.noreply.github.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
2026-09-17 06:24:06 +03:00
Nick Hill 5efbf0886a [CI] Support FORCE_COLOR env var; enable colors in CPU CI output (#56913)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
2026-09-16 22:40:21 -04:00
omerpaz95 fa3622a4a1 [EC Connector] Add Metrics Collection (#54960)
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
2026-09-17 10:36:23 +08:00
Oxana KorzhandAndreas Karatzas 2307a1d16c [Core] Don't issue a blocking collective RPC during engine handshake (#57226)
Signed-off-by: okorzh <okorzh@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-09-16 21:30:59 -05:00
Chuan (Richard) LiandCursor f730a93d2b [Scheduler] Add --max-num-active-seqs to cap RUNNING admission (#56758)
Signed-off-by: Li <chuali@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-17 10:22:12 +08:00
Jiangyun ZhuandCodex b1f9ebc0c3 [Test][Core] Add hybrid model prefix cache hit-rate coverage (#57127)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-16 19:17:45 -07:00
062f81d8ef Use skip-redaction option for crcr-report (#56532)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-16 19:01:54 -07:00
AlecandCodex 28ec03bc6e [Bugfix][Rust Frontend] Accept appended EngineCoreOutput fields (#56533)
Co-authored-by: Codex <noreply@openai.com>
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
2026-09-17 01:54:43 +00:00
dongluwandAndreas Karatzas 19b6ff62f2 [ROCm][Bugfix] Ignore descales for unquantized AITER caches (#56726)
Signed-off-by: donglu <donglu@cohere.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-09-17 01:29:50 +00:00
Robert ShawandRobert Shaw ed769b4a45 [A2A] Add DeepEPv2 to SP Supported List (#57210)
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
2026-09-16 21:29:10 -04:00
Bugen Zhao e52da038d1 [Rust Frontend] Normalize native renderer reasoning controls (#56998)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-09-16 18:15:05 -07:00
3e267bae70 [ROCm] triton+triton_kernels 3.8 mxfp4 MoE support (gpt-oss + DeepSeek-V4) (#55934)
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Matt <156021403+mawong-amd@users.noreply.github.com>
2026-09-16 20:03:34 -05:00
Divakar VermaandAndreas Karatzas 95f4925c3a [ROCm][CI] Enable AITER FP8/unquantized cases in modular-kernel sweep + fix MoRI per-tensor FP8 dispatch (#57074)
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-09-16 19:53:06 -05:00
Thillai Chithambaram a615f53364 [Bugfix][Metrics][MFU] Size activation traffic from the model dtype (#57070)
Signed-off-by: Thillai Chithambaram <thillaichithambaram.a@gmail.com>
2026-09-17 00:23:28 +00:00
c58ff535f4 [Bugfix][Spec Decode] Fix EAGLE and dense draft startup with EP (#56930)
Signed-off-by: Kyle Liang <kyleliang-nv@users.noreply.github.com>
Co-authored-by: Kyle Liang <kyleliang-nv@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-16 17:03:36 -07:00
Aarushi JainandAndreas Karatzas 91b96a533c [ROCm][CI] Shard MI300 Multimodal Processor (#57056)
Signed-off-by: aarushjain29 <Aarushi.Jain2@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-09-16 18:55:14 -05:00
andrewor14 62f9482583 [Tests] Delete deprecate torchao tests for v1 configs (#52956)
Signed-off-by: andrewor14 <andrewor14@gmail.com>
2026-09-16 23:11:27 +00:00