Commit Graph
22205 Commits
Author SHA1 Message Date
Fabian Joswigandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 1117140edb [Bugfix][Model] Fix DiffusionGemma silently freezing attention mask under CUDA graph replay (#51994)
Signed-off-by: Fabian Joswig <fjosw@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-30 05:34:26 +00:00
Ting SUNandFlora Feng 329e6eee3f [Bugfix][Frontend] Report named Anthropic tool calls as tool_use (#47598)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
2026-09-30 05:32:38 +00:00
Shijie Lyu ac68c30872 [Bugfix][Frontend] Ignore reused prompt token ids for media in /v1/responses (#59173)
Signed-off-by: Shijie Lyu <lshjhf@gmail.com>
2026-09-30 05:21:09 +00:00
Flora FengandClaude Fable 5.1 a3af78384a [Agents] Add API compatibility checking skill (#58003)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 04:59:48 +00:00
Wentao Yeandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 834ad456d3 [Refactor] Remove dead tests code (#58916)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-30 04:39:03 +00:00
90e13fc757 [Bugfix][HiSparse] Never allocate GPU pages without host backing (#59036)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 04:13:29 +00:00
Mia Ojeda e006d761a5 [Bugfix][CPU][DiffusionGemma] Support narrower canvas w/ sync scheduling (#59107)
Signed-off-by: ojeda-e <estefania.b.ojeda@gmail.com>
2026-09-29 23:28:50 -04:00
Louie Tsai 1b77cc3d67 [Benchmark] Add sweep warmup and failure recovery (#57305)
Signed-off-by: louie-tsai <louie.tsai@intel.com>
2026-09-30 11:16:41 +08:00
42d9f8ccdb support rl feature : weight checker (#51350)
Signed-off-by: shiyuan680 <yangcheng104@huawei.com>
Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: shiyuan680 <yangcheng104@huawei.com>
Co-authored-by: Ronald1995 <ronaldautomobile@163.com>
Co-authored-by: DeepSeek Harness <noreply@deepseek.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
2026-09-30 03:13:43 +00:00
a8e069f81b [Bugfix][MiniMax M3] Share target embeddings with MTP under PP (#58648)
Signed-off-by: Peiyuan Zhou <peiyuanzhou1994@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
2026-09-29 20:04:10 -07:00
Matthew BonanniandClaude Opus 5.5 2798f66860 [Bugfix][HiSparse] Resolve MTP verification rows with a union residency kernel (#59235)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 03:01:45 +00:00
Kevin H. LuuandCodex bec710fccf [CI] Fix mock type narrowing in LoRA serving test (#59344)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-29 19:55:04 -07:00
Wei Zhao 678baf5372 [Dependency] Upgrade FlashInfer to 0.7.0.post1 (#59323)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
2026-09-30 02:34:36 +00:00
Bugen ZhaoandClaude Sonnet 5.5 8039d3cbfd [Rust Frontend] Use the MiMo structural-tag builder (#59148)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-30 01:34:46 +00:00
Nick HillandClaude Opus 5.5 105a4e097b [Bugfix][Frontend] Reject LoRA adapters named after a served model (#59286)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 18:29:38 -07:00
765872e7ed [Core][BugFix] Tag prefix-cache extra keys by source (#51899)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com>
Co-authored-by: Tai An <antai12232931@outlook.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 18:24:59 -07:00
xiangdongandKunshang Ji 09c47db1ca [XPU][CI]Skip test_abort_timeout_on_prefiller in nightly (#58307)
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
2026-09-29 17:29:59 -07:00
Flora Feng 7ca31ef599 [Bugfix][Responses API] Build streamed final response from streamed items (#59307)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
2026-09-30 00:16:05 +00:00
Lio Einaudiandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 4e0a414c44 [Kernel][Perf] Add TP=2/4/8 per-rank shapes to the sm_120 batch-invariant matmul table (#58495)
Signed-off-by: LioEinaudi <zhao3024667639@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-29 23:51:50 +00:00
Harshilandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> be255076d0 [Bugfix] Reject a prefix_match_unit that a single KV cache group cannot honor (#58021)
Signed-off-by: QHarshil <harshil_c@hotmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-29 23:12:15 +00:00
Juan Pérez de AlgabaandCursor eec2a86b1e [Security] Bump nltk, aiohttp, pillow, and datamodel-code-generator (#59249)
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-29 16:00:36 -07:00
RongJie GandFlora Feng 0755e69e75 [Bugfix][Responses API] Preserve built-in tool output call IDs (#55596)
Signed-off-by: CorgiBoyG <111257566+CorgiBoyG@users.noreply.github.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
2026-09-29 22:45:14 +00:00
c37f86e572 [Bugfix] GLM-5.3-Flash: fp8 plan dtype on SM90 sparse MLA, and right-size the indexer prefill workspace (#55222)
Signed-off-by: Mikhail Kostryukov <mike@triptrack.net>
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: Mikhail Kostryukov <drakosha81@proton.me>
Co-authored-by: NickLucche <nicolo.lucchesi@mistral.ai>
2026-09-29 22:36:39 +00:00
Tyler Michael SmithandCodex 50239dfc4d [WideEP] Change DeepEPv2 to auto select hybrid mode by default (#57991)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-29 18:36:30 -04:00
Flora Feng 797505747f [Bugfix][Frontend] Honor parallel_tool_calls=false in the Responses API (#59298)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
2026-09-29 22:36:11 +00:00
a7a9ac2745 [Core] Combine per-engine utility results like the Rust client (#59240)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 22:20:51 +00:00
cherry77-cloudandFlora Feng 5e887a078b [Bugfix] Route Step3p5 forced tool choices through XML parser (#51810)
Signed-off-by: taking-lying-flat <1615405@qq.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
2026-09-29 21:58:46 +00:00
Ostring24andFlora Feng 4e7af3b0de [Bugfix][Frontend] Enforce parallel_tool_calls=false in the required-tool grammar (#50502)
Signed-off-by: ostring <ostring@qq.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
2026-09-29 21:33:28 +00:00
Misha Goinandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 1ee7f78e80 [Perf] Reduce redundant Triton sampler warmup specializations (#58605)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-29 21:23:27 +00:00
d882bddbea [Bugfix][Mamba] Keep the prompt-end prefill checkpoint under sparse retention (#59146)
Signed-off-by: Jared Wen <jaredwen@inferact.ai>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
2026-09-29 21:00:16 +00:00
yzong-rh 1d331f8341 [Bugfix] Suppress HarmonyError Unexpected token while expecting start token 200006 (#59254)
Signed-off-by: Yifan Zong <yzong@redhat.com>
2026-09-29 16:40:15 -04:00
faacc13565 [Perf][KV Connector][Mooncake] Pack hybrid/MLA KV into coalesced transfer regions (#57952)
Signed-off-by: staryxchen <staryxchen@tencent.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
2026-09-29 13:29:04 -07:00
5dd693122c [MyPy][2/N] Fix mypy errors in small tests/ dirs (#51043)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 21:27:45 +01:00
sashko-zakharchuk a96ee5935d [MRV2] Add DRY as a custom logits processor example (#50584)
Signed-off-by: Oleksandr Zakharchuk <oleksandr.zakharchuk@gmail.com>
2026-09-29 19:46:00 +00:00
hubuntandFlora Feng 19a4d66a0b [Bugfix] Avoid JSON constraints for native tool parsers (#47512)
Signed-off-by: Flora Feng <4florafeng@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
2026-09-29 19:37:12 +00:00
Aarushi Jain 7aa8372ef7 [ROCm][CI] Run Basic Correctness Sleep Mode on MI300 for now (#59262)
Signed-off-by: aarushjain29 <aarushi.jain2@amd.com>
2026-09-29 19:25:01 +00:00
YukioZzzandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 30ae8248b6 [KVConnector][MoRIIO] Support K3 DSpark hybrid READ (#57700)
Signed-off-by: Yichao Zhu <Yichao.Zhu@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-29 19:14:24 +00:00
Andrey Talman 35cd03ebff [CI] Mint the CRCR report's OIDC token after the wait, not before (#59259) 2026-09-29 11:50:12 -07:00
Shimi BandielandClaude 4dc57d44c4 [Frontend] Attach resolved logprobs to streaming derender chunks (#55029)
Signed-off-by: Shimi Bandiel <shimib@google.com>
Co-authored-by: Claude <noreply@anthropic.com>
2026-09-29 18:43:44 +00:00
djramicandAndreas Karatzas df4dbe46e7 [CI][ROCm] Increase timeouts for AMD MI300 jobs near their limits (#59227)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-09-29 18:25:49 +00:00
Chanbin Lim 91de237333 [Bugfix][DP] add_dp_placement_groups does not require ray[default] (#57648)
Signed-off-by: beenpow <57864041+beenpow@users.noreply.github.com>
2026-09-29 18:15:13 +00:00
9a190f142c [Mypy] Fix mypy typing for Zamba2 models (#58255)
Signed-off-by: Ashraf Bhuiyan <mbhuiyan@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-09-29 18:13:52 +00:00
467d81d9a0 [ROCm] Upgrade MoRI version on rocm dockers required for WideEP DP16 DI CI enablement and fixes for combine API (#56073)
Signed-off-by: Shiksha Patel <shiksha.patel@amd.com>
Signed-off-by: lcskrishna <lollachaitanya@gmail.com>
Co-authored-by: shikamd123 <shikpate@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-09-29 18:07:31 +00:00
Bugen ZhaoandClaude Opus 5.5 afac509a33 [Bugfix][Rust Frontend] Skip engine-derived metrics under --disable-log-stats (#59205)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 11:01:54 -07:00
f5ed3d9c03 [Fast Start] Charge daemon-held weights against gpu_memory_utilization (#57298)
Signed-off-by: liusy58 <mg21330037@smail.nju.edu.cn>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Signed-off-by: Xun Sun <UNIDY2002@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Xun Sun <UNIDY2002@outlook.com>
2026-09-29 17:58:35 +00:00
Jung JiyuandMisha Goin cb4f016c5d [Bugfix] Fix standalone torch.compile cache loading after relocation (#52142)
Signed-off-by: jungjiyu <libraryofjiyu@gmail.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
2026-09-29 12:53:20 -04:00
cd94b21264 [Bugfix][Frontend] Return 400 for malformed RL dev route bodies (#59236)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 16:46:56 +00:00
Isotr0py 31876d8ea1 [Bugfix] Fix TorchCodec audio IO correctness (#58364)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
2026-09-29 11:34:48 -05:00
stefankoncarevicandAndreas Karatzas c3a4a36c20 [CI][ROCm] Fix stale basic_correctness path in Model Runner V2 Distributed (#59201)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-09-29 16:32:04 +00:00
Ashraf BhuiyanandWentao Ye 2454b5a4f0 [Mypy] Fix mypy typing for Whisper models (#58254)
Signed-off-by: Ashraf Bhuiyan <mbhuiyan@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
2026-09-29 17:10:28 +01:00