 Lio Einaudiandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
4e0a414c44
|
[Kernel][Perf] Add TP=2/4/8 per-rank shapes to the sm_120 batch-invariant matmul table (#58495)
Signed-off-by: LioEinaudi <zhao3024667639@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-29 23:51:50 +00:00 |
|
|
Harshilandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
be255076d0
|
[Bugfix] Reject a prefix_match_unit that a single KV cache group cannot honor (#58021)
Signed-off-by: QHarshil <harshil_c@hotmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-29 23:12:15 +00:00 |
|
|
Juan Pérez de AlgabaandCursor
|
eec2a86b1e
|
[Security] Bump nltk, aiohttp, pillow, and datamodel-code-generator (#59249)
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-29 16:00:36 -07:00 |
|
|
RongJie GandFlora Feng
|
0755e69e75
|
[Bugfix][Responses API] Preserve built-in tool output call IDs (#55596)
Signed-off-by: CorgiBoyG <111257566+CorgiBoyG@users.noreply.github.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-09-29 22:45:14 +00:00 |
|
|
|
c37f86e572
|
[Bugfix] GLM-5.3-Flash: fp8 plan dtype on SM90 sparse MLA, and right-size the indexer prefill workspace (#55222)
Signed-off-by: Mikhail Kostryukov <mike@triptrack.net>
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: Mikhail Kostryukov <drakosha81@proton.me>
Co-authored-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-09-29 22:36:39 +00:00 |
|
|
Tyler Michael SmithandCodex
|
50239dfc4d
|
[WideEP] Change DeepEPv2 to auto select hybrid mode by default (#57991)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-29 18:36:30 -04:00 |
|
|
Flora Feng
|
797505747f
|
[Bugfix][Frontend] Honor parallel_tool_calls=false in the Responses API (#59298)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
|
2026-09-29 22:36:11 +00:00 |
|
|
|
a7a9ac2745
|
[Core] Combine per-engine utility results like the Rust client (#59240)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-29 22:20:51 +00:00 |
|
|
cherry77-cloudandFlora Feng
|
5e887a078b
|
[Bugfix] Route Step3p5 forced tool choices through XML parser (#51810)
Signed-off-by: taking-lying-flat <1615405@qq.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-09-29 21:58:46 +00:00 |
|
|
Ostring24andFlora Feng
|
4e7af3b0de
|
[Bugfix][Frontend] Enforce parallel_tool_calls=false in the required-tool grammar (#50502)
Signed-off-by: ostring <ostring@qq.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-09-29 21:33:28 +00:00 |
|
|
Misha Goinandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
1ee7f78e80
|
[Perf] Reduce redundant Triton sampler warmup specializations (#58605)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-29 21:23:27 +00:00 |
|
|
|
d882bddbea
|
[Bugfix][Mamba] Keep the prompt-end prefill checkpoint under sparse retention (#59146)
Signed-off-by: Jared Wen <jaredwen@inferact.ai>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
|
2026-09-29 21:00:16 +00:00 |
|
|
yzong-rh
|
1d331f8341
|
[Bugfix] Suppress HarmonyError Unexpected token while expecting start token 200006 (#59254)
Signed-off-by: Yifan Zong <yzong@redhat.com>
|
2026-09-29 16:40:15 -04:00 |
|
|
|
faacc13565
|
[Perf][KV Connector][Mooncake] Pack hybrid/MLA KV into coalesced transfer regions (#57952)
Signed-off-by: staryxchen <staryxchen@tencent.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
|
2026-09-29 13:29:04 -07:00 |
|
|
|
5dd693122c
|
[MyPy][2/N] Fix mypy errors in small tests/ dirs (#51043)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-29 21:27:45 +01:00 |
|
|
sashko-zakharchuk
|
a96ee5935d
|
[MRV2] Add DRY as a custom logits processor example (#50584)
Signed-off-by: Oleksandr Zakharchuk <oleksandr.zakharchuk@gmail.com>
|
2026-09-29 19:46:00 +00:00 |
|
|
hubuntandFlora Feng
|
19a4d66a0b
|
[Bugfix] Avoid JSON constraints for native tool parsers (#47512)
Signed-off-by: Flora Feng <4florafeng@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-09-29 19:37:12 +00:00 |
|
|
Aarushi Jain
|
7aa8372ef7
|
[ROCm][CI] Run Basic Correctness Sleep Mode on MI300 for now (#59262)
Signed-off-by: aarushjain29 <aarushi.jain2@amd.com>
|
2026-09-29 19:25:01 +00:00 |
|
|
YukioZzzandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
30ae8248b6
|
[KVConnector][MoRIIO] Support K3 DSpark hybrid READ (#57700)
Signed-off-by: Yichao Zhu <Yichao.Zhu@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-29 19:14:24 +00:00 |
|
|
Andrey Talman
|
35cd03ebff
|
[CI] Mint the CRCR report's OIDC token after the wait, not before (#59259)
|
2026-09-29 11:50:12 -07:00 |
|
|
Shimi BandielandClaude
|
4dc57d44c4
|
[Frontend] Attach resolved logprobs to streaming derender chunks (#55029)
Signed-off-by: Shimi Bandiel <shimib@google.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-09-29 18:43:44 +00:00 |
|
|
djramicandAndreas Karatzas
|
df4dbe46e7
|
[CI][ROCm] Increase timeouts for AMD MI300 jobs near their limits (#59227)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-29 18:25:49 +00:00 |
|
|
Chanbin Lim
|
91de237333
|
[Bugfix][DP] add_dp_placement_groups does not require ray[default] (#57648)
Signed-off-by: beenpow <57864041+beenpow@users.noreply.github.com>
|
2026-09-29 18:15:13 +00:00 |
|
|
|
9a190f142c
|
[Mypy] Fix mypy typing for Zamba2 models (#58255)
Signed-off-by: Ashraf Bhuiyan <mbhuiyan@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-29 18:13:52 +00:00 |
|
|
|
467d81d9a0
|
[ROCm] Upgrade MoRI version on rocm dockers required for WideEP DP16 DI CI enablement and fixes for combine API (#56073)
Signed-off-by: Shiksha Patel <shiksha.patel@amd.com>
Signed-off-by: lcskrishna <lollachaitanya@gmail.com>
Co-authored-by: shikamd123 <shikpate@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-29 18:07:31 +00:00 |
|
|
Bugen ZhaoandClaude Opus 5.5
|
afac509a33
|
[Bugfix][Rust Frontend] Skip engine-derived metrics under --disable-log-stats (#59205)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-29 11:01:54 -07:00 |
|
|
|
f5ed3d9c03
|
[Fast Start] Charge daemon-held weights against gpu_memory_utilization (#57298)
Signed-off-by: liusy58 <mg21330037@smail.nju.edu.cn>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Signed-off-by: Xun Sun <UNIDY2002@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Xun Sun <UNIDY2002@outlook.com>
|
2026-09-29 17:58:35 +00:00 |
|
|
Jung JiyuandMisha Goin
|
cb4f016c5d
|
[Bugfix] Fix standalone torch.compile cache loading after relocation (#52142)
Signed-off-by: jungjiyu <libraryofjiyu@gmail.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-09-29 12:53:20 -04:00 |
|
|
|
cd94b21264
|
[Bugfix][Frontend] Return 400 for malformed RL dev route bodies (#59236)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-29 16:46:56 +00:00 |
|
|
Isotr0py
|
31876d8ea1
|
[Bugfix] Fix TorchCodec audio IO correctness (#58364)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-29 11:34:48 -05:00 |
|
|
stefankoncarevicandAndreas Karatzas
|
c3a4a36c20
|
[CI][ROCm] Fix stale basic_correctness path in Model Runner V2 Distributed (#59201)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-29 16:32:04 +00:00 |
|
|
Ashraf BhuiyanandWentao Ye
|
2454b5a4f0
|
[Mypy] Fix mypy typing for Whisper models (#58254)
Signed-off-by: Ashraf Bhuiyan <mbhuiyan@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-09-29 17:10:28 +01:00 |
|
|
|
f4917dadc8
|
[Bugfix][Quantization] Stop sleep(level=2) from zeroing compressed-tensors KV scales (#57163)
Signed-off-by: AlanFokCo <alanfok2868@gmail.com>
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
|
2026-09-29 15:34:15 +00:00 |
|
|
Giulio De Pasquale
|
8aaeef343a
|
[Bugfix][MiMo] Declare embedding_fields so an EPD pair can serve images (#58938)
Signed-off-by: Giulio De Pasquale <git@depasquale.giugl.io>
|
2026-09-29 23:33:01 +08:00 |
|
|
|
ac7f3e11ea
|
[Bugfix] Profile maximum DeepSeek V4.1 vision features (#57898)
Signed-off-by: ahmed xijiaat <52128022+xijiaat@users.noreply.github.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-29 15:21:27 +00:00 |
|
|
stefankoncarevic
|
741edeebee
|
[Bugfix][CI] Assert the logger call the Anthropic merge warning makes (#59202)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
|
2026-09-29 06:27:34 -07:00 |
|
|
|
cd947f5c62
|
[MM] Fix compiled ViT attention output layouts (#58182)
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@mistral.ai>
|
2026-09-29 06:27:03 -07:00 |
|
|
Shijin ZhangandChauncey
|
d95d1dcfb9
|
[Bugfix][Frontend] Force reasoning mode for GLM-5.3 chat templates in the GLM MoE parser (#56994)
Signed-off-by: Shijin Zhang <75300765+Dovis01@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-09-29 21:26:34 +08:00 |
|
|
|
dfc8e0f3e2
|
[Frontend] Support strict MiMo-V2.6 tool calling (#58019)
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: yuchuan <yuchuan.7streams@gmail.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Ubospica <ubospica@gmail.com>
Signed-off-by: yuchuan <yuchuan.7streams@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-29 12:47:47 +00:00 |
|
|
jackandQwertyJack
|
79a0307d74
|
[Config] Remove Engram CUDA-alike device restrictions (#59171)
Signed-off-by: QwertyJack <7554089+QwertyJack@users.noreply.github.com>
Co-authored-by: QwertyJack <7554089+QwertyJack@users.noreply.github.com>
|
2026-09-29 12:42:02 +00:00 |
|
|
Harry MellorandClaude Opus 5.5
|
998490cd9f
|
[Docs] Speed up docs build ~5x (#58705)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-29 12:16:33 +01:00 |
|
|
|
05d89636fc
|
[ROCm][CI] Mirror generic GEMM-RS/AR on MI355 (#58433)
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-29 10:28:15 +00:00 |
|
|
|
3f3fbe286f
|
[Bugfix][Rust Frontend] Account for new requests in DP routing (#58956)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: reidliu41 <reid201711@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-29 10:24:28 +00:00 |
|
|
Louie Tsai
|
208bb38c80
|
[Bugfix][Rust Frontend] Fix startup with config-only model (#58643)
Signed-off-by: louie-tsai <louie.tsai@intel.com>
|
2026-09-29 10:11:53 +00:00 |
|
|
|
af5b4857e1
|
[Fast Start] Support PP (#55477)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Xun Sun <UNIDY2002@outlook.com>
|
2026-09-29 09:37:43 +00:00 |
|
|
yhcheong (vllmellm)
|
77e52645e9
|
[Bugfix][Model] MiMo: keep fused fp8 qkv_proj pairing state across weight-loading calls (#58142)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
|
2026-09-29 09:37:20 +00:00 |
|
|
aoshen02andOpenAI Codex
|
4861833ae2
|
[Bugfix][Core] Allow AuxOutput reset after abort without running requests (#59060)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-29 09:23:32 +00:00 |
|
|
Chauncey
|
3e2a7e74a5
|
[Feat][Model] Enable KDA prefill checkpoints for GLM-5.3-Flash (#56960)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-09-29 09:14:30 +00:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
3acddf01e7
|
[Bugfix][ROCm] Keep Mooncake bootstrap ports bound during startup (#58967)
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-29 04:14:26 -05:00 |
|
|
Andreas Karatzas
|
6ebb5bd64f
|
[ROCm][CI] Expand MI355 mirrors and route MIG-sized jobs to DPX (#59137)
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
|
2026-09-29 03:40:07 -05:00 |
|