faacc13565
[Perf][KV Connector][Mooncake] Pack hybrid/MLA KV into coalesced transfer regions ( #57952 )
...
Signed-off-by: staryxchen <staryxchen@tencent.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai >
2026-09-29 13:29:04 -07:00
5dd693122c
[MyPy][2/N] Fix mypy errors in small tests/ dirs ( #51043 )
...
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com >
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-09-29 21:27:45 +01:00
sashko-zakharchuk
a96ee5935d
[MRV2] Add DRY as a custom logits processor example ( #50584 )
...
Signed-off-by: Oleksandr Zakharchuk <oleksandr.zakharchuk@gmail.com >
2026-09-29 19:46:00 +00:00
hubunt and Flora Feng
19a4d66a0b
[Bugfix] Avoid JSON constraints for native tool parsers ( #47512 )
...
Signed-off-by: Flora Feng <4florafeng@gmail.com >
Co-authored-by: Flora Feng <4florafeng@gmail.com >
2026-09-29 19:37:12 +00:00
Aarushi Jain
7aa8372ef7
[ROCm][CI] Run Basic Correctness Sleep Mode on MI300 for now ( #59262 )
...
Signed-off-by: aarushjain29 <aarushi.jain2@amd.com >
2026-09-29 19:25:01 +00:00
YukioZzz and mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
30ae8248b6
[KVConnector][MoRIIO] Support K3 DSpark hybrid READ ( #57700 )
...
Signed-off-by: Yichao Zhu <Yichao.Zhu@amd.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-29 19:14:24 +00:00
Andrey Talman
35cd03ebff
[CI] Mint the CRCR report's OIDC token after the wait, not before ( #59259 )
2026-09-29 11:50:12 -07:00
Shimi Bandiel and Claude
4dc57d44c4
[Frontend] Attach resolved logprobs to streaming derender chunks ( #55029 )
...
Signed-off-by: Shimi Bandiel <shimib@google.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-09-29 18:43:44 +00:00
djramic and Andreas Karatzas
df4dbe46e7
[CI][ROCm] Increase timeouts for AMD MI300 jobs near their limits ( #59227 )
...
Signed-off-by: Djordje Ramic <djoramic@amd.com >
Co-authored-by: Andreas Karatzas <akaratza@amd.com >
2026-09-29 18:25:49 +00:00
Chanbin Lim
91de237333
[Bugfix][DP] add_dp_placement_groups does not require ray[default] ( #57648 )
...
Signed-off-by: beenpow <57864041+beenpow@users.noreply.github.com >
2026-09-29 18:15:13 +00:00
9a190f142c
[Mypy] Fix mypy typing for Zamba2 models ( #58255 )
...
Signed-off-by: Ashraf Bhuiyan <mbhuiyan@redhat.com >
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com >
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-09-29 18:13:52 +00:00
467d81d9a0
[ROCm] Upgrade MoRI version on rocm dockers required for WideEP DP16 DI CI enablement and fixes for combine API ( #56073 )
...
Signed-off-by: Shiksha Patel <shiksha.patel@amd.com >
Signed-off-by: lcskrishna <lollachaitanya@gmail.com >
Co-authored-by: shikamd123 <shikpate@amd.com >
Co-authored-by: Andreas Karatzas <akaratza@amd.com >
2026-09-29 18:07:31 +00:00
Bugen Zhao and Claude Opus 5.5
afac509a33
[Bugfix][Rust Frontend] Skip engine-derived metrics under --disable-log-stats ( #59205 )
...
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-09-29 11:01:54 -07:00
f5ed3d9c03
[Fast Start] Charge daemon-held weights against gpu_memory_utilization ( #57298 )
...
Signed-off-by: liusy58 <mg21330037@smail.nju.edu.cn >
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
Signed-off-by: Xun Sun <UNIDY2002@outlook.com >
Co-authored-by: Isotr0py <Isotr0py@outlook.com >
Co-authored-by: Xun Sun <UNIDY2002@outlook.com >
2026-09-29 17:58:35 +00:00
Jung Jiyu and Misha Goin
cb4f016c5d
[Bugfix] Fix standalone torch.compile cache loading after relocation ( #52142 )
...
Signed-off-by: jungjiyu <libraryofjiyu@gmail.com >
Co-authored-by: Misha Goin <mgoin64@gmail.com >
2026-09-29 12:53:20 -04:00
cd94b21264
[Bugfix][Frontend] Return 400 for malformed RL dev route bodies ( #59236 )
...
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com >
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-09-29 16:46:56 +00:00
Isotr0py
31876d8ea1
[Bugfix] Fix TorchCodec audio IO correctness ( #58364 )
...
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
2026-09-29 11:34:48 -05:00
stefankoncarevic and Andreas Karatzas
c3a4a36c20
[CI][ROCm] Fix stale basic_correctness path in Model Runner V2 Distributed ( #59201 )
...
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com >
Co-authored-by: Andreas Karatzas <akaratza@amd.com >
2026-09-29 16:32:04 +00:00
Ashraf Bhuiyan and Wentao Ye
2454b5a4f0
[Mypy] Fix mypy typing for Whisper models ( #58254 )
...
Signed-off-by: Ashraf Bhuiyan <mbhuiyan@redhat.com >
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com >
2026-09-29 17:10:28 +01:00
f4917dadc8
[Bugfix][Quantization] Stop sleep(level=2) from zeroing compressed-tensors KV scales ( #57163 )
...
Signed-off-by: AlanFokCo <alanfok2868@gmail.com >
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
Co-authored-by: aoshen02 <aoshen@inferact.ai >
2026-09-29 15:34:15 +00:00
Giulio De Pasquale
8aaeef343a
[Bugfix][MiMo] Declare embedding_fields so an EPD pair can serve images ( #58938 )
...
Signed-off-by: Giulio De Pasquale <git@depasquale.giugl.io >
2026-09-29 23:33:01 +08:00
ac7f3e11ea
[Bugfix] Profile maximum DeepSeek V4.1 vision features ( #57898 )
...
Signed-off-by: ahmed xijiaat <52128022+xijiaat@users.noreply.github.com >
Co-authored-by: OpenAI Codex <noreply@openai.com >
Co-authored-by: Isotr0py <Isotr0py@outlook.com >
2026-09-29 15:21:27 +00:00
stefankoncarevic
741edeebee
[Bugfix][CI] Assert the logger call the Anthropic merge warning makes ( #59202 )
...
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com >
2026-09-29 06:27:34 -07:00
cd947f5c62
[MM] Fix compiled ViT attention output layouts ( #58182 )
...
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com >
Co-authored-by: OpenAI Codex <noreply@openai.com >
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@mistral.ai >
2026-09-29 06:27:03 -07:00
Shijin Zhang and Chauncey
d95d1dcfb9
[Bugfix][Frontend] Force reasoning mode for GLM-5.3 chat templates in the GLM MoE parser ( #56994 )
...
Signed-off-by: Shijin Zhang <75300765+Dovis01@users.noreply.github.com >
Co-authored-by: Chauncey <chaunceyjiang@gmail.com >
2026-09-29 21:26:34 +08:00
dfc8e0f3e2
[Frontend] Support strict MiMo-V2.6 tool calling ( #58019 )
...
Co-authored-by: Codex <noreply@openai.com >
Co-authored-by: yuchuan <yuchuan.7streams@gmail.com >
Co-authored-by: Bugen Zhao <i@bugenzhao.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
Signed-off-by: Ubospica <ubospica@gmail.com >
Signed-off-by: yuchuan <yuchuan.7streams@gmail.com >
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
2026-09-29 12:47:47 +00:00
jack and QwertyJack
79a0307d74
[Config] Remove Engram CUDA-alike device restrictions ( #59171 )
...
Signed-off-by: QwertyJack <7554089+QwertyJack@users.noreply.github.com >
Co-authored-by: QwertyJack <7554089+QwertyJack@users.noreply.github.com >
2026-09-29 12:42:02 +00:00
Harry Mellor and Claude Opus 5.5
998490cd9f
[Docs] Speed up docs build ~5x ( #58705 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-09-29 12:16:33 +01:00
05d89636fc
[ROCm][CI] Mirror generic GEMM-RS/AR on MI355 ( #58433 )
...
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com >
Co-authored-by: OpenAI Codex <noreply@openai.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-29 10:28:15 +00:00
3f3fbe286f
[Bugfix][Rust Frontend] Account for new requests in DP routing ( #58956 )
...
Co-authored-by: Bugen Zhao <i@bugenzhao.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
Signed-off-by: reidliu41 <reid201711@gmail.com >
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
2026-09-29 10:24:28 +00:00
Louie Tsai
208bb38c80
[Bugfix][Rust Frontend] Fix startup with config-only model ( #58643 )
...
Signed-off-by: louie-tsai <louie.tsai@intel.com >
2026-09-29 10:11:53 +00:00
af5b4857e1
[Fast Start] Support PP ( #55477 )
...
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
Co-authored-by: Isotr0py <Isotr0py@outlook.com >
Co-authored-by: Xun Sun <UNIDY2002@outlook.com >
2026-09-29 09:37:43 +00:00
yhcheong (vllmellm)
77e52645e9
[Bugfix][Model] MiMo: keep fused fp8 qkv_proj pairing state across weight-loading calls ( #58142 )
...
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com >
2026-09-29 09:37:20 +00:00
aoshen02 and OpenAI Codex
4861833ae2
[Bugfix][Core] Allow AuxOutput reset after abort without running requests ( #59060 )
...
Signed-off-by: aoshen02 <aoshen@inferact.ai >
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-09-29 09:23:32 +00:00
Chauncey
3e2a7e74a5
[Feat][Model] Enable KDA prefill checkpoints for GLM-5.3-Flash ( #56960 )
...
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com >
2026-09-29 09:14:30 +00:00
Andreas Karatzas and OpenAI Codex
3acddf01e7
[Bugfix][ROCm] Keep Mooncake bootstrap ports bound during startup ( #58967 )
...
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-09-29 04:14:26 -05:00
Andreas Karatzas
6ebb5bd64f
[ROCm][CI] Expand MI355 mirrors and route MIG-sized jobs to DPX ( #59137 )
...
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com >
2026-09-29 03:40:07 -05:00
Jakub Zakrzewski and OpenAI Codex
70dc122f81
[MM] Enable device normalization for Llama Nemotron VL Embed/Rerank ( #57928 )
...
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-09-29 08:33:52 +00:00
Chauncey
61349e342d
[Misc] Avoid repeated warnings for merged Anthropic system messages ( #59172 )
...
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com >
2026-09-29 01:31:22 -07:00
Yifan Qiao and Claude Fable 5.1
4b2e1cfa7b
[Model] Decoder-side SWA bounded replay for DeepSeek-V4.1 ( #58132 )
...
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai >
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com >
2026-09-29 08:25:46 +00:00
9af952c555
[Bugfix][Rust Frontend] Support raise_exception in chat templates ( #59020 )
...
Co-authored-by: Claude <noreply@anthropic.com >
Co-authored-by: Bugen Zhao <i@bugenzhao.com >
Signed-off-by: Yashasvi Asthana <yashasvi.asthana@gmail.com >
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
2026-09-29 08:01:52 +00:00
77d9cda688
[ROCm][Model][Bugfix] Fix GLM-5.2 shared-expert fusion and MTP on the ROCm DSA path ( #58904 )
...
Signed-off-by: Jin Tao <jin.tao@amd.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Shanshan Shen <467638484@qq.com >
2026-09-29 07:57:23 +00:00
Juntian Liu and Claude Opus 5.5
30f5c01d4e
[DSv4.1] Avoid runtime recompiles of _ring_slot_mapping_kernel ( #59119 )
...
Signed-off-by: Juntian Liu <Juntianl777@gmail.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-09-29 07:31:30 +00:00
Václav Čadek and Cursor Agent
6cbbea8721
[Bugfix] Hoist $defs/definitions in Cohere parser tool schema composition ( #49602 )
...
Signed-off-by: Václav Čadek <vaclavcadek@gmail.com >
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2026-09-29 07:11:56 +00:00
Andreas Karatzas and OpenAI Codex
78fc1e6274
[ROCm][CI] Add MI355 TP2 AR-RMS and B200 fusion mirrors ( #58284 )
...
Signed-off-by: Andreas Karatzas <akaratza@amd.com >
Co-authored-by: OpenAI Codex <noreply@openai.com >
2026-09-29 07:10:26 +00:00
Andreas Karatzas and OpenAI Codex
69d5c81fcd
[ROCm][CI] Mirror split kernel groups on MI355 and fix exposed tests ( #58654 )
...
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com >
Signed-off-by: Codex <codex@openai.com >
Signed-off-by: Andreas Karatzas <akaratza@amd.com >
Co-authored-by: OpenAI Codex <noreply@openai.com >
2026-09-29 02:08:31 -05:00
Andreas Karatzas and Codex
0ae480ff1a
[CI][ROCm] Mirror large-model GSM8K evaluations on MI355 ( #58683 )
...
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com >
Co-authored-by: Codex <noreply@openai.com >
2026-09-29 02:06:44 -05:00
d86cf91240
[MM][Mistral3] Image preprocessing optimization ( #57531 )
...
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com >
Co-authored-by: OpenAI Codex <noreply@openai.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-29 06:53:38 +00:00
65ed0a2642
[Bugfix][GLM-5.3-Flash] Take video placeholder timestamps from the pixel path's frame sampler ( #55647 )
...
Signed-off-by: NNNtrance <232268405+NNNtrance@users.noreply.github.com >
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
Co-authored-by: NNNtrance <232268405+NNNtrance@users.noreply.github.com >
Co-authored-by: Isotr0py <Isotr0py@outlook.com >
2026-09-29 06:45:29 +00:00
MOVZX and Hinata
ae0350c0de
[Spec Decode][MRV2] RecoverSSM for Qwen GDN and PLE short conv (PR #58863 )
...
Intake of open upstream PR vllm-project/vllm#58863 . Active only with
VLLM_USE_V2_MODEL_RUNNER=1; inert otherwise.
Speculative decoding on Gated DeltaNet snapshotted the full recurrent
state after every draft position and reserved one Mamba block per draft
position. On a 24 GB card that is reserved VRAM we never use, plus
per-step copy traffic.
RecoverSSM, the protocol Kimi-K3 KDA already uses, replaces this:
verify runs from a read-only checkpoint and stores a small per-token
replay record [correction (V), normalized key (K), gate (1)] in fp32;
commit replays only the accepted tokens and writes the recurrent state
once, plus the block-boundary state in align mode. The PLE dilated
short conv compacts its accepted window with the same plan.
Conflict in vllm/models/qwen4_exp/nvidia/mtp.py: our get_top_tokens()
work put LocalArgmaxMixin on Qwen4ExpMTP, the PR adds SupportsReplaySSM
to the same base list. Kept both.
Co-Authored-By: Hinata <hinata@idihore.id >
Signed-off-by: MOVZX <movzx@yahoo.com >
2026-09-29 13:39:09 +07:00