|
5688a4dd4a
|
[Bugfix][GLM-5.3] Size the image encoder cache from the exact token ceiling (#59565)
Signed-off-by: Yufeng He <40085740+he-yufeng@users.noreply.github.com>
Co-authored-by: Kimi Code <kimi-code@moonshot.cn>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-10-02 10:43:29 +00:00 |
|
|
|
af2a582d5c
|
[Bugfix][Spec Decode] Qualify Transformers backend attention layer names with the model prefix (#59293)
Signed-off-by: Farhad Al-Amin <99006654+Legend-2727@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-10-02 11:21:20 +01:00 |
|
|
aoshen02andClaude Opus 5.5
|
8e58ac22af
|
[Feature] Offload KV-init runtime state on sleep (#59158)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 09:49:21 +00:00 |
|
|
Juan Pérez de Algaba
|
c15672cfb4
|
[Security] Accept zero-sum DeepSeek-OCR pixel tensors (#59417)
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com>
|
2026-10-02 09:17:12 +00:00 |
|
|
Isotr0pyandHarry Mellor
|
58b3298457
|
[Misc] Add Transformers version upper bound in requirements (#59614)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-10-02 08:27:11 +00:00 |
|
|
|
9d2a6f52b2
|
[Rust Frontend] Expose gRPC port in Python vllm serve (#59659)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-10-02 08:14:37 +00:00 |
|
|
Isotr0py
|
b558f160a2
|
[Bugfix] Fix minimax-m3 multimodal processor compatability with Transformers v5.18 (#59613)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-10-02 07:29:49 +00:00 |
|
|
kliuae
|
0154979656
|
[ROCm][Perf] Kimi-K3 enable prefill checkpoints on ROCm (#58344)
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
|
2026-10-02 06:58:04 +00:00 |
|
|
|
4056c8ac1f
|
[Bugfix][HiSparse] Fix MTP acceptance collapse under FULL graphs with a saturated GPU pool (#59309)
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-10-01 23:04:21 -07:00 |
|
|
|
0cbac6cd13
|
[Model][Spec Decode] Enable EAGLE3/DSpark pipeline parallelism for Sarvam MLA (#55902)
Signed-off-by: mohit-sarvam <mohit@sarvam.ai>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-10-02 04:28:19 +00:00 |
|
|
|
f7999d2e44
|
[Bugfix][HiSparse] Size the KV cache from the groups HiSparse allocates (#59450)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
|
2026-10-02 04:11:55 +00:00 |
|
|
Teng MaandTeng Ma
|
1a9eaa3a68
|
[Doc] Document ECMooncakeConnector for EPD disaggregation (#59196)
Signed-off-by: Teng Ma <stmatengss@gmail.com>
Co-authored-by: Teng Ma <stmatengss@users.noreply.github.com>
|
2026-10-02 12:10:33 +08:00 |
|
|
Qiu ChunshuoandLucas Wilkinson
|
8486f1ebfe
|
[Perf][PCP] Shard decode requests across PCP ranks (#52162)
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
|
2026-10-01 23:50:13 -04:00 |
|
|
|
a810316c08
|
[Bugfix] Keep batch-invariance NCCL pins out of the weight-transfer group (#59500)
Signed-off-by: aoshen524 <aoshen524@gmail.com>
Co-authored-by: aoshen524 <aoshen524@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
|
2026-10-02 11:19:28 +08:00 |
|
|
Martin Hickey
|
fcfacc3499
|
[Bugfix][Frontend] Seed derender detokenization from the prompt (#59046)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
|
2026-10-02 03:17:56 +00:00 |
|
|
Harry MellorandClaude Opus 5.5
|
8faacd707f
|
[Model] Migrate Glm, Arcee, CWM and Mellum to the Transformers modeling backend (#59679)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 03:15:14 +00:00 |
|
|
Prudhvi VudaandOpenAI Codex
|
ea106db806
|
[Bugfix][Bench] Clean up synthetic video files and writers (#59529)
Signed-off-by: Prudhvivuda <prudhvi12042001@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-10-02 02:51:34 +00:00 |
|
|
|
9bd993564f
|
[Frontend] Parse tool calls and reasoning from checkpoint response templates (#58604)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Yoni Gozlan <yonigozlan@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-10-02 02:33:00 +00:00 |
|
|
Hyunjae Wooandaoshen02
|
5a661487e2
|
[Feature] Add native ModelExpress weight transfer backend (#58399)
Signed-off-by: Hyunjae Woo <hwoo@nvidia.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
|
2026-10-02 02:29:35 +00:00 |
|
|
Flora Feng
|
785b990116
|
[Distributed] Enable custom all-reduce under VLLM_BATCH_INVARIANT (#58623)
Signed-off-by: Flora Feng <4florafeng@gmail.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
|
2026-10-02 02:25:48 +00:00 |
|
|
Harry MellorandClaude Opus 5
|
e3cae8d2ac
|
[Model] Use upstream GLM-5.3 and Qwen4-Exp configs and processor (#57387)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-10-02 02:25:18 +00:00 |
|
|
aoshen02andClaude Opus 5.5
|
866f02db8a
|
[Feature] Release WorkspaceManager scratch on sleep (#59156)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 02:14:37 +00:00 |
|
|
|
e5d33a36e7
|
[Bugfix][Rust Frontend] Preserve whitespace in GLM string arguments (#59654)
Signed-off-by: ai-jz <ai-jz@users.noreply.github.com>
Co-authored-by: ai-jz <ai-jz@users.noreply.github.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
|
2026-10-02 10:10:35 +08:00 |
|
|
|
6660926d92
|
[Bugfix][CPU] Fix macOS build on Apple Clang < 17: structured binding… (#58932)
Signed-off-by: Miajan Chowdhury <chowdhurymiajan@gmail.com>
Co-authored-by: Miajan Chowdhury <chowdhurymiajan@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-02 10:01:07 +08:00 |
|
|
|
4caa060053
|
[TEST][CI] Fix serve rlhf tests subprocess import errors (#59622)
Signed-off-by: microslaw <you@example.com>
Co-authored-by: microslaw <you@example.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-10-02 09:47:47 +08:00 |
|
|
liuzhenwei
|
89772ddb1f
|
[CI][XPU] Skip CUDA-IPC weight sync metrics test on Intel (#59556)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
|
2026-10-02 01:28:58 +00:00 |
|
|
|
d58da79de7
|
[Metrics][P/D] Add KV-fetch stage gauges for async KV loads (#58874)
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-02 01:24:33 +00:00 |
|
|
|
eec3c36a47
|
[ROCm][BugFix] Revert AITER PA gluon decode from ROCM_AITER_FA (#54805)
Signed-off-by: ukannika <uma.kannikanti@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-02 00:21:18 +00:00 |
|
|
Kevin H. Luu
|
5b6b657e13
|
[ci] Update mergify to rebase if behind by 100 commits (#59710)
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
|
2026-10-01 17:17:37 -07:00 |
|
|
|
28c57456db
|
[Bugfix][Frontend] Accept Anthropic tool_addition and tool_removal content blocks (#57693)
Signed-off-by: Anurag Singh <dr.anuragkr@gmail.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Antigravity <antigravity@google.com>
Co-authored-by: sfeng33 <4florafeng@gmail.com>
|
2026-10-01 20:03:36 -04:00 |
|
|
Divakar VermaandClaude Sonnet 5
|
e6674262f1
|
[Bugfix][CI] Widen DBO+DP+EP GSM8K accuracy margin on ROCm (#59700)
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
|
2026-10-01 23:37:36 +00:00 |
|
|
hclandHarry Mellor
|
e35082e7b6
|
[Bugfix][CLI] Include inherited field docstrings in get_attr_docs (#49821)
Signed-off-by: Chenglun Hu <chenglunhu@gmail.com>
Signed-off-by: hclsys <chenglunhu@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-10-01 23:35:58 +00:00 |
|
|
Aarushi Jain
|
d2125ea681
|
[ROCm][CI] Raise the MI355 DeepSeek-R1 GSM8K startup wait to 1800s (#59666)
Signed-off-by: aarushjain29 <aarushi.jain2@amd.com>
|
2026-10-01 22:30:13 +00:00 |
|
|
Flora Feng
|
a5105dba05
|
[Frontend] Port Step-3.5 parsers to the streaming parser engine (#59321)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
|
2026-10-01 22:18:37 +00:00 |
|
|
|
ca65eb67d9
|
[Perf][HiSparse] Avoid repeated prefix scans and residency updates (#57930)
Signed-off-by: S1ro1 <matej.sirovatka@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-10-01 21:48:18 +00:00 |
|
|
Yongye ZhuandClaude Opus 5.5
|
7566d83bd3
|
[Attention][MiniMax-M3] NVFP4 KV cache on the MSA sparse attention path (#59300)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-01 14:39:55 -07:00 |
|
|
Zijing Liu
|
ea84051819
|
[KVConnector][NIXL] Count completion notifications that arrive after KV expiry (#58875)
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
|
2026-10-01 21:30:58 +00:00 |
|
|
stefankoncarevicandAndreas Karatzas
|
ccda9098cc
|
[ROCm][CI] Drop two no-GPU AMD mirrors from the CPU test areas (#59593)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-10-01 14:54:26 -05:00 |
|
|
|
840c7c2f4b
|
[Bugfix][Engram] Fix intermittent Triton 3.8 crash in the lookup kernel (#59639)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
Co-authored-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-10-01 19:38:55 +00:00 |
|
|
Harry MellorandClaude Opus 5.5
|
7b44aad5db
|
[MyPy] Fix mypy errors in vllm/model_executor/models/[kK]* (#59402)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-01 19:32:27 +00:00 |
|
|
|
2a52715ef7
|
[Bugfix][Responses] Use standard reasoning content-part events (#59652)
Signed-off-by: ai-jz <ai-jz@users.noreply.github.com>
Co-authored-by: ai-jz <ai-jz@users.noreply.github.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-10-01 19:20:57 +00:00 |
|
|
Jaden Mathias
|
d848c4ed3d
|
[ROCm][Triton] Migrate Kimi-K3 kernels from make_block_ptr to tensor … (#58769)
Signed-off-by: JadenMathias <jaden.mathias@amd.com>
|
2026-10-01 13:41:41 -05:00 |
|
|
Chanbin LimandChendi.Xue
|
47de9d4d04
|
[KV Connector][NIXL] Coalesce host-buffer KV copies across cache groups (#54483)
Signed-off-by: beenpow <57864041+beenpow@users.noreply.github.com>
Co-authored-by: Chendi.Xue <chendi.xue@intel.com>
|
2026-10-01 13:10:54 -05:00 |
|
|
|
e9be5323f0
|
[Perf] Integrate flash-maxsim Triton kernels for late-interaction scoring (#40337)
Signed-off-by: roi.pony <roi.pony@ibm.com>
Co-authored-by: roi.pony <roi.pony@ibm.com>
Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-10-01 14:06:43 -04:00 |
|
|
Misha GoinandClaude
|
083060d046
|
[CI/Build] Add agents auto-label rule (#59641)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-10-01 13:28:27 -04:00 |
|
|
Matthew BonanniandClaude Opus 5.5
|
3a69636645
|
[Bugfix][HiSparse] Fix a chunked-prefill preemption livelock (#59494)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-01 13:02:31 -04:00 |
|
|
|
26bfdfb6bc
|
[ROCm][Perf] Parallelise AITER MLA page-index expansion over token chunks (#57978)
Signed-off-by: lifulu <fululi12@amd.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-01 12:00:15 -05:00 |
|
|
Misha GoinandClaude
|
362cfb72de
|
[Agents] Expose PR checklist skill to Claude (#59638)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-10-01 16:54:54 +00:00 |
|
|
Mehmet Cagri
|
08e03df940
|
[Bugfix][ROCm] Use a zero default for masked scales in the MXFP8 GEMM (#59454)
Signed-off-by: Mehmet Cagri Kaymak <mehmet.kaymak@amd.com>
|
2026-10-01 11:32:25 -05:00 |
|
|
Shijie Lyu
|
9aaef4296f
|
[Bugfix][Frontend] Check reused prompt token ids against the vocab before streaming (#59555)
Signed-off-by: Shijie Lyu <lshjhf@gmail.com>
|
2026-10-01 09:26:55 -07:00 |
|