|
e77daef89e
|
[Model] Support DeepSeek-V4.1-Flash (#56214)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: andyluo7 <andy.luo@amd.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: andyluo7 <andy.luo@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-11 02:11:19 -07:00 |
|
|
Tony Lin
|
e6821ceac9
|
[XPU][CI] Add decord to test requirements (#56355)
Signed-off-by: Tony Lin <tony.lin@intel.com>
|
2026-09-11 08:58:27 +00:00 |
|
|
Kevin H. LuuandOpenAI Codex
|
1cf6555214
|
[Bugfix] Pin EPLB and MLA host-to-device transfer buffers (#56138)
Signed-off-by: khluu <khluu000@gmail.com>
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-11 01:57:47 -07:00 |
|
|
|
d0dfe587d5
|
[Bugfix] Fall back to full decode graphs for noncompiled models (#55095)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
|
2026-09-11 01:56:05 -07:00 |
|
|
Nicolò Lucchesi
|
9dcab80215
|
[Bugfix][Bench] Fix bench mm-processor crash in shared request sampling (#56300)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-09-11 16:53:04 +08:00 |
|
|
|
69db1c26b4
|
[CI/Build][Rust Frontend] Publish vllm-proto on crates.io (#56365)
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Julien Darve <jdarve@NVIDIA.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-11 16:28:52 +08:00 |
|
|
Fadi ArafehandLi, Jiang <jiang1.li@intel.com>
|
e3f755b732
|
[CPU] Speedup LM Head on Arm CPUs (#55352)
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-09-11 16:21:14 +08:00 |
|
|
pmanczak
|
6376c601ed
|
[XPU][Tests] Enable test_per_token_group_quant_int8 on XPU (#55681)
Signed-off-by: pmanczak <pawel.manczak@intel.com>
|
2026-09-11 15:59:13 +08:00 |
|
|
|
fadfe1c7d4
|
[Bugfix][Core] Retire Mamba states across null gaps (#55450)
Signed-off-by: Luca Motz <luca.motz@icloud.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-09-11 15:50:47 +08:00 |
|
|
Micah Williamson
|
a9271c750f
|
[ROCm][CI] Accept base-v2-preview images during content hash lookup for ROCm base images (#56356)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
|
2026-09-11 02:30:39 -05:00 |
|
|
Alexander
|
5c642796e8
|
[Docs] Add Nebius Serverless AI deployment guide (#56414)
Signed-off-by: Alexander Salikov <salikov57@gmail.com>
|
2026-09-10 23:58:49 -07:00 |
|
|
|
4b839c3378
|
[Attention] Extend XQA decode support on SM90 (#50439)
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-11 06:19:55 +00:00 |
|
|
|
fbf51c7026
|
[Bugfix] Fix FlashInfer KV sharing with omitted K/V (#55864)
Signed-off-by: zhicheng Liu <lzc021026@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-10 23:07:52 -07:00 |
|
|
wang.yuqi
|
fe4d4109c2
|
[Frontend][last/N] Move all non-OpenAI content out of the OpenAI folder. (#56369)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-09-11 05:33:26 +00:00 |
|
|
Hung Hoang (黄兴）andCursor Agent
|
5ff50f3996
|
[Bugfix][MM] Fix swapped H/W in dummy video profiling inputs (#56385)
Signed-off-by: hungh <hungh@nvidia.com>
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
|
2026-09-11 05:25:51 +00:00 |
|
|
Simon Danielsson
|
ae48466cf3
|
[Perf][ROCm] Add AITER custom AG/RS (DP only) (#48247)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-09-11 13:19:57 +08:00 |
|
|
|
980c16c8e4
|
[PCP][Spec Decode] Adds PCP support for single-module MTP and replicated DSpark. (#56107)
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Summer Yang <girasoleyang@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-10 22:07:53 -07:00 |
|
|
Tianyu Guo
|
e7edf17cea
|
[EC] Automatically enable embedding inputs on EC/KV consumers (#56379)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
|
2026-09-11 04:53:37 +00:00 |
|
|
Kushal
|
b5d4186300
|
[Bugfix][LoRA] Use stored rsLoRA scaling factor in MoE expert packing (#55548)
Signed-off-by: Kushal <72650064+kushaldabbe@users.noreply.github.com>
|
2026-09-11 03:52:33 +00:00 |
|
|
|
ce08bb5b34
|
[Bugfix][Mooncake] Fix heterogeneous PP transfer completion (#56033)
Signed-off-by: wangyicong <wangyicong@bytedance.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-11 10:57:19 +08:00 |
|
|
YukioZzz
|
07b7553465
|
[Feature][SimpleCPU] Load fine-grained hybrid prefix hits (#54736)
Signed-off-by: Yichao Zhu <Yichao.Zhu@amd.com>
|
2026-09-10 20:36:37 -05:00 |
|
|
|
828f4f19b4
|
[ROCm][Bugfix] Route GLM-5.3-Flash MTP through ragged sparse MLA (#55239)
Signed-off-by: jamesETsmith <james.smith9113@gmail.com>
Signed-off-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-10 20:13:14 -05:00 |
|
|
焦恺文
|
84030bbe3d
|
[Bugfix][Core] Stop zero-progress preemption cascades for deferred KV frees (#49675)
Signed-off-by: LearningMachine621 <147347705+LearningMachine621@users.noreply.github.com>
|
2026-09-11 00:40:10 +00:00 |
|
|
Marceli FylcekandClaude Opus 5
|
5b6cf93e8e
|
[XPU] Add forward_xpu to Mixer2RMSNormGated and FusedRMSNormGated (#54968)
Signed-off-by: Marceli Fylcek <marceli.fylcek@intel.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-11 07:58:28 +08:00 |
|
|
Tyler Michael SmithandOpenAI Codex
|
a89de950a4
|
[CI/Build] Pin HyperCLOVAX V2 test model revision (#56335)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-10 16:26:11 -07:00 |
|
|
Colin McNamara
|
360f33f61c
|
[Bugfix] Set stop_sequence explicitly in streaming message_delta event (#55325)
Signed-off-by: Colin McNamara <colin@2cups.com>
|
2026-09-10 18:21:21 -04:00 |
|
|
MattandClaude Opus 5
|
9163190dda
|
[ROCm][Bugfix][Perf] Tune multi-stream shared experts use; wvSplitKrc fixes (#56098)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-10 15:14:22 -07:00 |
|
|
shaohuaxiandCodex
|
ae71862c51
|
[Bugfix][Frontend] Check EC requirements for each metadata item (#56070)
Signed-off-by: 子华 <huaxi.shx@alibaba-inc.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-10 19:23:34 +00:00 |
|
|
Jiatai WangandOpenAI Codex
|
a36dfc93cb
|
[Bugfix][Multimodal] Restore cached audio inputs with UUIDs (#56310)
Signed-off-by: JiataiWang <wangjiatai@proton.me>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-10 19:20:03 +00:00 |
|
|
Micah Williamson
|
7de70fa7ae
|
[Bugfix][ROCm] Create linear layer biases with requires_grad=False (#56161)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
|
2026-09-10 13:54:52 -05:00 |
|
|
Matt
|
48cb12c184
|
[ROCm][Bugfix] Fix profiler in TheRock image (#56190)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
|
2026-09-10 13:39:33 -05:00 |
|
|
|
7cdd9304ae
|
[KV Connector] Support symmetric DCP disagg for hybrid mamba models (#55531)
Signed-off-by: Wei Zhao <weizha@oci-aga-slurm-1-vscode-02.cm.cluster>
Signed-off-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Wei Zhao <weizha@oci-aga-slurm-1-vscode-02.cm.cluster>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-10 11:12:15 -07:00 |
|
|
Julien Denize
|
983b7e28c9
|
[Bugfix] Avoid MistralCommonBackend for HF tokenizers (#54192)
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
|
2026-09-10 17:57:44 +00:00 |
|
|
|
8359e15aae
|
[ROCm][Feature] Support KV connectors with ROCM_AITER_UNIFIED_ATTN (#53695)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Signed-off-by: Simon Danielsson <70206058+simondanielsson@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-09-10 12:48:42 -05:00 |
|
|
Nick Hill
|
e6cb56337b
|
[Core] MRV2 support for fast-prefill (#56145)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-09-10 10:36:04 -07:00 |
|
|
Simon Danielsson
|
7470082f57
|
[ROCm][Perf] Add bpreshuffled blockscaled fp8 GEMM (#51692)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-09-10 16:18:37 +00:00 |
|
|
Josiah Davis
|
3078e7cbe1
|
[Docs]: quote variable-bearing wheel URLs (#56286)
Signed-off-by: Josiah Davis <Josiah.Davis@arm.com>
|
2026-09-10 16:13:09 +00:00 |
|
|
Rita Brugarolasandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
6ee5bb0a0b
|
[DCP][Kernel][Perf] Fuse the empty-shard LSE mask into the A2A pack kernel (#54889)
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-10 11:43:00 -04:00 |
|
|
Itay AlroyandTyler Michael Smith
|
bdea2777ea
|
[Bugfix][MoE] Fix batched CUTLASS workspace overallocation (#55579)
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
|
2026-09-10 15:33:56 +00:00 |
|
|
Cenab Batu BoraandCodex
|
db723d245a
|
[Bugfix] Honor explicit empty and zero CLI arguments (#55710)
Signed-off-by: Cenab Batu Bora <40250311+cenab@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-10 15:07:42 +00:00 |
|
|
Li, Jiang
|
46bae7e98c
|
[CI/Build][CPU] Fix flaky rust downloads, broken prune flag, and triton-cpu cache coupling (#56247)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
|
2026-09-10 22:27:26 +08:00 |
|
|
bjf-frzandNick Hill
|
2e0ee66cab
|
[Perf] Use UVA-backed contents for MRV2 apply_write (#55819)
Signed-off-by: bjf-frz <frz123db@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-09-10 07:27:16 -07:00 |
|
|
Alexander CrettenandandClaude
|
7d8d71e989
|
[Bugfix] Qwen3-VL(-MoE): pass architectures to with_hf_config for pipeline parallelism (#43272)
Signed-off-by: Xonder <xonder@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-09-10 14:49:35 +01:00 |
|
|
Harry MellorandClaude Opus 5
|
364679feab
|
[CI] Enable ruff INP to require __init__.py under vllm/ (#56264)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-10 13:49:17 +00:00 |
|
|
Taneem Ibrahim
|
f9083cb83a
|
[Mypy] Fix typing for R/S models (#54157)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-09-10 09:43:08 -04:00 |
|
|
siyuandIsotr0py
|
73fb19151f
|
[Fast Start] Support fp4 (#55465)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-10 13:22:17 +00:00 |
|
|
YoavMironandBenjamin Chislett
|
40e6042ec8
|
[Feature][Spec Decode] MTP with separate (possibly quantized) lm head for nemotron (#54574)
Signed-off-by: Yoav Miron <yomiron@nvidia.com>
Signed-off-by: YoavMiron <yomiron@nvidia.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
|
2026-09-10 08:26:31 -04:00 |
|
|
|
9b959b8657
|
[Model] DeepSeek-V4.1-Flash Model Definitions (#56228)
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-10 20:16:26 +08:00 |
|
|
|
e83d57d8ae
|
[Doc] Sync KV event medium terminology after #48123 (#51646)
Signed-off-by: Alex <jihui.huang@daocloud.io>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-09-10 14:42:31 +03:00 |
|
|
Lucas WilkinsonandNicolò Lucchesi
|
93911fcf68
|
[NIXL][PCP] Report replicated-PCP ranks > 0 as done sending instead of hiding them (#53903)
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@mistral.ai>
|
2026-09-10 12:58:05 +02:00 |
|