 Harry MellorandClaude Opus 5
|
364679feab
|
[CI] Enable ruff INP to require __init__.py under vllm/ (#56264)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-10 13:49:17 +00:00 |
|
|
Taneem Ibrahim
|
f9083cb83a
|
[Mypy] Fix typing for R/S models (#54157)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-09-10 09:43:08 -04:00 |
|
|
siyuandIsotr0py
|
73fb19151f
|
[Fast Start] Support fp4 (#55465)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-10 13:22:17 +00:00 |
|
|
YoavMironandBenjamin Chislett
|
40e6042ec8
|
[Feature][Spec Decode] MTP with separate (possibly quantized) lm head for nemotron (#54574)
Signed-off-by: Yoav Miron <yomiron@nvidia.com>
Signed-off-by: YoavMiron <yomiron@nvidia.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
|
2026-09-10 08:26:31 -04:00 |
|
|
|
9b959b8657
|
[Model] DeepSeek-V4.1-Flash Model Definitions (#56228)
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-10 20:16:26 +08:00 |
|
|
|
e83d57d8ae
|
[Doc] Sync KV event medium terminology after #48123 (#51646)
Signed-off-by: Alex <jihui.huang@daocloud.io>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-09-10 14:42:31 +03:00 |
|
|
Lucas WilkinsonandNicolò Lucchesi
|
93911fcf68
|
[NIXL][PCP] Report replicated-PCP ranks > 0 as done sending instead of hiding them (#53903)
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@mistral.ai>
|
2026-09-10 12:58:05 +02:00 |
|
|
Juan Pérez de AlgabaandCursor
|
08426d51ef
|
[Docs][Security] Clarify reporter credit and CVE publication timing (#55476)
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-10 10:19:39 +00:00 |
|
|
Wentao Ye
|
86aca66191
|
[Kimi K3 Perf] Avoid KDA mixed-batch gather/scatter, 5.2%~7.7% E2E Throughput Improvement (#56159)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-09-10 17:57:01 +08:00 |
|
|
Jakub ByczkowskiandCopilot
|
c9355e25e8
|
[XPU][Bugfix] Add forward_xpu to Ernie4_5_VLRotaryEmbedding (#55942)
Signed-off-by: Jakub Byczkowski <jakub.byczkowski@intel.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
|
2026-09-10 17:48:00 +08:00 |
|
|
|
6fd08c45e6
|
[XPU][Bugfix] Fix FalconH1 pipeline-parallel execution (#55913)
Signed-off-by: Jakub Byczkowski <jakub.byczkowski@intel.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-10 17:47:29 +08:00 |
|
|
|
fe26c705f7
|
[Model] Add Bailing V3 VL support (#55921)
Signed-off-by: zexplorerhj <zhjoneson@163.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-10 02:46:56 -07:00 |
|
|
Giuseppe Grossi
|
6ff479e1f7
|
[ROCm] Add better kv dtype error discoverability (#55236)
Signed-off-by: Giuseppe Grossi <ggrossi@amd.com>
|
2026-09-10 09:17:41 +00:00 |
|
|
Toby Mao
|
b28c3e1568
|
[BugFix] Retain both replay boundaries so an EAGLE resend of a block-aligned prompt still hits (#54713)
Signed-off-by: tobymao <toby.mao@gmail.com>
|
2026-09-10 16:39:24 +08:00 |
|
|
Jared WenandClaude Fable 5.1
|
1768273c13
|
[Perf][GLM-5.3-Flash] Decode hot-path cleanups: strided KDA recurrent inputs, NoPE MQA query without concat, no duplicate router GEMM (#55736)
Signed-off-by: Jared Wen <jaredwen@inferact.ai>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-10 16:28:33 +08:00 |
|
|
Bugen ZhaoandIsotr0py
|
b47b01cf33
|
[Model][Frontend] Support DeepSeek-V4.1-Flash in Rust and Python frontends (#56208)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-10 01:15:06 -07:00 |
|
|
|
9521c60bdc
|
[ROCm][Perf] Kimi-K3 Fused kernels for KDA prefill reland (#54038)
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: kliuae <17350011+kliuae@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
|
2026-09-10 15:37:54 +08:00 |
|
|
Yongye ZhuandClaude Opus 5
|
be1cb9834b
|
[Kernel] Optional Q-norm in fused DSv4 MLA epilogue; group_size=32 for packed FP8 quant (#56215)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-10 00:35:59 -07:00 |
|
|
Flora Feng
|
9e25706560
|
[Bugfix] Tolerate misspelled DSML tool_calls wrapper (#56141)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
|
2026-09-10 15:04:29 +08:00 |
|
|
|
83990f5bcc
|
[Bugfix][MRV2] Initialize DCP metadata after batch partitioning (#55212)
Signed-off-by: Raphael Rialland <raphael.rialland@mistral.ai>
Signed-off-by: Ziyang Zhang <hafuhafu@qq.com>
Signed-off-by: Sy03 <1370724210@qq.com>
Co-authored-by: Raphael Rialland <raphael.rialland@mistral.ai>
Co-authored-by: Ziyang Zhang <hafuhafu@qq.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-10 06:50:09 +00:00 |
|
|
|
912d2e79fe
|
[multimodal][feat] add torchaudio backend to AudioResampler (#52598)
Signed-off-by: JaredforReal <w13431838023@gmail.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-10 06:42:38 +00:00 |
|
|
|
7e91760650
|
[ROCm][Perf] Route large DSV4 sparse prefill to AITER OPUS (#54855)
Signed-off-by: jiacao-amd <jiahui.cao@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-10 14:39:12 +08:00 |
|
|
Yunzhu LuandIsotr0py
|
442d36031c
|
[MM][CG] Enable encoder CUDA Graph for MiniCPM-V (#42785)
Signed-off-by: YunzhuLu <lucia.yunzhu@gmail.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-10 06:28:48 +00:00 |
|
|
Li, Jiang
|
c3ccc0e957
|
[Model] Add DeepSeek-V4 CPU backend (#55355)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
|
2026-09-10 14:14:48 +08:00 |
|
|
Qiming Zhang
|
49632fb3ac
|
[CI][XPU] Reject CUDA-IPC weight cache on non-CUDA/ROCm platforms (#56010)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
|
2026-09-10 14:05:07 +08:00 |
|
|
Colin Z
|
588a813a60
|
[ROCm] [BugFix] Fix AITER MXFP4 ASM-GEMM crash on unfused shared experts (#55213)
Signed-off-by: Colin Zeng <Colin.Zeng@amd.com>
|
2026-09-10 05:23:36 +00:00 |
|
|
Tianyu Guo
|
479611c0c6
|
[Frontend][EPD] Use JSON arrays for multimodal metadata (#56090)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
|
2026-09-10 05:04:14 +00:00 |
|
|
|
2a02f6efe3
|
[CI][ROCm][Disagg] Add GLM-5.2-FP8 to MoRIIO model catalog (#53885)
Signed-off-by: avininjamay8 <avpaul@amd.com>
Co-authored-by: avininjamay8 <avpaul@amd.com>
Co-authored-by: lcskrishna <lollachaitanya@gmail.com>
|
2026-09-10 12:12:54 +08:00 |
|
|
|
ea40bb9e90
|
[feature] Watermarked generation and detection (Gumbel-max algorithm) (#54053)
Signed-off-by: Raphael Rialland <raphael.rialland@mistral.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-09 21:00:15 -07:00 |
|
|
zvier
|
8c34a37232
|
[Refactor] Extract maybe_run_omni() and defer CLI imports past omni early-return (#56103)
Signed-off-by: Jeff Zvier <zvier20@gmail.com>
|
2026-09-10 03:21:58 +00:00 |
|
|
Qiming Zhang
|
6e1d051fc9
|
[CI][XPU] skip test_models_text on XPU (#56038)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
|
2026-09-10 11:03:09 +08:00 |
|
|
Chaojun Zhang
|
5c0aeb5954
|
[CI][XPU] Disable model runner V2 for XPU quantization test for some partially pre-quantized models (#56179)
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
|
2026-09-10 11:02:57 +08:00 |
|
|
|
3735c2d5f5
|
[Security][Rust Frontend] Normalize HTTP method labels in metrics (#56058)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-10 10:54:40 +08:00 |
|
|
|
41cffa9af0
|
[Rust Frontend] Strongly type wire dtypes and multimodal modalities (#56174)
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-10 02:11:22 +00:00 |
|
|
Bugen Zhao
|
285cbce6bd
|
[Rust Frontend] Resolve unified and split parser selections consistently (#56018)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-09 18:19:30 -07:00 |
|
|
Yan Ma
|
978c22f54b
|
[XPU] update triton-xpu 3.8.0 shim layer (#56014)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-09-10 08:44:11 +08:00 |
|
|
Mikhail PodvitskiiandFlora Feng
|
65f3fca568
|
[Bugfix][Parser] Seed-OSS turn-boundary tokens + boundary-fallback tests (#54264)
Signed-off-by: Mikhail Podvitskii <podvitskiymichael@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-09-09 23:29:30 +00:00 |
|
|
Taneem Ibrahim
|
4ebf61ebda
|
[Cohere] Bound remaining request priorities to the MessagePack int64 range (#56146)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-09-09 18:57:01 -04:00 |
|
|
ykamiset
|
83252ea899
|
[Performance][ROCm] Integrate aiter indexer scoring and top-k kernels into MiniMax-M3 sparse attention path (#52664)
Signed-off-by: Yamini Preethi Kamisetty <YaminiPreethi.Kamisetty@amd.com>
|
2026-09-09 15:40:33 -07:00 |
|
|
Aarushi Jain
|
6983a0883d
|
[ROCm][CI] Split MI300 Distributed Compile by graph partition mode (#53602)
Signed-off-by: Aarushi Jain <142941703+aarushjain29@users.noreply.github.com>
Signed-off-by: Aarushi Jain <aarushi.jain2@amd.com>
|
2026-09-09 17:07:51 -05:00 |
|
|
Andreas Karatzas
|
dcd544486b
|
[ROCm][Bugfix] Support shared KV prefill in AITER attention (#55887)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-09-09 14:51:34 -07:00 |
|
|
yzong-rh
|
26fec6d183
|
[Bugfix] Fix Step-3.5 reasoning parser for structured outputs (#53174)
Signed-off-by: Yifan Zong <yzong@redhat.com>
|
2026-09-09 17:10:23 -04:00 |
|
|
Wei ZhaoandOpenAI Codex
|
8c87c333b8
|
[Perf] Fix TRTLLM ragged prefill perf regression (#55499)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-09 20:38:20 +00:00 |
|
|
|
56d001faf0
|
[Bugfix] Detect OpenAI content format when message.content is passed through macro parameters (#53824)
Signed-off-by: wuhangxian <1391938827@qq.com>
Signed-off-by: wuhangxian <wuhangxian@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: wuhangxian <wuhangxian@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-09 20:10:28 +00:00 |
|
|
djramic
|
cce50657b7
|
[ROCm][CI] Use a platform-independent GEMM in the merged-column fuser test (#56130)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
|
2026-09-09 15:08:39 -05:00 |
|
|
Chris EastwoodandNick Hill
|
e8064a96d0
|
[Bugfix][V2] record_stream idx_mapping in the PP draft broadcast (#55745)
Signed-off-by: Chris Eastwood <chris.eastwood@pwn4g3.dev>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-09-09 12:55:56 -07:00 |
|
|
Aarushi Jain
|
c69d5d72a6
|
[CI][ROCm] Increase timeout for AMD MI355 Language Models (Standard) (#56114)
Signed-off-by: Aarushi Jain <aarushi.jain2@amd.com>
|
2026-09-09 18:10:26 +00:00 |
|
|
Divakar VermaandAndreas Karatzas
|
3fb676bfad
|
[ROCm][CI] Fix moe layer tests for fp8 dtype compatibility (#56106)
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-09 17:48:14 +00:00 |
|
|
Guancheng Fu
|
a207d7ce1d
|
[Bugfix][LoRA] Log when an adapter applies no weights (#55310)
Signed-off-by: Guancheng Fu <110874468+gc-fu@users.noreply.github.com>
|
2026-09-09 17:44:46 +00:00 |
|
|
|
22d95d1adc
|
[Bugfix] Make mm_device_do_normalize encoder-cudagraph safe (#55370)
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-10 01:43:22 +08:00 |
|