 aoshen02
|
17da48596c
|
[Bugfix][DP] Synchronize the device on pause completion (#52914)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
|
2026-08-26 09:50:33 -07:00 |
|
|
Avinash Paulandavininjamay8
|
8d301f075b
|
[Bugfix][ROCm][Disagg] Fix MoRIIO shared KV memory region registration (#53698)
Signed-off-by: avininjamay8 <avpaul@amd.com>
Co-authored-by: avininjamay8 <avpaul@amd.com>
|
2026-08-27 00:10:57 +08:00 |
|
|
Konstantin DunasandOpenAI Codex
|
c71f6f8a81
|
[Bugfix] Thread kv_transfer_params into engine for /inference/v1/generate (disagg) (#42644)
Signed-off-by: hallerite <git@hallerite.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-26 08:42:52 -07:00 |
|
|
Luciano MartinsandLuciano Martins
|
2ab187430b
|
[Bugfix] Make Gemma4 MTP suppress_tokens masking CUDA-graph-safe (#53884)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
|
2026-08-26 15:39:19 +00:00 |
|
|
Fangzhou Ai
|
657f9b9ce2
|
[ROCm][DSV4][Perf] Fuse DeepSeek V4 C4 compressor GEMMs (#53838)
Signed-off-by: fai <fangzhouai@gmail.com>
|
2026-08-26 23:36:14 +08:00 |
|
|
fanxingran
|
080a66a69c
|
[Bugfix][ROCm] Capture CUDA graphs on the current stream (#53818)
Signed-off-by: fanxingran <xingran.fan@amd.com>
|
2026-08-26 23:16:45 +08:00 |
|
|
Oliver HolworthyandOpenAI Codex
|
28b484e5d7
|
[Model] Pixtral: use packed multimodal encoder attention (#52185)
Signed-off-by: Oliver Holworthy <1216955+oliverholworthy@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-26 14:14:40 +00:00 |
|
|
|
c47ca4aaeb
|
[Mypy Fix] Mypy fix for "vllm/model_executor/models/[tT]" (#53466)
Signed-off-by: Jensen Chen <a1043904820@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-26 14:12:11 +00:00 |
|
|
Tony
|
903a02192f
|
[Bugfix] Handle empty FlatLogprobs slices and delta output (#53704)
Signed-off-by: tony <864832769@qq.com>
|
2026-08-26 21:00:54 +08:00 |
|
|
Robert ShawandRobert Shaw
|
6a5e8f5979
|
[DeepEPv2] Support MXFp8 Activation Scale Dispatch (#51398)
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
|
2026-08-26 12:26:11 +00:00 |
|
|
QWERQWERQWE86
|
15baeaee98
|
[Doc] Fix local input path in run-batch examples across docs (#53220)
|
2026-08-26 12:17:56 +00:00 |
|
|
Artem Perevedentsev
|
2cd6c664c1
|
[MoE] enable all2all fi_one_sided by default (#53311)
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
|
2026-08-26 17:03:45 +05:00 |
|
|
Cyrus Leung
|
31739ceb0b
|
[CI/Build] Improve pre-commit fail message (#53866)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-08-26 11:22:48 +00:00 |
|
|
|
61d4f56635
|
[Offloader] Offload submodules that make_layers never reaches (#53120)
Signed-off-by: ray24777 <103923677+ray24777@users.noreply.github.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-26 18:37:00 +08:00 |
|
|
Andrey Talman
|
7a9993878c
|
[CI] forward fix CRCR report step in the torch-nightly lane (#53732)
Signed-off-by: Andrey Talman <atalman@fb.com>
|
2026-08-26 02:51:26 -07:00 |
|
|
Andrey TalmanandShengqi Chen
|
b821d7b2a6
|
[CI] Build mamba-ssm with C++20 for torch 2.14 nightly compatibility (#49600)
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
|
2026-08-26 17:31:08 +08:00 |
|
|
adisivaprasadandadisivaprasad
|
73bd7c83c4
|
[Bugfix][Processor] Replace bare asserts with ValueError in DeepseekVLV2/OCR processors (#53854)
Signed-off-by: adisivaprasad <adisivaprasad@users.noreply.github.com>
Co-authored-by: adisivaprasad <adisivaprasad@users.noreply.github.com>
|
2026-08-26 09:10:54 +00:00 |
|
|
|
2267d3b112
|
[AttentionBackend][HPC-ops] update hpc rope norm to support stride kv cache (#53705)
Signed-off-by: chengvjiang <chengvjiang@tencent.com>
Co-authored-by: chengvjiang <chengvjiang@tencent.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
|
2026-08-26 08:20:28 +00:00 |
|
|
Jee Jee Li
|
75aa189ba0
|
[LoRA] Cleanup VocabParallelEmbedding (#53843)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-08-26 16:19:35 +08:00 |
|
|
Qiu Chunshuo
|
e376d45e82
|
[Config] Delegate PCP compatibility checks to PCP manager (#53853)
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
|
2026-08-26 01:16:01 -07:00 |
|
|
Ziming HuangandOpenAI Codex
|
f14369c7f9
|
[Bugfix][Mooncake] Fix Mamba prefill truncation ordering (#53663)
Signed-off-by: Ziming Huang <zelda.huanghuang@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-26 01:08:37 -07:00 |
|
|
rasmithandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
cde7ba92da
|
[CI/Build][The Rock] Use model_class_overrides so spawned worker can use test PredictableLlamaForCausalLM class when worker spawned using Python 3.14 (#49218)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-26 00:55:07 -07:00 |
|
|
Matt
|
796822d141
|
[Hardware][AMD][Perf][Bugfix] Update ROCr and clr in base image (#53712)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
|
2026-08-26 00:38:20 -07:00 |
|
|
|
ee5ae2ae70
|
[RL] Add rank-local IPC weight updates (#52497)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
|
2026-08-26 15:36:57 +08:00 |
|
|
Hung Hoang (黄兴）
|
a5f82882a6
|
[Bugfix][Model] Honor Molmo2 dummy video num_frames >= 2 override (#53830)
Signed-off-by: hungh <hungh@nvidia.com>
|
2026-08-26 06:47:02 +00:00 |
|
|
|
b1fbbc2ade
|
BugFix(PCP): use persistent input buffers for PIECEWISE CUDA graphs (#53515)
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-26 05:58:13 +00:00 |
|
|
Flora Feng
|
46638857fd
|
[Bugfix][Structured Output] Preserve reasoning adapters for shared parser engines (#52830)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
|
2026-08-26 00:37:36 -04:00 |
|
|
|
044b05220e
|
[Kernel][Perf] Tune fused_moe FP8 config for Qwen3.5 on L40S (+7%) (#53819)
Signed-off-by: nizhang1 <nizhang1@coupang.com>
Co-authored-by: nizhang1 <nizhang1@coupang.com>
Co-authored-by: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
|
2026-08-26 04:02:26 +00:00 |
|
|
Hyunkyun Moon
|
f25c2692fe
|
[Frontend] Add /v1/messages/render endpoint for the Anthropic Messages API (#45803)
Signed-off-by: HyunKyun Moon <mhg5303@gmail.com>
|
2026-08-26 11:33:59 +08:00 |
|
|
Wentao Yeandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
a5e0045433
|
[Refactor] Remove dead code quantization 2 (#52821)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-25 20:28:44 -07:00 |
|
|
simon-veitner-redhat
|
7156c63bef
|
[SM100] Hdim 256 optimized (#52980)
Signed-off-by: Simon Veitner <sveitner@redhat.com>
|
2026-08-25 20:28:40 -07:00 |
|
|
linitra24
|
f6130145c8
|
[Bugfix][LoRA] Enable tower/connector LoRA for Qwen3-Omni (#53557)
Signed-off-by: linitra24 <Joy25810@foxmail.com>
|
2026-08-26 10:44:41 +08:00 |
|
|
Jee Jee Li
|
88e1b11313
|
[Perf] Tune FlashInfer all-reduce thresholds for single-node TP8 on SM103 (#53606)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-08-26 01:46:56 +00:00 |
|
|
Thien TranandCodex
|
d125b540b7
|
[Agents] Add CUDA IMA debugging skill (#53702)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Codex <codex@openai.com>
|
2026-08-25 18:09:24 -07:00 |
|
|
Wentao Ye
|
a447955aca
|
[Kimi Bug] Fix k3 torch.AcceleratorError: CUDA error: an illegal memory access was encountered (#53773)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-25 17:38:48 -07:00 |
|
|
Canlin Guo
|
bc2d63e650
|
[Kimi K3][Kernel] Enable low-latency decode GEMM dispatch on SM100 (#53534)
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com>
|
2026-08-25 16:32:28 -07:00 |
|
|
Almog Tavor
|
bc39ded3c4
|
[Bugfix][KV Offload] Defer request-level cascade of in-flight primary keys (#53329)
Signed-off-by: almogtavor <almogtavor@gmail.com>
|
2026-08-25 23:20:03 +00:00 |
|
|
|
80771bbbdd
|
[Core] Disable fuse_allreduce_rms under VLLM_BATCH_INVARIANT (non-deterministic under TP) (#51292)
Signed-off-by: Don Tolley <tolleybot@gmail.com>
Signed-off-by: tolleybot <tolleybot@gmail.com>
Co-authored-by: yewentao256 <yewentao256@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-25 15:16:09 -04:00 |
|
|
Wentao Ye
|
0e30bd62fe
|
[CI Bug] Fix kimi test AssertionError: Aligned Mamba state indices must be precomputed (#53766)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-25 15:06:14 -04:00 |
|
|
Wentao Ye
|
384d079697
|
[Perf] Autotune batch invariance triton kernel in blackwell, 33.6% E2E latency reduction (#53649)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-25 15:06:01 -04:00 |
|
|
Nick Hill
|
e6cc0899b6
|
[Bugfix][MRV2] Run cudagraph memory profiling in a throwaway graph pool (#53682)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-25 18:52:15 +00:00 |
|
|
Misha GoinandOpenAI Codex
|
c9331d8064
|
[CI] Preserve Rust Docker cache across commits (#53290)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-25 11:13:36 -07:00 |
|
|
Moe Huzaifa
|
299ebd094a
|
[Bugfix][Multimodal] Reject malformed base64 audio with 400 instead of 500 (#53744)
Signed-off-by: mhuzaifa3 <mhuzaifa3@outlook.com>
|
2026-08-25 17:31:42 +00:00 |
|
|
Misha Goin
|
7de96050c5
|
[Spec Decode] Enable adaptive DSpark on SM100 sparse MLA (#52783)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-25 13:31:15 -04:00 |
|
|
Wentao Ye
|
70021a0081
|
[Mypy Fix] Mypy fix for "vllm/model_executor/models/[gG]" (#53616)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-25 09:47:16 -07:00 |
|
|
Moe Huzaifa
|
217a0b5cef
|
[Bugfix][Frontend] Apply the stop string limit to Cohere requests (#53750)
Signed-off-by: mhuzaifa3 <mhuzaifa3@outlook.com>
|
2026-08-25 16:41:08 +00:00 |
|
|
Moe Huzaifa
|
3e833933dc
|
[Bugfix][Frontend] Keep credentials out of the Rust frontend launch log (#53738)
Signed-off-by: mhuzaifa3 <mhuzaifa3@outlook.com>
|
2026-08-25 16:32:12 +00:00 |
|
|
Moe Huzaifa
|
19406fae28
|
[Bugfix][Tokenizer] Replace bare asserts in the DeepSeek V4 encoder (#53747)
Signed-off-by: mhuzaifa3 <mhuzaifa3@outlook.com>
|
2026-08-25 16:30:23 +00:00 |
|
|
Luke Alonso
|
3454335f7b
|
[Bugfix] Resolve B12X modules before Dynamo tracing (#53326)
Signed-off-by: Luke Alonso <lalonso@gmail.com>
|
2026-08-25 09:20:15 -07:00 |
|
|
Colin ZandAndreas Karatzas
|
bc11ecaf4e
|
[CI] Add GSM8K accuracy test for amd/DeepSeek-V4-Flash-MXFP4 (#50632)
Signed-off-by: Colin Zeng <Colin.Zeng@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-25 09:06:58 -07:00 |
|