Commit Graph
20423 Commits
Author SHA1 Message Date
adisivaprasadandadisivaprasad 73bd7c83c4 [Bugfix][Processor] Replace bare asserts with ValueError in DeepseekVLV2/OCR processors (#53854)
Signed-off-by: adisivaprasad <adisivaprasad@users.noreply.github.com>
Co-authored-by: adisivaprasad <adisivaprasad@users.noreply.github.com>
2026-08-26 09:10:54 +00:00
2267d3b112 [AttentionBackend][HPC-ops] update hpc rope norm to support stride kv cache (#53705)
Signed-off-by: chengvjiang <chengvjiang@tencent.com>
Co-authored-by: chengvjiang <chengvjiang@tencent.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
2026-08-26 08:20:28 +00:00
Jee Jee Li 75aa189ba0 [LoRA] Cleanup VocabParallelEmbedding (#53843)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
2026-08-26 16:19:35 +08:00
Qiu Chunshuo e376d45e82 [Config] Delegate PCP compatibility checks to PCP manager (#53853)
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
2026-08-26 01:16:01 -07:00
Ziming HuangandOpenAI Codex f14369c7f9 [Bugfix][Mooncake] Fix Mamba prefill truncation ordering (#53663)
Signed-off-by: Ziming Huang <zelda.huanghuang@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-08-26 01:08:37 -07:00
rasmithandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> cde7ba92da [CI/Build][The Rock] Use model_class_overrides so spawned worker can use test PredictableLlamaForCausalLM class when worker spawned using Python 3.14 (#49218)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-26 00:55:07 -07:00
Matt 796822d141 [Hardware][AMD][Perf][Bugfix] Update ROCr and clr in base image (#53712)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
2026-08-26 00:38:20 -07:00
ee5ae2ae70 [RL] Add rank-local IPC weight updates (#52497)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
2026-08-26 15:36:57 +08:00
Hung Hoang (黄兴) a5f82882a6 [Bugfix][Model] Honor Molmo2 dummy video num_frames >= 2 override (#53830)
Signed-off-by: hungh <hungh@nvidia.com>
2026-08-26 06:47:02 +00:00
Qiu ChunshuoLucas Wilkinsonmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
b1fbbc2ade BugFix(PCP): use persistent input buffers for PIECEWISE CUDA graphs (#53515)
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-26 05:58:13 +00:00
Flora Feng 46638857fd [Bugfix][Structured Output] Preserve reasoning adapters for shared parser engines (#52830)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
2026-08-26 00:37:36 -04:00
nicholaskh-ainizhang1Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
044b05220e [Kernel][Perf] Tune fused_moe FP8 config for Qwen3.5 on L40S (+7%) (#53819)
Signed-off-by: nizhang1 <nizhang1@coupang.com>
Co-authored-by: nizhang1 <nizhang1@coupang.com>
Co-authored-by: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-08-26 04:02:26 +00:00
Hyunkyun Moon f25c2692fe [Frontend] Add /v1/messages/render endpoint for the Anthropic Messages API (#45803)
Signed-off-by: HyunKyun Moon <mhg5303@gmail.com>
2026-08-26 11:33:59 +08:00
Wentao Yeandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> a5e0045433 [Refactor] Remove dead code quantization 2 (#52821)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-25 20:28:44 -07:00
simon-veitner-redhat 7156c63bef [SM100] Hdim 256 optimized (#52980)
Signed-off-by: Simon Veitner <sveitner@redhat.com>
2026-08-25 20:28:40 -07:00
linitra24 f6130145c8 [Bugfix][LoRA] Enable tower/connector LoRA for Qwen3-Omni (#53557)
Signed-off-by: linitra24 <Joy25810@foxmail.com>
2026-08-26 10:44:41 +08:00
Jee Jee Li 88e1b11313 [Perf] Tune FlashInfer all-reduce thresholds for single-node TP8 on SM103 (#53606)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
2026-08-26 01:46:56 +00:00
Thien TranandCodex d125b540b7 [Agents] Add CUDA IMA debugging skill (#53702)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Codex <codex@openai.com>
2026-08-25 18:09:24 -07:00
Wentao Ye a447955aca [Kimi Bug] Fix k3 torch.AcceleratorError: CUDA error: an illegal memory access was encountered (#53773)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
2026-08-25 17:38:48 -07:00
Canlin Guo bc2d63e650 [Kimi K3][Kernel] Enable low-latency decode GEMM dispatch on SM100 (#53534)
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com>
2026-08-25 16:32:28 -07:00
Almog Tavor bc39ded3c4 [Bugfix][KV Offload] Defer request-level cascade of in-flight primary keys (#53329)
Signed-off-by: almogtavor <almogtavor@gmail.com>
2026-08-25 23:20:03 +00:00
Donald Tolleyyewentao256mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
80771bbbdd [Core] Disable fuse_allreduce_rms under VLLM_BATCH_INVARIANT (non-deterministic under TP) (#51292)
Signed-off-by: Don Tolley <tolleybot@gmail.com>
Signed-off-by: tolleybot <tolleybot@gmail.com>
Co-authored-by: yewentao256 <yewentao256@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-25 15:16:09 -04:00
Wentao Ye 0e30bd62fe [CI Bug] Fix kimi test AssertionError: Aligned Mamba state indices must be precomputed (#53766)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
2026-08-25 15:06:14 -04:00
Wentao Ye 384d079697 [Perf] Autotune batch invariance triton kernel in blackwell, 33.6% E2E latency reduction (#53649)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
2026-08-25 15:06:01 -04:00
Nick Hill e6cc0899b6 [Bugfix][MRV2] Run cudagraph memory profiling in a throwaway graph pool (#53682)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
2026-08-25 18:52:15 +00:00
Misha GoinandOpenAI Codex c9331d8064 [CI] Preserve Rust Docker cache across commits (#53290)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-25 11:13:36 -07:00
Moe Huzaifa 299ebd094a [Bugfix][Multimodal] Reject malformed base64 audio with 400 instead of 500 (#53744)
Signed-off-by: mhuzaifa3 <mhuzaifa3@outlook.com>
2026-08-25 17:31:42 +00:00
Misha Goin 7de96050c5 [Spec Decode] Enable adaptive DSpark on SM100 sparse MLA (#52783)
Signed-off-by: mgoin <mgoin64@gmail.com>
2026-08-25 13:31:15 -04:00
Wentao Ye 70021a0081 [Mypy Fix] Mypy fix for "vllm/model_executor/models/[gG]" (#53616)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
2026-08-25 09:47:16 -07:00
Moe Huzaifa 217a0b5cef [Bugfix][Frontend] Apply the stop string limit to Cohere requests (#53750)
Signed-off-by: mhuzaifa3 <mhuzaifa3@outlook.com>
2026-08-25 16:41:08 +00:00
Moe Huzaifa 3e833933dc [Bugfix][Frontend] Keep credentials out of the Rust frontend launch log (#53738)
Signed-off-by: mhuzaifa3 <mhuzaifa3@outlook.com>
2026-08-25 16:32:12 +00:00
Moe Huzaifa 19406fae28 [Bugfix][Tokenizer] Replace bare asserts in the DeepSeek V4 encoder (#53747)
Signed-off-by: mhuzaifa3 <mhuzaifa3@outlook.com>
2026-08-25 16:30:23 +00:00
Luke Alonso 3454335f7b [Bugfix] Resolve B12X modules before Dynamo tracing (#53326)
Signed-off-by: Luke Alonso <lalonso@gmail.com>
2026-08-25 09:20:15 -07:00
Colin ZandAndreas Karatzas bc11ecaf4e [CI] Add GSM8K accuracy test for amd/DeepSeek-V4-Flash-MXFP4 (#50632)
Signed-off-by: Colin Zeng <Colin.Zeng@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-08-25 09:06:58 -07:00
Yan Ma 10ade93979 [XPU] update key supported models (#53494)
Signed-off-by: Yan Ma <yan.ma@intel.com>
2026-08-25 15:10:48 +00:00
Wentao Ye 41729fc53b [K3 Perf] Optimize k3 mamba metadata preparation, 6.6~7.6x kernel performance improvement (#52388)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
2026-08-25 11:00:28 -04:00
Naveenraj KamalakannanandBenjamin Chislett d5cadcee86 [Feature][DSpark]: Logprobs adaptive verification (#52242)
Signed-off-by: Naveenraj Kamalakannan <therealnaveenkamal@gmail.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
2026-08-25 10:22:33 -04:00
Elvir CrnčevićClaude Opus 4.8Tyler Michael Smithmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
ca29cd48ba [Quantization][Humming] Support MXFP4 weight + block-FP8 activation for MoE (#51332)
Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Elvir Crnčević <elvircrn@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-25 10:21:00 -04:00
Taneem Ibrahim 9c8e90eb26 [Bugfix] Handle parenthesized Gemma4 tool calls (#53657)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
2026-08-25 08:21:42 -04:00
Taneem Ibrahim 2014e47485 [Pooling UX] Improve serve --task error guidance (#53467)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
2026-08-25 08:20:10 -04:00
Elvir Crnčević afc91fa0d2 [Profiler] Fix start_profile permanently no-op after max_iterations auto-stop (#51839)
Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
2026-08-25 08:13:29 -04:00
djramic d9fbe526c0 [ROCm][CI] Skip ModernBERT FP8 MTEB test when no FP8 ScaledMM kernel exists (#53589)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
2026-08-25 08:07:09 +00:00
Tianyu Guo 12c84b98dd [Config][EC] Normalize producer-only encoder config (#53656)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
2026-08-25 07:53:04 +00:00
Jiahao LiangandChauncey 59d7fc92ea [Bugfix][DeepSeek V4] Handle trailing system messages in prompt rendering (#51262)
Signed-off-by: jiahaoliang <gzliangjiahao@gmail.com>
Signed-off-by: Jiahao Liang <gzliangjiahao@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
2026-08-25 07:49:44 +00:00
Ning Xie 23310bc3de [sleep functionality] code refactor about sleep/wake_up (#50431)
Signed-off-by: Andy Xie <andy.xning@gmail.com>
2026-08-25 07:45:20 +00:00
Thien TranandCodex 5e379a361e [Agents] Add kernel microbenchmark skill (#53688)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Codex <codex@openai.com>
2026-08-25 07:25:27 +00:00
Jiatai WangandOpenAI Codex 06ecec7a84 [Bugfix][MM] Fix JinaVL processing cache order (#53553)
Signed-off-by: JiataiWang <wangjiatai@proton.me>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-25 00:03:05 -07:00
wang.yuqi 735daf8ef6 [Frontend] Move cli_args.py and dp_supervisor.py out openai folder (#53659)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
2026-08-25 07:02:32 +00:00
c74dd2d208 [Bugfix][MRV2] Dispatch uniform decode to a padded FULL cudagraph (#53407)
Signed-off-by: Xiaohu Guo <Xiaohu.Guo@amd.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: xiaohuguo2023 <149615094+xiaohuguo2023@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
2026-08-25 06:59:38 +00:00
Louie Tsai 4af586e185 Vllm recipes tool improve (#53325)
Signed-off-by: louie-tsai <louie.tsai@intel.com>
2026-08-25 05:53:47 +00:00