|
2267d3b112
|
[AttentionBackend][HPC-ops] update hpc rope norm to support stride kv cache (#53705)
Signed-off-by: chengvjiang <chengvjiang@tencent.com>
Co-authored-by: chengvjiang <chengvjiang@tencent.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
|
2026-08-26 08:20:28 +00:00 |
|
|
Jee Jee Li
|
75aa189ba0
|
[LoRA] Cleanup VocabParallelEmbedding (#53843)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-08-26 16:19:35 +08:00 |
|
|
Qiu Chunshuo
|
e376d45e82
|
[Config] Delegate PCP compatibility checks to PCP manager (#53853)
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
|
2026-08-26 01:16:01 -07:00 |
|
|
Ziming HuangandOpenAI Codex
|
f14369c7f9
|
[Bugfix][Mooncake] Fix Mamba prefill truncation ordering (#53663)
Signed-off-by: Ziming Huang <zelda.huanghuang@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-26 01:08:37 -07:00 |
|
|
rasmithandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
cde7ba92da
|
[CI/Build][The Rock] Use model_class_overrides so spawned worker can use test PredictableLlamaForCausalLM class when worker spawned using Python 3.14 (#49218)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-26 00:55:07 -07:00 |
|
|
Matt
|
796822d141
|
[Hardware][AMD][Perf][Bugfix] Update ROCr and clr in base image (#53712)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
|
2026-08-26 00:38:20 -07:00 |
|
|
|
ee5ae2ae70
|
[RL] Add rank-local IPC weight updates (#52497)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
|
2026-08-26 15:36:57 +08:00 |
|
|
Hung Hoang (黄兴）
|
a5f82882a6
|
[Bugfix][Model] Honor Molmo2 dummy video num_frames >= 2 override (#53830)
Signed-off-by: hungh <hungh@nvidia.com>
|
2026-08-26 06:47:02 +00:00 |
|
|
|
b1fbbc2ade
|
BugFix(PCP): use persistent input buffers for PIECEWISE CUDA graphs (#53515)
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-26 05:58:13 +00:00 |
|
|
Flora Feng
|
46638857fd
|
[Bugfix][Structured Output] Preserve reasoning adapters for shared parser engines (#52830)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
|
2026-08-26 00:37:36 -04:00 |
|
|
|
044b05220e
|
[Kernel][Perf] Tune fused_moe FP8 config for Qwen3.5 on L40S (+7%) (#53819)
Signed-off-by: nizhang1 <nizhang1@coupang.com>
Co-authored-by: nizhang1 <nizhang1@coupang.com>
Co-authored-by: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
|
2026-08-26 04:02:26 +00:00 |
|
|
Hyunkyun Moon
|
f25c2692fe
|
[Frontend] Add /v1/messages/render endpoint for the Anthropic Messages API (#45803)
Signed-off-by: HyunKyun Moon <mhg5303@gmail.com>
|
2026-08-26 11:33:59 +08:00 |
|
|
Wentao Yeandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
a5e0045433
|
[Refactor] Remove dead code quantization 2 (#52821)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-25 20:28:44 -07:00 |
|
|
simon-veitner-redhat
|
7156c63bef
|
[SM100] Hdim 256 optimized (#52980)
Signed-off-by: Simon Veitner <sveitner@redhat.com>
|
2026-08-25 20:28:40 -07:00 |
|
|
linitra24
|
f6130145c8
|
[Bugfix][LoRA] Enable tower/connector LoRA for Qwen3-Omni (#53557)
Signed-off-by: linitra24 <Joy25810@foxmail.com>
|
2026-08-26 10:44:41 +08:00 |
|
|
Jee Jee Li
|
88e1b11313
|
[Perf] Tune FlashInfer all-reduce thresholds for single-node TP8 on SM103 (#53606)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-08-26 01:46:56 +00:00 |
|
|
Thien TranandCodex
|
d125b540b7
|
[Agents] Add CUDA IMA debugging skill (#53702)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Codex <codex@openai.com>
|
2026-08-25 18:09:24 -07:00 |
|
|
Wentao Ye
|
a447955aca
|
[Kimi Bug] Fix k3 torch.AcceleratorError: CUDA error: an illegal memory access was encountered (#53773)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-25 17:38:48 -07:00 |
|
|
Canlin Guo
|
bc2d63e650
|
[Kimi K3][Kernel] Enable low-latency decode GEMM dispatch on SM100 (#53534)
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com>
|
2026-08-25 16:32:28 -07:00 |
|
|
Almog Tavor
|
bc39ded3c4
|
[Bugfix][KV Offload] Defer request-level cascade of in-flight primary keys (#53329)
Signed-off-by: almogtavor <almogtavor@gmail.com>
|
2026-08-25 23:20:03 +00:00 |
|
|
|
80771bbbdd
|
[Core] Disable fuse_allreduce_rms under VLLM_BATCH_INVARIANT (non-deterministic under TP) (#51292)
Signed-off-by: Don Tolley <tolleybot@gmail.com>
Signed-off-by: tolleybot <tolleybot@gmail.com>
Co-authored-by: yewentao256 <yewentao256@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-25 15:16:09 -04:00 |
|
|
Wentao Ye
|
0e30bd62fe
|
[CI Bug] Fix kimi test AssertionError: Aligned Mamba state indices must be precomputed (#53766)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-25 15:06:14 -04:00 |
|
|
Wentao Ye
|
384d079697
|
[Perf] Autotune batch invariance triton kernel in blackwell, 33.6% E2E latency reduction (#53649)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-25 15:06:01 -04:00 |
|
|
Nick Hill
|
e6cc0899b6
|
[Bugfix][MRV2] Run cudagraph memory profiling in a throwaway graph pool (#53682)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-25 18:52:15 +00:00 |
|
|
Misha GoinandOpenAI Codex
|
c9331d8064
|
[CI] Preserve Rust Docker cache across commits (#53290)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-25 11:13:36 -07:00 |
|
|
Moe Huzaifa
|
299ebd094a
|
[Bugfix][Multimodal] Reject malformed base64 audio with 400 instead of 500 (#53744)
Signed-off-by: mhuzaifa3 <mhuzaifa3@outlook.com>
|
2026-08-25 17:31:42 +00:00 |
|
|
Misha Goin
|
7de96050c5
|
[Spec Decode] Enable adaptive DSpark on SM100 sparse MLA (#52783)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-25 13:31:15 -04:00 |
|
|
Wentao Ye
|
70021a0081
|
[Mypy Fix] Mypy fix for "vllm/model_executor/models/[gG]" (#53616)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-25 09:47:16 -07:00 |
|
|
Moe Huzaifa
|
217a0b5cef
|
[Bugfix][Frontend] Apply the stop string limit to Cohere requests (#53750)
Signed-off-by: mhuzaifa3 <mhuzaifa3@outlook.com>
|
2026-08-25 16:41:08 +00:00 |
|
|
Moe Huzaifa
|
3e833933dc
|
[Bugfix][Frontend] Keep credentials out of the Rust frontend launch log (#53738)
Signed-off-by: mhuzaifa3 <mhuzaifa3@outlook.com>
|
2026-08-25 16:32:12 +00:00 |
|
|
Moe Huzaifa
|
19406fae28
|
[Bugfix][Tokenizer] Replace bare asserts in the DeepSeek V4 encoder (#53747)
Signed-off-by: mhuzaifa3 <mhuzaifa3@outlook.com>
|
2026-08-25 16:30:23 +00:00 |
|
|
Luke Alonso
|
3454335f7b
|
[Bugfix] Resolve B12X modules before Dynamo tracing (#53326)
Signed-off-by: Luke Alonso <lalonso@gmail.com>
|
2026-08-25 09:20:15 -07:00 |
|
|
Colin ZandAndreas Karatzas
|
bc11ecaf4e
|
[CI] Add GSM8K accuracy test for amd/DeepSeek-V4-Flash-MXFP4 (#50632)
Signed-off-by: Colin Zeng <Colin.Zeng@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-25 09:06:58 -07:00 |
|
|
Yan Ma
|
10ade93979
|
[XPU] update key supported models (#53494)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-08-25 15:10:48 +00:00 |
|
|
Wentao Ye
|
41729fc53b
|
[K3 Perf] Optimize k3 mamba metadata preparation, 6.6~7.6x kernel performance improvement (#52388)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-25 11:00:28 -04:00 |
|
|
Naveenraj KamalakannanandBenjamin Chislett
|
d5cadcee86
|
[Feature][DSpark]: Logprobs adaptive verification (#52242)
Signed-off-by: Naveenraj Kamalakannan <therealnaveenkamal@gmail.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
|
2026-08-25 10:22:33 -04:00 |
|
|
|
ca29cd48ba
|
[Quantization][Humming] Support MXFP4 weight + block-FP8 activation for MoE (#51332)
Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Elvir Crnčević <elvircrn@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-25 10:21:00 -04:00 |
|
|
Taneem Ibrahim
|
9c8e90eb26
|
[Bugfix] Handle parenthesized Gemma4 tool calls (#53657)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-25 08:21:42 -04:00 |
|
|
Taneem Ibrahim
|
2014e47485
|
[Pooling UX] Improve serve --task error guidance (#53467)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-25 08:20:10 -04:00 |
|
|
Elvir Crnčević
|
afc91fa0d2
|
[Profiler] Fix start_profile permanently no-op after max_iterations auto-stop (#51839)
Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
|
2026-08-25 08:13:29 -04:00 |
|
|
djramic
|
d9fbe526c0
|
[ROCm][CI] Skip ModernBERT FP8 MTEB test when no FP8 ScaledMM kernel exists (#53589)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
|
2026-08-25 08:07:09 +00:00 |
|
|
Tianyu Guo
|
12c84b98dd
|
[Config][EC] Normalize producer-only encoder config (#53656)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
|
2026-08-25 07:53:04 +00:00 |
|
|
Jiahao LiangandChauncey
|
59d7fc92ea
|
[Bugfix][DeepSeek V4] Handle trailing system messages in prompt rendering (#51262)
Signed-off-by: jiahaoliang <gzliangjiahao@gmail.com>
Signed-off-by: Jiahao Liang <gzliangjiahao@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-08-25 07:49:44 +00:00 |
|
|
Ning Xie
|
23310bc3de
|
[sleep functionality] code refactor about sleep/wake_up (#50431)
Signed-off-by: Andy Xie <andy.xning@gmail.com>
|
2026-08-25 07:45:20 +00:00 |
|
|
Thien TranandCodex
|
5e379a361e
|
[Agents] Add kernel microbenchmark skill (#53688)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Codex <codex@openai.com>
|
2026-08-25 07:25:27 +00:00 |
|
|
Jiatai WangandOpenAI Codex
|
06ecec7a84
|
[Bugfix][MM] Fix JinaVL processing cache order (#53553)
Signed-off-by: JiataiWang <wangjiatai@proton.me>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-25 00:03:05 -07:00 |
|
|
wang.yuqi
|
735daf8ef6
|
[Frontend] Move cli_args.py and dp_supervisor.py out openai folder (#53659)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-25 07:02:32 +00:00 |
|
|
|
c74dd2d208
|
[Bugfix][MRV2] Dispatch uniform decode to a padded FULL cudagraph (#53407)
Signed-off-by: Xiaohu Guo <Xiaohu.Guo@amd.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: xiaohuguo2023 <149615094+xiaohuguo2023@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
|
2026-08-25 06:59:38 +00:00 |
|
|
Louie Tsai
|
4af586e185
|
Vllm recipes tool improve (#53325)
Signed-off-by: louie-tsai <louie.tsai@intel.com>
|
2026-08-25 05:53:47 +00:00 |
|
|
|
48d7132962
|
[Model] Migrate FlexOlmo, Olmo3 and Hunyuan V1/VL to the Transformers modeling backend (#53615)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-08-24 22:39:05 -07:00 |
|