Commit Graph
20456 Commits
Author SHA1 Message Date
Qiu Chunshuo b3af042abd Bugfix: use PCP slot mappings for PIECEWISE capture (#53869)
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
2026-08-27 05:39:36 +00:00
liuzhenwei f25c580af1 [XPU][Dockerfile] Update UCX install (#53817)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
2026-08-27 04:34:03 +00:00
Giancarlo Delfin 5acc1c4e4b [Model Runner V2][Spec Decode] Skip DP sync before EAGLE/MTP draft prefill (#53694) 2026-08-26 20:59:35 -07:00
Ning Xie ca90b9e7d4 [warmup] overlap renderer warmup and engine core initialization (#52764)
Signed-off-by: Andy Xie <andy.xning@gmail.com>
2026-08-27 11:42:08 +08:00
omerpaz95andClaude Opus 5 f8d38fbc87 [EC Connector] EC Offloading Connector use events instead of StepTracker (#49994)
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-27 03:41:46 +00:00
Wei Zhao 94d96e2446 [Bugfix] Release CUDA graph profiling memory before KV cache allocation (#53955)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
2026-08-27 01:35:59 +00:00
rasmith 2dc53bae17 [AMD][BugFix] Add gpu_sync_allowed to ROCm AITER FA backend (#53641)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
2026-08-26 18:23:04 -07:00
yzong-rhandBen Browning 51d1b45182 [Bugfix][GPT-OSS] Fix strict tool-call grammar to accept Harmony renders (#52222)
Signed-off-by: Yifan Zong <yzong@redhat.com>
Co-authored-by: Ben Browning <56071+bbrowning@users.noreply.github.com>
2026-08-26 18:05:09 -07:00
vllm-agentandKevin Luu d1e5e66ee3 [Bugfix] Restore portable all2all backend default (#53952)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
2026-08-26 16:19:49 -07:00
3fd72ffd7b [Bugfix][Rust Frontend] Fix LogprobsTensors wire schema mismatch (#53939)
Signed-off-by: jungjiyu <libraryofjiyu@gmail.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-26 16:16:43 -07:00
liuzhenwei a27e88c862 [XPU][CI] increase timeout of extract_hidden_states tp2 (#53862) 2026-08-26 15:57:36 -07:00
Shenglei FuClaudemergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
f18d0ba90d [Doc] Add Granite 3.1 series to batch invariance tested models (#53650)
Signed-off-by: Shenglei Fu <117230642+ShengleiFu@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-26 18:29:10 -04:00
Wentao Ye 76cfe1cd88 [Kimi K3 Perf] Optimize eh_proj linear calculation, 12.9 ~ 25.2% kernel performance improvement (#53942) 2026-08-26 17:08:02 -04:00
Venkat Balaji SandBen Browning 161ffd37d2 [Bugfix] Guard tool call argument JSON parsing in chat message postprocessing (#48922)
Signed-off-by: VBS2004 <venkatbalaji2004@gmail.com>
Co-authored-by: Ben Browning <56071+bbrowning@users.noreply.github.com>
2026-08-26 20:26:00 +00:00
xiangdong 00ca27d0c1 [XPU][TEST]Move LoRA Multimodal to B70 in Intel GPU CI (#53841)
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
2026-08-26 20:04:10 +00:00
Woosuk Kwon 0a5ad6f0d4 [Model] Remove unused DeepSeek V4 top-k buffer helper (#53697) 2026-08-26 11:59:09 -07:00
xiaohuguo2023andCursor 1a085dadf2 [ROCm][K3] Extend FP8 asm MLA prefill to non-divisor small head counts (#51040)
Signed-off-by: Xiaohu Guo <Xiaohu.Guo@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-26 17:47:16 +00:00
aoshen02 17da48596c [Bugfix][DP] Synchronize the device on pause completion (#52914)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
2026-08-26 09:50:33 -07:00
Avinash Paulandavininjamay8 8d301f075b [Bugfix][ROCm][Disagg] Fix MoRIIO shared KV memory region registration (#53698)
Signed-off-by: avininjamay8 <avpaul@amd.com>
Co-authored-by: avininjamay8 <avpaul@amd.com>
2026-08-27 00:10:57 +08:00
Konstantin DunasandOpenAI Codex c71f6f8a81 [Bugfix] Thread kv_transfer_params into engine for /inference/v1/generate (disagg) (#42644)
Signed-off-by: hallerite <git@hallerite.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-08-26 08:42:52 -07:00
Luciano MartinsandLuciano Martins 2ab187430b [Bugfix] Make Gemma4 MTP suppress_tokens masking CUDA-graph-safe (#53884)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
2026-08-26 15:39:19 +00:00
Fangzhou Ai 657f9b9ce2 [ROCm][DSV4][Perf] Fuse DeepSeek V4 C4 compressor GEMMs (#53838)
Signed-off-by: fai <fangzhouai@gmail.com>
2026-08-26 23:36:14 +08:00
fanxingran 080a66a69c [Bugfix][ROCm] Capture CUDA graphs on the current stream (#53818)
Signed-off-by: fanxingran <xingran.fan@amd.com>
2026-08-26 23:16:45 +08:00
Oliver HolworthyandOpenAI Codex 28b484e5d7 [Model] Pixtral: use packed multimodal encoder attention (#52185)
Signed-off-by: Oliver Holworthy <1216955+oliverholworthy@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-26 14:14:40 +00:00
Jensen ChenClaude Opus 5mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
c47ca4aaeb [Mypy Fix] Mypy fix for "vllm/model_executor/models/[tT]" (#53466)
Signed-off-by: Jensen Chen <a1043904820@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-26 14:12:11 +00:00
Tony 903a02192f [Bugfix] Handle empty FlatLogprobs slices and delta output (#53704)
Signed-off-by: tony <864832769@qq.com>
2026-08-26 21:00:54 +08:00
Robert ShawandRobert Shaw 6a5e8f5979 [DeepEPv2] Support MXFp8 Activation Scale Dispatch (#51398)
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
2026-08-26 12:26:11 +00:00
QWERQWERQWE86 15baeaee98 [Doc] Fix local input path in run-batch examples across docs (#53220) 2026-08-26 12:17:56 +00:00
Artem Perevedentsev 2cd6c664c1 [MoE] enable all2all fi_one_sided by default (#53311)
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
2026-08-26 17:03:45 +05:00
Cyrus Leung 31739ceb0b [CI/Build] Improve pre-commit fail message (#53866)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
2026-08-26 11:22:48 +00:00
ray24777Claude Opus 5Isotr0pymergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
61d4f56635 [Offloader] Offload submodules that make_layers never reaches (#53120)
Signed-off-by: ray24777 <103923677+ray24777@users.noreply.github.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-26 18:37:00 +08:00
Andrey Talman 7a9993878c [CI] forward fix CRCR report step in the torch-nightly lane (#53732)
Signed-off-by: Andrey Talman <atalman@fb.com>
2026-08-26 02:51:26 -07:00
Andrey TalmanandShengqi Chen b821d7b2a6 [CI] Build mamba-ssm with C++20 for torch 2.14 nightly compatibility (#49600)
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
2026-08-26 17:31:08 +08:00
adisivaprasadandadisivaprasad 73bd7c83c4 [Bugfix][Processor] Replace bare asserts with ValueError in DeepseekVLV2/OCR processors (#53854)
Signed-off-by: adisivaprasad <adisivaprasad@users.noreply.github.com>
Co-authored-by: adisivaprasad <adisivaprasad@users.noreply.github.com>
2026-08-26 09:10:54 +00:00
2267d3b112 [AttentionBackend][HPC-ops] update hpc rope norm to support stride kv cache (#53705)
Signed-off-by: chengvjiang <chengvjiang@tencent.com>
Co-authored-by: chengvjiang <chengvjiang@tencent.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
2026-08-26 08:20:28 +00:00
Jee Jee Li 75aa189ba0 [LoRA] Cleanup VocabParallelEmbedding (#53843)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
2026-08-26 16:19:35 +08:00
Qiu Chunshuo e376d45e82 [Config] Delegate PCP compatibility checks to PCP manager (#53853)
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
2026-08-26 01:16:01 -07:00
Ziming HuangandOpenAI Codex f14369c7f9 [Bugfix][Mooncake] Fix Mamba prefill truncation ordering (#53663)
Signed-off-by: Ziming Huang <zelda.huanghuang@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-08-26 01:08:37 -07:00
rasmithandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> cde7ba92da [CI/Build][The Rock] Use model_class_overrides so spawned worker can use test PredictableLlamaForCausalLM class when worker spawned using Python 3.14 (#49218)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-26 00:55:07 -07:00
Matt 796822d141 [Hardware][AMD][Perf][Bugfix] Update ROCr and clr in base image (#53712)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
2026-08-26 00:38:20 -07:00
ee5ae2ae70 [RL] Add rank-local IPC weight updates (#52497)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
2026-08-26 15:36:57 +08:00
Hung Hoang (黄兴) a5f82882a6 [Bugfix][Model] Honor Molmo2 dummy video num_frames >= 2 override (#53830)
Signed-off-by: hungh <hungh@nvidia.com>
2026-08-26 06:47:02 +00:00
Qiu ChunshuoLucas Wilkinsonmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
b1fbbc2ade BugFix(PCP): use persistent input buffers for PIECEWISE CUDA graphs (#53515)
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-26 05:58:13 +00:00
Flora Feng 46638857fd [Bugfix][Structured Output] Preserve reasoning adapters for shared parser engines (#52830)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
2026-08-26 00:37:36 -04:00
nicholaskh-ainizhang1Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
044b05220e [Kernel][Perf] Tune fused_moe FP8 config for Qwen3.5 on L40S (+7%) (#53819)
Signed-off-by: nizhang1 <nizhang1@coupang.com>
Co-authored-by: nizhang1 <nizhang1@coupang.com>
Co-authored-by: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-08-26 04:02:26 +00:00
Hyunkyun Moon f25c2692fe [Frontend] Add /v1/messages/render endpoint for the Anthropic Messages API (#45803)
Signed-off-by: HyunKyun Moon <mhg5303@gmail.com>
2026-08-26 11:33:59 +08:00
Wentao Yeandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> a5e0045433 [Refactor] Remove dead code quantization 2 (#52821)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-25 20:28:44 -07:00
simon-veitner-redhat 7156c63bef [SM100] Hdim 256 optimized (#52980)
Signed-off-by: Simon Veitner <sveitner@redhat.com>
2026-08-25 20:28:40 -07:00
linitra24 f6130145c8 [Bugfix][LoRA] Enable tower/connector LoRA for Qwen3-Omni (#53557)
Signed-off-by: linitra24 <Joy25810@foxmail.com>
2026-08-26 10:44:41 +08:00
Jee Jee Li 88e1b11313 [Perf] Tune FlashInfer all-reduce thresholds for single-node TP8 on SM103 (#53606)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
2026-08-26 01:46:56 +00:00