Commit Graph
20845 Commits
Author SHA1 Message Date
hy123andOpenAI Codex b160cab156 [Bugfix] Restore model info caching for package backends (#52690)
Signed-off-by: haoyang.qian <haoyangqian@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-19 11:18:10 +00:00
wangxiyuan cba06764d7 [Platform] Fill in the missing backend parameter for torch.compile (#51781)
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
2026-08-19 10:31:19 +00:00
wang.yuqi eac636a7fa [Frontend] Move api_server.py out openai folder (#52131)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
2026-08-19 09:43:46 +00:00
Yufeng He 340b7e4909 fix: reject string schemas that mix pattern/format with length bounds (#49996)
Signed-off-by: Yufeng He <40085740+he-yufeng@users.noreply.github.com>
2026-08-19 17:29:32 +08:00
Qiming Zhang 93eea4f665 [XPU][CI] downgrade sentencepiece (#52904)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
2026-08-19 09:01:12 +00:00
LuckyStep 9a9aa2b017 [Bugfix] Redact api_key in non-default args log (#52523)
Signed-off-by: LuckyStep <67696304+Andy365-365@users.noreply.github.com>
2026-08-19 15:52:53 +08:00
Taneem Ibrahim 842dd8fd96 [Pooling] Use semantic task validation errors (#52867)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
2026-08-19 07:21:08 +00:00
Woosuk Kwon b09bd69b5b [Model][NVIDIA] Route DSA models to the CUDA non-compiled path (#52861) 2026-08-19 00:13:52 -07:00
Nick Hill ee11730751 [BugFix] Revert incorrect MM keep_on_cpu=True changes (#52881)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
2026-08-19 07:07:40 +00:00
5a4c8d9924 [Bugfix][LoRA] Add embedding_modules for Qwen3.5 CausalLM (#48850)
Signed-off-by: m0_68169237 <m0_68169237@noreply.gitcode.com>
Co-authored-by: m0_68169237 <m0_68169237@noreply.gitcode.com>
Co-authored-by: Cursor Composer <composer@cursor.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
2026-08-19 04:55:20 +00:00
Vineeth Sai Varikuntla 86a89a9348 [Bugfix][Frontend] Run the serve arg checks for vllm launch too (#52825)
Signed-off-by: Vineeth Sai <vineethsai4444@gmail.com>
2026-08-19 04:48:50 +00:00
Taneem Ibrahim 08afae2786 [ModelRunner v2] Enable MRV2 for pooling models by default (#48290)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
2026-08-18 21:36:05 -07:00
drakoshaClaudemergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
63ff748f65 [Attention][MLA] FlashMLA sparse: DCP on the fp8_ds_mla mixed-batch path + MTP (#46514)
Signed-off-by: Mikhail Kostryukov <mike@triptrack.net>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-19 00:02:09 -04:00
3130573630 [Model] Add GraniteSWA and GraniteMoeSWA via existing Granite (#52706)
Signed-off-by: Davis Wertheimer <davis.wertheimer@ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-18 20:32:46 -07:00
Matthew Bonanniandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 8e46accab2 [Attention] Vectorize sparse MLA mask loads (#52217)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-18 20:32:41 -07:00
Qiming Zhang e575b5f1a9 [XPU][CI] fix hf runner (#52730)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
2026-08-19 11:30:47 +08:00
Nick Hill deeeae75d0 [MM] Keep more metadata tensors on CPU (#52827)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
2026-08-18 19:56:33 -07:00
Tyler Michael SmithandOpenAI Codex aabc1a0a0b [Bugfix][Benchmark] Check readiness before tokenizer init in rust vllm-bench (#51863)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-19 02:52:25 +00:00
Qiming Zhang 03b87dc42f [XPU] upgrade requirements/test/xpu.txt (#52672)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
Signed-off-by: Qiming Zhang <qiming1.zhang@intel.com>
2026-08-19 10:47:37 +08:00
Willow Lopez f936a267f9 [Bugfix][XPU] Fix Mamba state pointer overflow (#48109)
Signed-off-by: Oxygen56 <jiangth99@163.com>
2026-08-19 10:45:41 +08:00
Li, Jiang e4d61d0d22 [CPU] Add AMX-only high-performance MLA backend for DeepSeek V2/V3/R1 (#52616)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
2026-08-19 10:28:52 +08:00
Chaojun Zhang f485081e8b [XPU] Support EC connector KV Offloading on XPU (#49532)
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
2026-08-19 10:25:23 +08:00
liuzhenwei b1d9337e92 [EPD] Allow KV consumers to omit MM embeddings (#52697)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
2026-08-19 02:16:08 +00:00
Itay Alroy a2257f95b7 [Elastic EP] Reduce eager-mode reconfiguration downtime (#51885)
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
2026-08-19 02:13:06 +00:00
Itay EtelisandItay Etelis d36cc4254e [Bugfix][Elastic EP] Reject scale below the minimum data parallel size (#52702)
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
2026-08-19 01:37:29 +00:00
b05ae5dc00 [CI][Bugfix] Complete DeepSeek-V4 FSE test fixture contract (#52842)
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Claude <noreply@anthropic.com>
2026-08-18 19:04:10 -06:00
Woosuk KwonandOpenAI Codex f1178f3a06 Revert DSv4 eager workspace reuse (#52836)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-18 17:02:59 -07:00
ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 a9f4afb66f [Bugfix] Fix DeepSeek V4 mHC broadcast buffer for dummy load (#51368)
Signed-off-by: Hollow Man <hollowman@opensuse.org>
2026-08-18 17:02:18 -07:00
Russell BryantandClaude Opus 4.8 ef47a897e2 [Core] Make prefix-cache NONE_HASH deterministic by default (#51875)
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-08-18 23:14:39 +00:00
Andreas KaratzasandOpenAI Codex 8f4a7f45c5 [ROCm][CI] Gating more ROCm tests (#44969)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-18 15:45:47 -07:00
Andreas KaratzasandOpenAI Codex aa6abec49a [CI][ROCm] Prevent Git maintenance races during shallow fetches (#52810)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-18 15:34:50 -07:00
Andreas Karatzas 203926c477 [ROCm][CI] Add AMD CI Pull-Request Commands (#52822)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
2026-08-18 15:16:25 -07:00
Summer Yang 5f7a20b316 [nv] add pcp support in dsv3.2 (#52046)
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
2026-08-18 14:59:08 -07:00
xuebwang-amdandClaude Opus 5 d3fafe0c27 [Quantization] Remove the dead ocp_mx_scheme branch from moe_kernel_quantize_input (#52603)
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-18 16:42:45 -05:00
stefankoncarevic 6066bb3d50 [ROCM][CI] Attention test speedup (#52763)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
2026-08-18 16:40:30 -05:00
yinfengLiuandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 5d8a4cf976 [ROCm] Pad non-aligned AITER MLA heads (#51647)
Signed-off-by: Liuyinfeng01 <yinfeliu@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-18 16:37:10 -05:00
Flora Feng 12f64b39d2 [Bugfix][Structured Output] Stop XGrammar token batches at termination (#52805)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
2026-08-18 21:21:43 +00:00
aoshen02andClaude Opus 5 7ddb50788d [Bugfix][DP] Don't assume the engines started when forwarding a wake (#51481)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-18 13:49:35 -07:00
Biswa Pandaandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 6a391a931a [Rust Frontend][RL] add routed expert prompt offset (#52703)
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-18 20:04:28 +00:00
Kevin H. LuuandOpenAI Codex 8d6b18329a [CI] Standardize test job labels by device (#52659)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-18 12:50:32 -07:00
Sage Moore 9842d70145 [DBO][CI] Increase the coverage of prefill DBO in test_dbo.py (#48628)
Signed-off-by: Sage Moore <sage@neuralmagic.com>
2026-08-18 19:00:04 +00:00
Michał GanczarenkoandWentao Ye 6948a43fbb [Bugfix] Detect all attention-spelling variants in ModelConfig.is_hybrid (#52161)
Signed-off-by: Michal Ganczarenko <michal.ganczarenko@intel.com>
Signed-off-by: Michał Ganczarenko <michal.ganczarenko@intel.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
2026-08-18 14:43:51 -04:00
Andreas KaratzasandOpenAI Codex 90984ddbed [CI] Upgrade huggingface-hub to 1.28.0 (#52797)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-18 13:35:44 -05:00
Connor CarpenterandBugen Zhao d75136c030 [Rust Frontend] Wait for all utility calls to finish (#52671)
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
2026-08-18 11:23:34 -07:00
Woosuk KwonandOpenAI Codex 01e56caaf2 [Bugfix][MLA] Do not use Dense MHA for GLM-5.2 (#52512)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-18 11:20:48 -07:00
Matvei PashkovskiiandClaude ad5e71b276 [ROCm][Perf] Enable fused KDA decode on gfx942 (MI325X) (#52293)
Signed-off-by: Matvei Pashkovskii <mpashkov@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
2026-08-18 18:01:00 +00:00
Strahinja Stamenkovicandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> ddbf826bee [ROCm] Gate Torch FP8 scaled-MM on architecture support (#51021)
Signed-off-by: sstamenk <strahinja.stamenkovic@amd.com>
Signed-off-by: Strahinja Stamenkovic <strahinja.stamenkovic@amd.com>
Signed-off-by: Strahinja Stamenkovic <sstamenk@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-18 17:54:51 +00:00
Misha GoinandOpenAI Codex bca7bea240 Remove VLLM_TEST_FORCE_FP8_MARLIN to replace with linear_backend/moe_backend (#52182)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-18 12:58:04 -04:00
fxmarty-amd 88b2bff2c6 [MOE] Standardize and abstract fused shared expert optimization selection (#51695)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
2026-08-18 12:56:56 -04:00
f9f066d195 [Bugfix][PaliGemma] Remove stale image embedding scaling (#52692)
Signed-off-by: jikuixie <jikuixie@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-18 16:00:55 +00:00