Commit Graph
20845 Commits
Author SHA1 Message Date
stefankoncarevic 11c3fa4adc [Bugfix][ROCm][CI] Give the AITER MLA decode metadata stub its MLA dims (#52139)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
2026-08-13 13:35:00 -05:00
fxmarty-amdAndreas Karatzasmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
c5b7c069a4 [ROCm] Defer tilelang import through its import from vllm.tilelang_utils import tilelang and relaxed has_tilelang (#51159)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-13 13:12:40 -05:00
yzong-rh e6b2a8ad5e [Bugfix][Structured Output] Mask request stop tokens in xgrammar until grammar terminates (#50595)
Signed-off-by: Yifan Zong <yzong@redhat.com>
2026-08-13 14:07:59 -04:00
fxmarty-amd 48825acc23 [Quantization] Remove dead QuantizationConfig.is_mxfp4_quant (#51793)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
2026-08-13 13:58:31 -04:00
Andreas Karatzas b96bcd0b47 [ROCm][CI] Solidify entrypoint LLM lifecycle (#51280)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
2026-08-13 12:24:02 -05:00
Cyrus Leung 69d4c3a06b Auto-ping Cohere on related issues (#52091)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
2026-08-13 16:40:38 +00:00
Nick Iusiumbeli 83d4c6196a [Bugfix] Declare SupportsEagle3 on KimiLinearForCausalLM (#52171)
Signed-off-by: Nick Iusiumbeli <nickuspro@gmail.com>
2026-08-13 16:22:50 +00:00
Harry Mellor b245d8e73f Apply logit softcapping in Transformers modelling backend (#52173)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-13 16:21:55 +00:00
Thien Tran 6014f9e672 [Kimi-K3] Add GEMM-RS for sequence parallelism (#52079)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
2026-08-13 09:02:28 -07:00
Qiming Zhang 96acd473a7 [Bugfix][MiniCPM-V] Fix AssertionError in get_dummy_mm_data when passing VideoDummyOptions to _get_dummy_images (#52122)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
2026-08-13 15:44:03 +00:00
Ali JaseemandClaude 64ca614fe4 [Bugfix] Fix --data-parallel-start-rank 0 being treated as unset in create_engine_config (#47692)
Signed-off-by: Syed Ali Jaseem <syedali0057@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
2026-08-13 15:12:26 +00:00
Harry MellorandClaude Opus 5 80d6d557f3 Standardise weight tying on ParallelLMHead.tie_weights (#52147)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-13 15:10:09 +00:00
aoshen02OpenAI Codexmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
7553aac77b [Frontend] Add routed-experts prompt offset (#51906)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-13 08:09:00 -07:00
vllmellm f3c1638927 [ROCm] Enable V2 model runner for Kimi-K3 on ROCm (#51653)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
2026-08-13 14:34:53 +00:00
Michael Goin 2d24355eb8 [Bugfix] Fix packed GDN decode launch for large batch-head grids (#52030)
Signed-off-by: mgoin <mgoin64@gmail.com>
2026-08-13 07:19:08 -07:00
范裕达 170592a931 [Bugfix] Disable sequence parallelism for Dots3 NOTE (#52172)
Signed-off-by: KurodaKanbei <mistergalahad@gmail.com>
2026-08-13 22:13:00 +08:00
95c9144424 [LoRA][Gemma4] Support vision tower LoRA (#42662)
Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: linitra24 <Joy25810@foxmail.com>
Signed-off-by: linitra24 <joy25810@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: linitra24 <joy25810@gmail.com>
2026-08-13 22:07:43 +08:00
zexplorerhj 8e1131e1d1 [Model] [Quantization] Add Ling hybrid MXFP4 routed experts support (#52114)
Signed-off-by: zexplorerhj <zhjoneson@163.com>
2026-08-13 21:46:53 +08:00
yang rui 152c913a63 [Frontend] Log output token IDs at DEBUG level (#52098)
Signed-off-by: ruirui6946 <142162413+ruirui6946@users.noreply.github.com>
2026-08-13 13:11:51 +00:00
Vineeta TiwariandVineeta Tiwari 015660da91 [Misc] Add missing return type annotations in outputs.py (#52145)
Signed-off-by: Vineeta Tiwari <vineeta.tiwari2@ibm.com>
Co-authored-by: Vineeta Tiwari <vineeta.tiwari2@ibm.com>
2026-08-13 12:58:45 +00:00
pmanczak c4e969294e [XPU] Add tuned Mamba SSU configs for Intel Arc Pro B70 (#50534)
Signed-off-by: pmanczak <pawel.manczak@intel.com>
2026-08-13 12:36:55 +00:00
Taneem Ibrahim d0ae25e2f2 [Bugfix] Preserve Anthropic disable_parallel_tool_use (#52021)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
2026-08-13 08:25:55 -04:00
JasonCohere 5fee0a872d chore: Upstream Cohere parser fixes + tests (#51998)
Signed-off-by: Jason Ozuzu <jasonozuzu@cohere.com>
2026-08-13 05:05:36 -07:00
QWERQWERQWE86 443fa5aca0 [Doc] Fix stale rejection_sample_method and synthetic_acceptance_rate (#51611)
Signed-off-by: qwerqwerqwe8688-jpg <xuuuuu2021@163.com>
2026-08-13 10:56:27 +00:00
Juan Pérez de Algaba 37c3bdf5a7 fix(security): enforce audio decode duration limit in NanoNemotronVL (#50221)
Signed-off-by: jperezde <jperezde@redhat.com>
2026-08-13 03:31:55 -07:00
Thomas Ortner b8baa31a28 Hardware-agnostic model definition via HF transformer backend (1/N) (#49458)
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
2026-08-13 11:21:50 +01:00
Harry Mellor 903da602f3 [Docs] Fix WhisperEncoderLayer.forward docstring in dots3_note (#52134)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-13 02:32:14 -07:00
Li, Jiang 1c3633acaf [CI/Build][CPU] Shrink triton-cpu-build layer by dropping build artifacts (#52127)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
2026-08-13 17:17:00 +08:00
kliuae f96261637c [ROCm][Perf] Kimi-K3 Remove prefill pipeline stall in chunk KDA (#51862)
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
2026-08-13 09:11:45 +00:00
50ba4bc6b2 [Feature] Mask Replay (#49577)
Signed-off-by: vx120 <893600387@qq.com>
Signed-off-by: vx120 <57470515+vx120@users.noreply.github.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-13 08:44:31 +00:00
Cyrus Leung 10bcad2523 Update CODEOWNERS (#52123)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
2026-08-13 08:43:07 +00:00
hotTeaandHMCCMH 7bbbf7c8e5 [Core] Configure custom encoder cache managers from VllmConfig (#51251)
Signed-off-by: hotTea <958436561@qq.com>
Signed-off-by: HMCCMH <chenminghaoscu@163.com>
Co-authored-by: HMCCMH <chenminghaoscu@163.com>
2026-08-13 16:08:01 +08:00
399f97424e [Bugfix][R3] Size monolithic routing replay buffer for DP (#50874)
Signed-off-by: tbarnatan <tbarnatan@nvidia.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
2026-08-13 00:18:08 -07:00
Li, Jiang 373592ef57 [CPU] Ship triton-cpu wheel and fix several hardcoded pin_memory=True (#52092)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
2026-08-13 14:40:53 +08:00
kiroxuandCodex 89c8401c8a [Model] Skip unused Jina V5 output layers (#52037)
Signed-off-by: kiroxu <148877251+BabyDrangoner@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
2026-08-13 06:14:37 +00:00
Frank 7bc1660bd6 [Misc] Use VLLMValidationError in pooling input validation (#51931)
Signed-off-by: frank-suwen <suwenw2@outlook.com>
2026-08-13 06:13:25 +00:00
Yangyi GaoClaude Fable 5高杨懿OpenAI CodexOpenAI Codexmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
b908a21f9a [Model][LoRA] Add tower/connector LoRA support for Ultravox (#48215)
Signed-off-by: arthurgao2003 <arthurgao2003@gmail.com>
Signed-off-by: Arthur Gao <arthurgao2003@gmail.com>
Signed-off-by: 高杨懿 <15312196+gao-yangyi@user.noreply.gitee.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: 高杨懿 <15312196+gao-yangyi@user.noreply.gitee.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-12 22:57:59 -07:00
ovidiusm 5658391af7 Remove NIXL reinstall step (#51882)
Signed-off-by: Ovidiu Mara <ovidium@nvidia.com>
2026-08-12 22:44:05 -07:00
Yongye ZhuClaude Opus 5mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
903d2efe7e [Attention][MLA] Fuse Kimi-K3 chunked-context K/V packing (#51772)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-12 22:42:57 -07:00
Yan MaandKunshang Ji 63344913a6 [XPU] update UMD to 26.27 (#50513)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
2026-08-13 13:15:25 +08:00
Simon DanielssonandAndreas Karatzas 3d204dfdaa Revert "[Perf][ROCm] Dual-stream decode with hipgraphs" (#52024)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-08-13 04:38:34 +00:00
kx 2ac1f683f1 [BugFix] Reserve the bonus query slot in DFlash scheduling budget (#51256)
Signed-off-by: HF-001 <1670186653@qq.com>
2026-08-13 03:50:23 +00:00
Lucas WilkinsonandOpenAI Codex 79f3183f86 [Bugfix] Bound KV block zeroing launch geometry (#52058)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-13 03:42:26 +00:00
Nick Hill f9538af28c [Core] Clearer comments in BlockPool.free_blocks() (#52076)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
2026-08-12 20:36:08 -07:00
Wentao Ye 9a276d6375 [Mypy Fix] Mypy fix for "vllm/model_executor/models/[cC][dD]" (#52003) 2026-08-13 11:33:55 +08:00
Ziqi Fan 15227b934a [Bugfix][KV Offload] Emit self-describing CPU events at KV-group block granularity (#51614)
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
2026-08-12 20:28:15 -07:00
Ziqi Fan f9a0f629bd [KV Offload] Expose data-parallel topology to offloading backends (#51879)
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
2026-08-12 20:27:26 -07:00
Julien Debache 6e502b62cb fix and test EPLB balancedness calculation (#51813)
Signed-off-by: jdebache <jdebache@nvidia.com>
2026-08-12 20:27:22 -07:00
61826c1c6f [Hardware][Power] Unqualized MoE Backend for Power (VSX) (#51624)
Signed-off-by: Akash kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Antigravity <antigravity@google.com>
2026-08-13 10:56:09 +08:00
Kevin H. LuuandOpenAI Codex 8eb35c5217 [CI] Mirror external test assets in vLLM S3 (#52064)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-08-13 02:08:59 +00:00