Commit Graph
3113 Commits
Author SHA1 Message Date
Jiatai WangandOpenAI Codex 06ecec7a84 [Bugfix][MM] Fix JinaVL processing cache order (#53553)
Signed-off-by: JiataiWang <wangjiatai@proton.me>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-25 00:03:05 -07:00
48d7132962 [Model] Migrate FlexOlmo, Olmo3 and Hunyuan V1/VL to the Transformers modeling backend (#53615)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
2026-08-24 22:39:05 -07:00
Karan Shelar a9a17e7095 Dflash2 load fix (#53435) 2026-08-24 21:32:43 -07:00
Zupeng Wang 7b7e5cbfcd [Bugfix][LoRA] Restore tower and connector LoRA support for LFM2-VL (#53519)
Signed-off-by: Zupeng Wang <71580390+zupengwang@users.noreply.github.com>
2026-08-25 01:53:04 +00:00
kiroxuandOpenAI Codex 07ef21bc69 [Kernel][Perf] Enable fused QK-norm + partial MRoPE + gate for Qwen3.6 (#52676)
Signed-off-by: kiroxu <148877251+BabyDrangoner@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-24 18:28:49 -07:00
Nick Hill 09fddeb4ce [Bugfix] BailingMoeV3 KDA: skip absent metadata during CUDA graph profiling (#53593)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
2026-08-25 01:02:50 +00:00
7ca336929c [Model] Remove ten deprecated model architectures (#53608)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-24 17:06:00 -07:00
Giancarlo Delfin d154d90d6c [Model Runner V2] batch-sharded sample (#50465)
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
2026-08-24 15:49:57 -07:00
Prudhvi Vudaandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 342b8ebd8b [Bugfix][Multimodal] Encode text in mixed CLIP/SigLIP pooling batches (#53165)
Signed-off-by: Prudhvivuda <prudhvi12042001@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-24 10:45:42 -07:00
Jee Jee LiandCyrus Leung 4f686e182a [MISC] Cleanup deprecated parameters (#53559)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
2026-08-24 10:19:04 -07:00
Cyrus Leung ecfa7bb373 [MM] Cache common token sequences (#53560)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <tlleungac@connect.ust.hk>
2026-08-24 07:48:10 -07:00
Taneem Ibrahim 79bb395eea [Pooling] Improve BGE-M3 sync pooling throughput by up to 3.13% (#53464)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
2026-08-24 08:33:32 -04:00
linitra24 8c2bbe00d5 [Bugfix][LoRA] Add multimodal module mapping for Muse-Glimmer (#53513)
Signed-off-by: linitra24 <Joy25810@foxmail.com>
2026-08-24 05:51:43 +00:00
linitra24 460c08bc8a [LoRA] Add Qwen3-Omni multimodal LoRA support (#52786)
Signed-off-by: linitra24 <Joy25810@foxmail.com>
2026-08-24 05:25:23 +00:00
ThunGuoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> e8888b2d68 [Model] Add FP8 quantization support for ModernBERT (#53101)
Signed-off-by: thunguo <tew@apache.org>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-24 03:04:19 +00:00
danisereb a7195188a4 Add MTP support for Nemotron VL models (#53121)
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
2026-08-24 00:59:56 +00:00
Wyett b26039b09f Add routed expert loading for gpt-oss (#52209)
Signed-off-by: Wyett <wyettzeng@gmail.com>
Signed-off-by: wyett <wyettzeng@gmail.com>
2026-08-23 17:59:08 +08:00
Cyrus LeungandQwen Code ebcd606467 [MM] Simplify prompt updates: replace PromptSeq with list[int] (#53372)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Qwen Code <noreply@alibaba-inc.com>
2026-08-23 14:50:32 +08:00
anmolgupt a3561ef8e4 [Bugfix][Model] Mistral3: fix image placeholder grid for processor size overrides (#52874)
Signed-off-by: Anmol Gupta <14880251+anmolgupt@users.noreply.github.com>
2026-08-22 21:34:38 -07:00
Zhou248 2f55ef254c [Model] Add Qwen3-Omni DSpark support (#52560)
Signed-off-by: Zhou248 <630563665@qq.com>
2026-08-22 15:35:22 -07:00
Wentao Ye 811d12ee26 [Mypy Fix] Mypy fix for "vllm/model_executor/models/[eE][fF]" (#53381)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
2026-08-22 15:41:27 -04:00
Cyrus Leung 020829f66b [MM] Remove renderer_applies_updates flag (#53385)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
2026-08-23 01:25:55 +08:00
Cyrus Leung 040700aaa6 [MM] Address comments on #53275 (#53364)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
2026-08-22 10:27:59 +00:00
Cyrus Leung 0b19ebcacd [MM] Simplify _apply_hf_processor_main (#53275)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
2026-08-22 01:49:37 -07:00
Lucas Wilkinson 8bdc70ec7b [6/N][KV-Cache Layout Refactor] Standardize KV cache layout (#51718)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
2026-08-21 17:47:49 -07:00
Kevin H. LuuandAndreas Karatzas e3f6026503 Revert "Remove native Hunyuan V1 and VL implementations" (#53296)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-08-21 13:39:58 -07:00
Tiezhen WANGandOpenAI Codex d53b1c2efc Remove native Hunyuan V1 and VL implementations (#53272)
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-08-21 09:07:10 -07:00
72aedcc426 [DCP] Default query replication for GLM sparse attention (#50382)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-21 09:07:05 -07:00
DCo c1d7a3808d [Bugfix] Fix HYV3 shared_mlp prefix for compressed-tensors ignore matching (#48682)
Signed-off-by: Xiaoyi Xu <xu_xiaoyi@hotmail.com>
2026-08-21 09:07:01 -07:00
linitra24 e85d1b69cf [Bugfix][LoRA] Use an explicit capability flag for tower connector LoRA (#53092)
Signed-off-by: linitra24 <Joy25810@foxmail.com>
2026-08-21 09:45:54 +00:00
Zihan Zhang b389ac2946 [Spec Decode] DFlash2: local convolution + candidate selector (#52816) 2026-08-20 22:27:22 -07:00
Cyrus Leung b00f475f09 [MM] Remove text components from ProcessorInputs (#53093)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
2026-08-20 20:42:53 -07:00
Kevin H. Luu d29f7f5c92 [Bugfix] Load untied Gemma LM head weights (#53170)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
2026-08-21 00:47:08 +00:00
Harry Mellor 1fe3a1571a Reduce AutoWeightsLoader kwargs (#53106)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-20 15:40:11 +00:00
Harry Mellor 2dd17225c6 Fix Transformers modelling backend RMSNormFuser.fuse performance (#52766)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-20 15:21:23 +00:00
Yiqinandshenyiqin cb09dd7488 [Core][Multimodal] Skip redundant placeholder scan when token match succeeds (#52925)
Co-authored-by: shenyiqin <shenyiqin1@huawei.com>
2026-08-20 15:04:29 +00:00
Zupeng Wang df1376907b [Model] Add tower and connector LoRA support for LFM2-VL (#51498)
Signed-off-by: zupengwang <71580390+zupengwang@users.noreply.github.com>
2026-08-20 20:33:43 +08:00
Harry Mellor f0c14b4f77 Fix weight tying (#51665)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-20 10:31:55 +00:00
Harry Mellor 6e85feb1b7 [3/N] Harden Transformers modelling backend multi-modal path (#51827)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-20 10:24:41 +00:00
rongfu.lengandIsotr0py c8de519917 [Kernel][Kimi] fused vision q/k roper kernel (#50400)
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
2026-08-20 09:15:47 +00:00
Juan Pérez de Algaba c0a25c089a [Bugfix][Security] Guard _load_ov2_processor with resolve_trust_remote_code (#52952)
Signed-off-by: jperezde <jperezde@redhat.com>
2026-08-20 09:09:49 +00:00
EgorandClaude e9e1630e93 [Model] Support bidirectional (encoder-only) attention for DeepSeek e… (#52948)
Signed-off-by: Egor <erop001@gmail.com>
Signed-off-by: Egor <47443236+Lossfull@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
2026-08-19 16:36:27 +00:00
Nave Assaf 58de6cbdc2 Add NemotronH_Omni_Reasoning_V3 as a supported Nemotron architecture (#52929)
Signed-off-by: Nave Assaf <nassaf@nvidia.com>
2026-08-19 12:34:50 +00:00
hy123andOpenAI Codex b160cab156 [Bugfix] Restore model info caching for package backends (#52690)
Signed-off-by: haoyang.qian <haoyangqian@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-19 11:18:10 +00:00
wangxiyuan cba06764d7 [Platform] Fill in the missing backend parameter for torch.compile (#51781)
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
2026-08-19 10:31:19 +00:00
Woosuk Kwon b09bd69b5b [Model][NVIDIA] Route DSA models to the CUDA non-compiled path (#52861) 2026-08-19 00:13:52 -07:00
Nick Hill ee11730751 [BugFix] Revert incorrect MM keep_on_cpu=True changes (#52881)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
2026-08-19 07:07:40 +00:00
5a4c8d9924 [Bugfix][LoRA] Add embedding_modules for Qwen3.5 CausalLM (#48850)
Signed-off-by: m0_68169237 <m0_68169237@noreply.gitcode.com>
Co-authored-by: m0_68169237 <m0_68169237@noreply.gitcode.com>
Co-authored-by: Cursor Composer <composer@cursor.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
2026-08-19 04:55:20 +00:00
3130573630 [Model] Add GraniteSWA and GraniteMoeSWA via existing Granite (#52706)
Signed-off-by: Davis Wertheimer <davis.wertheimer@ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-18 20:32:46 -07:00
Nick Hill deeeae75d0 [MM] Keep more metadata tensors on CPU (#52827)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
2026-08-18 19:56:33 -07:00