hcl
|
42e7942ac9
|
fix(config): guard LlamaBidirectionalConfig against missing hf_config.pooling (#50536)
Signed-off-by: Chenglun Hu <chenglunhu@gmail.com>
|
2026-08-27 18:56:07 +08:00 |
|
 Luciano MartinsandLuciano Martins
|
2ab187430b
|
[Bugfix] Make Gemma4 MTP suppress_tokens masking CUDA-graph-safe (#53884)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
|
2026-08-26 15:39:19 +00:00 |
|
 Oliver HolworthyandOpenAI Codex
|
28b484e5d7
|
[Model] Pixtral: use packed multimodal encoder attention (#52185)
Signed-off-by: Oliver Holworthy <1216955+oliverholworthy@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-26 14:14:40 +00:00 |
|
![mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>](/assets/img/avatar_default.png) 
|
c47ca4aaeb
|
[Mypy Fix] Mypy fix for "vllm/model_executor/models/[tT]" (#53466)
Signed-off-by: Jensen Chen <a1043904820@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-26 14:12:11 +00:00 |
|
![mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>](/assets/img/avatar_default.png)  
|
61d4f56635
|
[Offloader] Offload submodules that make_layers never reaches (#53120)
Signed-off-by: ray24777 <103923677+ray24777@users.noreply.github.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-26 18:37:00 +08:00 |
|
Hung Hoang (黄兴)
|
a5f82882a6
|
[Bugfix][Model] Honor Molmo2 dummy video num_frames >= 2 override (#53830)
Signed-off-by: hungh <hungh@nvidia.com>
|
2026-08-26 06:47:02 +00:00 |
|
linitra24
|
f6130145c8
|
[Bugfix][LoRA] Enable tower/connector LoRA for Qwen3-Omni (#53557)
Signed-off-by: linitra24 <Joy25810@foxmail.com>
|
2026-08-26 10:44:41 +08:00 |
|
Wentao Ye
|
70021a0081
|
[Mypy Fix] Mypy fix for "vllm/model_executor/models/[gG]" (#53616)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-25 09:47:16 -07:00 |
|
 Jiatai WangandOpenAI Codex
|
06ecec7a84
|
[Bugfix][MM] Fix JinaVL processing cache order (#53553)
Signed-off-by: JiataiWang <wangjiatai@proton.me>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-25 00:03:05 -07:00 |
|
  
|
48d7132962
|
[Model] Migrate FlexOlmo, Olmo3 and Hunyuan V1/VL to the Transformers modeling backend (#53615)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-08-24 22:39:05 -07:00 |
|
Karan Shelar
|
a9a17e7095
|
Dflash2 load fix (#53435)
|
2026-08-24 21:32:43 -07:00 |
|
Zupeng Wang
|
7b7e5cbfcd
|
[Bugfix][LoRA] Restore tower and connector LoRA support for LFM2-VL (#53519)
Signed-off-by: Zupeng Wang <71580390+zupengwang@users.noreply.github.com>
|
2026-08-25 01:53:04 +00:00 |
|
 kiroxuandOpenAI Codex
|
07ef21bc69
|
[Kernel][Perf] Enable fused QK-norm + partial MRoPE + gate for Qwen3.6 (#52676)
Signed-off-by: kiroxu <148877251+BabyDrangoner@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-24 18:28:49 -07:00 |
|
Nick Hill
|
09fddeb4ce
|
[Bugfix] BailingMoeV3 KDA: skip absent metadata during CUDA graph profiling (#53593)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-25 01:02:50 +00:00 |
|
 
|
7ca336929c
|
[Model] Remove ten deprecated model architectures (#53608)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-24 17:06:00 -07:00 |
|
Giancarlo Delfin
|
d154d90d6c
|
[Model Runner V2] batch-sharded sample (#50465)
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
|
2026-08-24 15:49:57 -07:00 |
|
![mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>](/assets/img/avatar_default.png) Prudhvi Vudaandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
342b8ebd8b
|
[Bugfix][Multimodal] Encode text in mixed CLIP/SigLIP pooling batches (#53165)
Signed-off-by: Prudhvivuda <prudhvi12042001@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-24 10:45:42 -07:00 |
|
 Jee Jee LiandCyrus Leung
|
4f686e182a
|
[MISC] Cleanup deprecated parameters (#53559)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-08-24 10:19:04 -07:00 |
|
Cyrus Leung
|
ecfa7bb373
|
[MM] Cache common token sequences (#53560)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-08-24 07:48:10 -07:00 |
|
Taneem Ibrahim
|
79bb395eea
|
[Pooling] Improve BGE-M3 sync pooling throughput by up to 3.13% (#53464)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-24 08:33:32 -04:00 |
|
linitra24
|
8c2bbe00d5
|
[Bugfix][LoRA] Add multimodal module mapping for Muse-Glimmer (#53513)
Signed-off-by: linitra24 <Joy25810@foxmail.com>
|
2026-08-24 05:51:43 +00:00 |
|
linitra24
|
460c08bc8a
|
[LoRA] Add Qwen3-Omni multimodal LoRA support (#52786)
Signed-off-by: linitra24 <Joy25810@foxmail.com>
|
2026-08-24 05:25:23 +00:00 |
|
![mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>](/assets/img/avatar_default.png) ThunGuoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
e8888b2d68
|
[Model] Add FP8 quantization support for ModernBERT (#53101)
Signed-off-by: thunguo <tew@apache.org>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-24 03:04:19 +00:00 |
|
danisereb
|
a7195188a4
|
Add MTP support for Nemotron VL models (#53121)
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
|
2026-08-24 00:59:56 +00:00 |
|
Wyett
|
b26039b09f
|
Add routed expert loading for gpt-oss (#52209)
Signed-off-by: Wyett <wyettzeng@gmail.com>
Signed-off-by: wyett <wyettzeng@gmail.com>
|
2026-08-23 17:59:08 +08:00 |
|
 Cyrus LeungandQwen Code
|
ebcd606467
|
[MM] Simplify prompt updates: replace PromptSeq with list[int] (#53372)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Qwen Code <noreply@alibaba-inc.com>
|
2026-08-23 14:50:32 +08:00 |
|
anmolgupt
|
a3561ef8e4
|
[Bugfix][Model] Mistral3: fix image placeholder grid for processor size overrides (#52874)
Signed-off-by: Anmol Gupta <14880251+anmolgupt@users.noreply.github.com>
|
2026-08-22 21:34:38 -07:00 |
|
Zhou248
|
2f55ef254c
|
[Model] Add Qwen3-Omni DSpark support (#52560)
Signed-off-by: Zhou248 <630563665@qq.com>
|
2026-08-22 15:35:22 -07:00 |
|
Wentao Ye
|
811d12ee26
|
[Mypy Fix] Mypy fix for "vllm/model_executor/models/[eE][fF]" (#53381)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-22 15:41:27 -04:00 |
|
Cyrus Leung
|
020829f66b
|
[MM] Remove renderer_applies_updates flag (#53385)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-08-23 01:25:55 +08:00 |
|
Cyrus Leung
|
040700aaa6
|
[MM] Address comments on #53275 (#53364)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-08-22 10:27:59 +00:00 |
|
Cyrus Leung
|
0b19ebcacd
|
[MM] Simplify _apply_hf_processor_main (#53275)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-08-22 01:49:37 -07:00 |
|
Lucas Wilkinson
|
8bdc70ec7b
|
[6/N][KV-Cache Layout Refactor] Standardize KV cache layout (#51718)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
|
2026-08-21 17:47:49 -07:00 |
|
 Kevin H. LuuandAndreas Karatzas
|
e3f6026503
|
Revert "Remove native Hunyuan V1 and VL implementations" (#53296)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-21 13:39:58 -07:00 |
|
 Tiezhen WANGandOpenAI Codex
|
d53b1c2efc
|
Remove native Hunyuan V1 and VL implementations (#53272)
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-21 09:07:10 -07:00 |
|
 
|
72aedcc426
|
[DCP] Default query replication for GLM sparse attention (#50382)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-21 09:07:05 -07:00 |
|
DCo
|
c1d7a3808d
|
[Bugfix] Fix HYV3 shared_mlp prefix for compressed-tensors ignore matching (#48682)
Signed-off-by: Xiaoyi Xu <xu_xiaoyi@hotmail.com>
|
2026-08-21 09:07:01 -07:00 |
|
linitra24
|
e85d1b69cf
|
[Bugfix][LoRA] Use an explicit capability flag for tower connector LoRA (#53092)
Signed-off-by: linitra24 <Joy25810@foxmail.com>
|
2026-08-21 09:45:54 +00:00 |
|
Zihan Zhang
|
b389ac2946
|
[Spec Decode] DFlash2: local convolution + candidate selector (#52816)
|
2026-08-20 22:27:22 -07:00 |
|
Cyrus Leung
|
b00f475f09
|
[MM] Remove text components from ProcessorInputs (#53093)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-08-20 20:42:53 -07:00 |
|
Kevin H. Luu
|
d29f7f5c92
|
[Bugfix] Load untied Gemma LM head weights (#53170)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
|
2026-08-21 00:47:08 +00:00 |
|
Harry Mellor
|
1fe3a1571a
|
Reduce AutoWeightsLoader kwargs (#53106)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-20 15:40:11 +00:00 |
|
Harry Mellor
|
2dd17225c6
|
Fix Transformers modelling backend RMSNormFuser.fuse performance (#52766)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-20 15:21:23 +00:00 |
|
 Yiqinandshenyiqin
|
cb09dd7488
|
[Core][Multimodal] Skip redundant placeholder scan when token match succeeds (#52925)
Co-authored-by: shenyiqin <shenyiqin1@huawei.com>
|
2026-08-20 15:04:29 +00:00 |
|
Zupeng Wang
|
df1376907b
|
[Model] Add tower and connector LoRA support for LFM2-VL (#51498)
Signed-off-by: zupengwang <71580390+zupengwang@users.noreply.github.com>
|
2026-08-20 20:33:43 +08:00 |
|
Harry Mellor
|
f0c14b4f77
|
Fix weight tying (#51665)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-20 10:31:55 +00:00 |
|
Harry Mellor
|
6e85feb1b7
|
[3/N] Harden Transformers modelling backend multi-modal path (#51827)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-20 10:24:41 +00:00 |
|
 rongfu.lengandIsotr0py
|
c8de519917
|
[Kernel][Kimi] fused vision q/k roper kernel (#50400)
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-08-20 09:15:47 +00:00 |
|
Juan Pérez de Algaba
|
c0a25c089a
|
[Bugfix][Security] Guard _load_ov2_processor with resolve_trust_remote_code (#52952)
Signed-off-by: jperezde <jperezde@redhat.com>
|
2026-08-20 09:09:49 +00:00 |
|
 EgorandClaude
|
e9e1630e93
|
[Model] Support bidirectional (encoder-only) attention for DeepSeek e… (#52948)
Signed-off-by: Egor <erop001@gmail.com>
Signed-off-by: Egor <47443236+Lossfull@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-19 16:36:27 +00:00 |
|