 Wyett
|
b26039b09f
|
Add routed expert loading for gpt-oss (#52209)
Signed-off-by: Wyett <wyettzeng@gmail.com>
Signed-off-by: wyett <wyettzeng@gmail.com>
|
2026-08-23 17:59:08 +08:00 |
|
|
Cyrus LeungandQwen Code
|
ebcd606467
|
[MM] Simplify prompt updates: replace PromptSeq with list[int] (#53372)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Qwen Code <noreply@alibaba-inc.com>
|
2026-08-23 14:50:32 +08:00 |
|
|
anmolgupt
|
a3561ef8e4
|
[Bugfix][Model] Mistral3: fix image placeholder grid for processor size overrides (#52874)
Signed-off-by: Anmol Gupta <14880251+anmolgupt@users.noreply.github.com>
|
2026-08-22 21:34:38 -07:00 |
|
|
Zhou248
|
2f55ef254c
|
[Model] Add Qwen3-Omni DSpark support (#52560)
Signed-off-by: Zhou248 <630563665@qq.com>
|
2026-08-22 15:35:22 -07:00 |
|
|
Wentao Ye
|
811d12ee26
|
[Mypy Fix] Mypy fix for "vllm/model_executor/models/[eE][fF]" (#53381)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-22 15:41:27 -04:00 |
|
|
Shuolei Wangandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
236f78cc5c
|
[Core][RL] Support sparse checkpoint updates through native weight loaders (#50723)
Signed-off-by: Shuolei Wang <shuoleiwang123@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-22 17:39:58 +00:00 |
|
|
Cyrus Leung
|
020829f66b
|
[MM] Remove renderer_applies_updates flag (#53385)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-08-23 01:25:55 +08:00 |
|
|
|
da329cc303
|
[Bugfix] Fix speculative decoding for short_conv (LFM2) models (#50272)
Signed-off-by: jens.luecke <jens.luecke@liquid.ai>
Co-authored-by: Tonoken3 <sakamakismile@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-22 13:34:22 +00:00 |
|
|
Cyrus Leung
|
040700aaa6
|
[MM] Address comments on #53275 (#53364)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-08-22 10:27:59 +00:00 |
|
|
Cyrus Leung
|
0b19ebcacd
|
[MM] Simplify _apply_hf_processor_main (#53275)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-08-22 01:49:37 -07:00 |
|
|
ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟
|
b2db227a7c
|
[Bugfix][R3] Unwrap UniformTypeKVCacheSpecs when selecting the routed-experts KV group (#53240)
Signed-off-by: Hollow Man <hollowman@opensuse.org>
|
2026-08-21 19:13:53 -07:00 |
|
|
stefankoncarevic
|
7f4a1b7e24
|
[Bugfix][ROCM] Fix the MXFP8 block scale exponent (#53110)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
|
2026-08-22 01:26:19 +00:00 |
|
|
Lucas Wilkinson
|
8bdc70ec7b
|
[6/N][KV-Cache Layout Refactor] Standardize KV cache layout (#51718)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
|
2026-08-21 17:47:49 -07:00 |
|
|
Kevin H. LuuandAndreas Karatzas
|
e3f6026503
|
Revert "Remove native Hunyuan V1 and VL implementations" (#53296)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-21 13:39:58 -07:00 |
|
|
vllm-agentandvllm-ci-failure-analyzer
|
ba53da60bb
|
Revert "[Bugfix][MoE] Tune FlashInfer experts to scheduler token limit" (#52989) (#53186)
Co-authored-by: vllm-ci-failure-analyzer <kevin@inferact.ai>
|
2026-08-21 12:39:28 -06:00 |
|
|
|
7a2fdbaac4
|
[K3 Perf] Fuse MXFP4 top-k finalization into latent-tail, ~5% E2E latency reduction (#53152)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-21 13:29:59 -04:00 |
|
|
Fangzhou Ai
|
fe76112ff2
|
[ROCm][Perf] Optimize DeepSeek V4 C4A top-k with AITER (#52882)
|
2026-08-21 10:00:39 -07:00 |
|
|
Tiezhen WANGandOpenAI Codex
|
d53b1c2efc
|
Remove native Hunyuan V1 and VL implementations (#53272)
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-21 09:07:10 -07:00 |
|
|
|
72aedcc426
|
[DCP] Default query replication for GLM sparse attention (#50382)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-21 09:07:05 -07:00 |
|
|
DCo
|
c1d7a3808d
|
[Bugfix] Fix HYV3 shared_mlp prefix for compressed-tensors ignore matching (#48682)
Signed-off-by: Xiaoyi Xu <xu_xiaoyi@hotmail.com>
|
2026-08-21 09:07:01 -07:00 |
|
|
ErenAta16
|
fbb17e780b
|
[Bugfix] Fix six quantization exception messages split across positional args (#50479)
Signed-off-by: ErenAta16 <erena6466@gmail.com>
|
2026-08-21 09:06:56 -07:00 |
|
|
Luke Alonsoandmgoin
|
2740c817ff
|
[Kernel] Add b12x FP4 MoE backend (#52018)
Signed-off-by: Luke Alonso <lalonso@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
|
2026-08-21 08:04:36 -07:00 |
|
|
Yan Ma
|
6feafb8b7d
|
[XPU] follow cuda path for mrope on XPU (#53201)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-08-21 10:13:27 +00:00 |
|
|
linitra24
|
e85d1b69cf
|
[Bugfix][LoRA] Use an explicit capability flag for tower connector LoRA (#53092)
Signed-off-by: linitra24 <Joy25810@foxmail.com>
|
2026-08-21 09:45:54 +00:00 |
|
|
Thanaji Rao ThakkalapelliandKunshang Ji
|
9fd750f00d
|
[XPU][INC] Add int4 w4a8 (dynamic int8 activation) backend for INC linear layers (#50501)
Signed-off-by: Thanaji Rao Thakkalapelli <thanaji.rao.thakkalapelli@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-21 14:38:59 +08:00 |
|
|
Wei ZhaoandOpenAI Codex
|
f8e0602713
|
Support kimi k3 nvfp4 checkpoint (#53132)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-21 05:59:44 +00:00 |
|
|
Zihan Zhang
|
b389ac2946
|
[Spec Decode] DFlash2: local convolution + candidate selector (#52816)
|
2026-08-20 22:27:22 -07:00 |
|
|
vhagor
|
ba07e4a48f
|
[Bugfix] Fix batch-invariant fp32 matmul OOR on SM89 for N=1 (#52960)
Signed-off-by: Juqi Li <2223621784@qq.com>
|
2026-08-21 11:46:55 +08:00 |
|
|
|
2785c72a14
|
[Kimi-K3] Extend GEMM-RS to GEMM-AR (#53053)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: wzhao18 <wzhao18.sz@gmail.com>
|
2026-08-21 03:44:15 +00:00 |
|
|
Cyrus Leung
|
b00f475f09
|
[MM] Remove text components from ProcessorInputs (#53093)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-08-20 20:42:53 -07:00 |
|
|
Kevin H. Luu
|
d29f7f5c92
|
[Bugfix] Load untied Gemma LM head weights (#53170)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
|
2026-08-21 00:47:08 +00:00 |
|
|
Misha GoinandOpenAI Codex
|
bfb6c13499
|
[Bugfix][MoE] Tune FlashInfer experts to scheduler token limit (#52989)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-20 16:26:24 -04:00 |
|
|
Harry Mellor
|
1fe3a1571a
|
Reduce AutoWeightsLoader kwargs (#53106)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-20 15:40:11 +00:00 |
|
|
Harry Mellor
|
2dd17225c6
|
Fix Transformers modelling backend RMSNormFuser.fuse performance (#52766)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-20 15:21:23 +00:00 |
|
|
Yiqinandshenyiqin
|
cb09dd7488
|
[Core][Multimodal] Skip redundant placeholder scan when token match succeeds (#52925)
Co-authored-by: shenyiqin <shenyiqin1@huawei.com>
|
2026-08-20 15:04:29 +00:00 |
|
|
SeonjinandMisha Goin
|
bd8865a299
|
[Kernel] Add FlashInfer TRTLLM MXFP8 linear backend (#52204)
Signed-off-by: seonjinn <sna@nvidia.com>
Signed-off-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-08-20 10:07:22 -04:00 |
|
|
Zupeng Wang
|
df1376907b
|
[Model] Add tower and connector LoRA support for LFM2-VL (#51498)
Signed-off-by: zupengwang <71580390+zupengwang@users.noreply.github.com>
|
2026-08-20 20:33:43 +08:00 |
|
|
Harry Mellor
|
f0c14b4f77
|
Fix weight tying (#51665)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-20 10:31:55 +00:00 |
|
|
Harry Mellor
|
6e85feb1b7
|
[3/N] Harden Transformers modelling backend multi-modal path (#51827)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-20 10:24:41 +00:00 |
|
|
pmanczak
|
44cf3f0466
|
[XPU][Tests] Make tests device-agnostic (#51968)
Signed-off-by: pmanczak <pawel.manczak@intel.com>
|
2026-08-20 02:25:41 -07:00 |
|
|
rongfu.lengandIsotr0py
|
c8de519917
|
[Kernel][Kimi] fused vision q/k roper kernel (#50400)
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-08-20 09:15:47 +00:00 |
|
|
Juan Pérez de Algaba
|
c0a25c089a
|
[Bugfix][Security] Guard _load_ov2_processor with resolve_trust_remote_code (#52952)
Signed-off-by: jperezde <jperezde@redhat.com>
|
2026-08-20 09:09:49 +00:00 |
|
|
Anton AandRoger Wang
|
14617c2b6c
|
[Bugfix] DeepEP-V2: expert_tokens_meta must be None on the decode/cudagraph path (empty recv_expert_num_tokens) (#52632)
Signed-off-by: Anton Alexander <dmvevents@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
|
2026-08-20 01:11:44 -07:00 |
|
|
Shanshan Shen
|
d626108b18
|
[ROCm][Perf] Fuse DeepSeek-V4 mHC post/pre and RMSNorm with AITER (#52737)
Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
|
2026-08-20 04:51:04 +00:00 |
|
|
Summer YangandWoosuk Kwon
|
58e5ee0158
|
[refactor] consolidate cp attn ops (#52839)
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-08-19 18:04:11 -07:00 |
|
|
Sage Moore
|
5bf0dbd6fd
|
[Bugfix] vLLM crashes at startup when DeepEP v2 is used with --enforce-eager wiht TRTLLM Bf16 (#51824)
|
2026-08-19 20:18:47 -04:00 |
|
|
Misha GoinandOpenAI Codex
|
541c6d64c1
|
[Bugfix][Quantization] Support CT block FP8 with Marlin (#52966)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-19 12:41:26 -07:00 |
|
|
Roger Wang
|
755492e37d
|
Revert "[Kernel] Gemma-4 FA4 FP8 Kernel" (#52987)
|
2026-08-19 10:48:46 -07:00 |
|
|
EgorandClaude
|
e9e1630e93
|
[Model] Support bidirectional (encoder-only) attention for DeepSeek e… (#52948)
Signed-off-by: Egor <erop001@gmail.com>
Signed-off-by: Egor <47443236+Lossfull@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-19 16:36:27 +00:00 |
|
|
|
54dd98be28
|
[CT] Support Humming for WNA16 MoE (#48918)
Signed-off-by: yiliu30 <yi4.liu@intel.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-19 12:31:32 -04:00 |
|