32e657e689
[BugFix] eagle draft max position embeddings ( #49343 )
...
Signed-off-by: JaredforReal <w13431838023@gmail.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk >
2026-07-29 01:24:47 -07:00
Perkz Zheng and Perkz Zheng
ad5d29db70
[Model] Support Qwen3.5 text-only dense and MoE models ( #50210 )
...
Signed-off-by: Perkz Zheng <PerkzZheng@users.noreply.github.com >
Co-authored-by: Perkz Zheng <PerkzZheng@users.noreply.github.com >
2026-07-29 08:21:57 +00:00
Bugen Zhao
f5a7cce9b6
[Model] Add Kimi K3 support: Python frontend [2/2] ( #50093 )
...
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
2026-07-29 01:06:01 -07:00
Seiji Eicher
6370e53f24
[Frontend] Reuse prefill token ids on the decode chat path for disaggregated serving ( #48145 )
...
Signed-off-by: Seiji Eicher <seiji@anyscale.com >
2026-07-29 10:02:57 +02:00
65a1a16594
[CPU] Fix FP8 attention scratchpad sizing ( #50194 )
...
Signed-off-by: Li, Tianmu <tianmu.li@intel.com >
Co-authored-by: Codex <noreply@openai.com >
Co-authored-by: Li, Jiang <jiang1.li@intel.com >
2026-07-29 15:34:37 +08:00
Kevin H. Luu
100d655a23
[CI] Allow PR comment acknowledgements ( #50211 )
...
Signed-off-by: khluu <khluu000@gmail.com >
2026-07-28 23:53:56 -07:00
7de49bab7e
[XPU][UT][CI] add xpu config to run gpt-oss accuracy in ut and ci ( #48703 )
...
Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com >
Signed-off-by: zofia <110436990+zufangzhu@users.noreply.github.com >
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-07-29 14:16:16 +08:00
+12
7c6729b769
[Model] Add Kimi K3 support: model files and kernels [1/N] ( #50089 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com >
Co-authored-by: Isotr0py <Isotr0py@outlook.com >
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg >
Co-authored-by: Bugen Zhao <i@bugenzhao.com >
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com >
Co-authored-by: Ziming Huang <zelda.huanghuang@gmail.com >
Co-authored-by: Roger Wang <hey@rogerw.io >
Co-authored-by: Isotr0py <mozf@inferact.ai >
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com >
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai >
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai >
Co-authored-by: aoshen02 <aoshen@inferact.ai >
Co-authored-by: Summer Yang <girasoleyang@gmail.com >
Co-authored-by: Kevin H. Luu <khluu000@gmail.com >
Co-authored-by: Bowen Wang <abmfy@icloud.com >
Co-authored-by: gnovack <novackgm@gmail.com >
Co-authored-by: Nick Hill <nickhill123@gmail.com >
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai >
Co-authored-by: xiaozhoupy <peiyuanzhou1994@gmail.com >
Co-authored-by: Roy Wang <yasong.wang@inferact.ai >
Co-authored-by: Jeff (Junze) Ma <93145857+majunze2001@users.noreply.github.com >
Co-authored-by: Codex <codex@openai.com >
2026-07-29 14:10:58 +08:00
6f00a1ae3b
fused_moe: add VLLM_TRITON_USE_TD tensor-descriptor path ( #42436 )
...
Signed-off-by: Artur Fierka <artur.fierka@intel.com >
Signed-off-by: Lena Onyshchenko <162571002+oonyshch@users.noreply.github.com >
Co-authored-by: Claude <noreply@anthropic.com >
Co-authored-by: Lena Onyshchenko <162571002+oonyshch@users.noreply.github.com >
2026-07-29 13:15:10 +08:00
Jared Wen and Isotr0py
6f91edf96d
[Test] dynamic_shapes_compilation ( #49974 )
...
Signed-off-by: JaredforReal <w13431838023@gmail.com >
Co-authored-by: Isotr0py <Isotr0py@outlook.com >
2026-07-29 04:54:57 +00:00
Rehan Khan and Li, Jiang <jiang1.li@intel.com>
db7a79cbf7
[CPU] Fix s390x builds and update torch version in dockerfile ( #50144 )
...
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com >
Co-authored-by: Li, Jiang <jiang1.li@intel.com >
2026-07-29 12:52:17 +08:00
Philip Pesic
dc1be79031
Add CachePolicyFactory for pluggable/external eviction policies ( #49114 )
...
Signed-off-by: Philip Pesic <philippesic06@gmail.com >
2026-07-29 07:34:55 +03:00
Andreas Karatzas
0bb548b60e
[CI][ROCm] Stabilize Qwen2-VL LoRA test ( #50161 )
...
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com >
Signed-off-by: Andreas Karatzas <akaratza@amd.com >
2026-07-29 04:27:45 +00:00
Zach Zhu
58f9659397
[Frontend][Core] Standardize request error handling with VLLMError hierarchy ( #49665 )
...
Signed-off-by: Zach Zhu <zzqshu@126.com >
2026-07-29 04:20:40 +00:00
Nick Hill and Jared Wen
f37f03db4a
[KV Connector] Support NIXL P/D for hybrid MLA+SSM models ( #49762 )
...
Signed-off-by: Nick Hill <nickhill123@gmail.com >
Co-authored-by: Jared Wen <w13431838023@gmail.com >
2026-07-29 11:50:30 +08:00
32a423ac0a
Integrate CuTeDSL MoE for ReLU2 NVFP4 ( #49580 )
...
Co-authored-by: OpenAI Codex <codex@openai.com >
Co-authored-by: Michael Goin <mgoin64@gmail.com >
2026-07-28 19:46:38 -07:00
30c2718eaa
[CompressedTensors] FP4 Qutlass Integration ( #43229 )
...
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com >
Signed-off-by: Brian Dellabetta <bdellabe@redhat.com >
Signed-off-by: Brian Dellabetta <brian-dellabetta@users.noreply.github.com >
Co-authored-by: Brian Dellabetta <bdellabe@redhat.com >
Co-authored-by: Brian Dellabetta <brian-dellabetta@users.noreply.github.com >
Co-authored-by: Dipika Sikka <dipikasikka1@gmail.com >
2026-07-28 20:34:20 -06:00
Andreas Karatzas
7398a30d79
[ROCm][CI] Stabilize ngram and suffix correctness test ( #50190 )
...
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com >
2026-07-28 20:29:00 -06:00
17a74b745b
[Model] Add Inkling compressed-tensors dynamic FP8 support ( #48876 )
...
Signed-off-by: mgoin <mgoin64@gmail.com >
Co-authored-by: mgoin <mgoin64@gmail.com >
Co-authored-by: OpenAI Codex <noreply@openai.com >
2026-07-28 19:27:01 -07:00
Kevin H. Luu
54ab69b14e
[CI] Allow comment-triggered builds past pipeline filters ( #50197 )
...
Signed-off-by: khluu <khluu000@gmail.com >
2026-07-28 19:11:04 -07:00
Kevin H. Luu and OpenAI Codex
7f4c52f2ba
[CI] Add comment-based Buildkite triggers ( #50132 )
...
Signed-off-by: khluu <khluu000@gmail.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-07-28 18:41:48 -07:00
Nick Hill and Jeff Ma
6fbbcf2151
[BugFix] Stop dummy runs from writing mamba state through stale block-table rows ( #49757 )
...
Signed-off-by: Nick Hill <nickhill123@gmail.com >
Signed-off-by: Jeff Ma <jeffjma@umich.edu >
Co-authored-by: Jeff Ma <jeffjma@umich.edu >
2026-07-29 01:09:41 +00:00
Kevin Glynn
56f31af62a
[Bugfix] Fix /wake_up crash on hybrid models (Mamba/DeltaNet) ( #41602 )
...
Signed-off-by: Kevin Glynn <kevglynn@gmail.com >
2026-07-29 00:17:35 +00:00
Divakar Verma
fe65aa6a97
[CI][NIXL] Fix flaky DP+EP test port conflict ( #50171 )
...
Signed-off-by: Divakar Verma <divakar.verma@amd.com >
2026-07-29 00:12:50 +00:00
Andreas Karatzas
176256b962
[ROCm][CI] Stabilize ROCm audio streaming test ( #50163 )
...
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com >
2026-07-29 07:58:10 +08:00
fxmarty-amd
5369f7b7b8
[MXFP8][ROCm] Fix MXFP8 MoE backend selection ( #49747 )
...
Signed-off-by: Felix Marty <Felix.Marty@amd.com >
2026-07-29 07:57:20 +08:00
liuzhenwei
e7f6a39db8
[Test] Make EPD correctness tests configurable for XPU ( #50110 )
...
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com >
2026-07-29 07:47:48 +08:00
Ruinan Ma and Nick Hill
a07fac758f
[Perf] Zero-copy torch.Tensor pickling in shm_broadcast MessageQueue ( #48442 )
...
Signed-off-by: Ruinan Ma <r7ma3088@gmail.com >
Signed-off-by: Nick Hill <nickhill123@gmail.com >
Co-authored-by: Nick Hill <nickhill123@gmail.com >
2026-07-28 16:28:28 -07:00
Julien Debache
bb3b61f2fd
perf: dispatch non-grouped bias-less topk routing methods to fused path ( #49618 )
...
Signed-off-by: jdebache <jdebache@nvidia.com >
2026-07-28 14:57:22 -07:00
Bugen Zhao
2899dca843
[Model] Add Kimi K3 support: Rust frontend [1/2] ( #50104 )
...
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
2026-07-28 14:31:13 -07:00
Siddhant Bharti and Claude Fable 5
0b6aa3c47c
[Bugfix][Spec Decode] Size DFlash query buffers for cudagraph-padded batches ( #50065 )
...
Signed-off-by: siddhant-bharti <sbharti@together.ai >
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
2026-07-28 19:34:22 +00:00
Bugen Zhao
d552a68645
[Rust Frontend] Extract shared tracing setup logic into vllm-tracing ( #50129 )
...
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
2026-07-28 19:31:15 +00:00
johnnyychiu
118bcde449
[BugFix] Fix clang spinloop mwaitx include ( #45532 )
...
Signed-off-by: johnny <johnnyychiu@gmail.com >
2026-07-28 19:00:06 +00:00
Shanshan Shen
6c7e679f04
[ROCm][Bugfix] Sanitize AITER paged-MQA logits before sparse top-k for DeepSeek-V4 ( #49714 )
...
Signed-off-by: shen-shanshan <467638484@qq.com >
2026-07-28 11:08:50 -07:00
labAxiaoming
1db989bbf1
[Bugfix][Multimodal] Fix video temporal padding estimates ( #49030 )
...
Signed-off-by: xiaoming <1259730330@qq.com >
2026-07-29 01:57:31 +08:00
Brian Dellabetta
8a7b3c2990
[compressed-tensors] update find_matched_target order to prioritize fused name matches over class match ( #49483 )
...
Signed-off-by: Brian Dellabetta <bdellabe@redhat.com >
2026-07-28 17:03:08 +00:00
Andreas Karatzas
05a0814863
[ROCm] Fix and optimize GPT-J-style MRoPE ( #49906 )
...
Signed-off-by: Andreas Karatzas <akaratza@amd.com >
2026-07-28 10:50:10 -06:00
jiacao-amd and TJian
4f56321d7e
[ROCm] Cache fp32 upcast of static e8m0 weight scale in AITER scaled_mm ( #47773 )
...
Signed-off-by: jiacao-amd <jiahui.cao@amd.com >
Co-authored-by: TJian <tunjian.tan@embeddedllm.com >
2026-07-28 11:34:16 -05:00
Bugen Zhao
01661cc57f
[Rust][Benchmark] Make vllm bench serve Rust delegation opt-in ( #50081 )
...
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
2026-07-28 16:21:12 +00:00
Yiliu Dong and OpenAI Codex
ba702e978e
[Attention] Skip sparse indexer scoring for dense short prefills ( #48407 )
...
Signed-off-by: Yiliu Dong <91178480+qianlihuang@users.noreply.github.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-07-28 16:17:22 +00:00
Nick Hill and Andreas Karatzas
6453fc0b8c
[Bugfix] Don't reuse engine core payload buffer while zmq is sending it ( #50053 )
...
Signed-off-by: Nick Hill <nickhill123@gmail.com >
Co-authored-by: Andreas Karatzas <akaratza@amd.com >
2026-07-28 16:09:28 +00:00
4fb483ca86
[Docs] Expand llm-d integration page ( #45432 )
...
Signed-off-by: ibrahimibrahim <ibib2595@gmail.com >
Co-authored-by: ibrahimibrahim <ibib2595@gmail.com >
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com >
2026-07-28 15:47:56 +00:00
30217b0e80
[Bugfix][KV Offload][P2P] Scope serve state to fetch rounds ( #49877 )
...
Signed-off-by: Itay Etelis <itay.etelis@ibm.com >
Co-authored-by: Itay Etelis <itay.etelis@ibm.com >
Co-authored-by: Itay Etelis <Itay.etelis@gmail.com >
2026-07-28 18:01:55 +03:00
Nick Hill
0d0504b54c
[Core] Warm up runner-owned Triton kernels before the first request ( #49903 )
2026-07-28 07:58:02 -07:00
Jonguk Cheong and OpenAI Codex
1e81853afc
[Bugfix][KV Offload] Keep Mamba block span unscaled under DCP ( #49964 )
...
Signed-off-by: Jonguk Cheong <jdal3031@snu.ac.kr >
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-07-28 17:41:55 +03:00
b6cbba8bc8
[Bugfix][Kernel] Fix batch invariance in RMSNorm kernels by pinning block size ( #48391 )
...
Signed-off-by: oops-oom <73481342@qq.com >
Signed-off-by: oops-oom <liubin8905@vip.qq.com >
Co-authored-by: oops-oom <73481342@qq.com >
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com >
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com >
Co-authored-by: Shengqi Chen <harry-chen@outlook.com >
2026-07-28 22:24:02 +08:00
Nick Hill and Claude Opus 4.8
94100b5915
[CI] Wire untethered test files into CI jobs ( #49340 )
...
Signed-off-by: Nick Hill <nickhill123@gmail.com >
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com >
2026-07-28 14:02:31 +00:00
Harry Mellor
62d8db7c05
[Bugfix] Add missing vllm/models/kimi_k3/__init__.py ( #50131 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-07-28 13:47:04 +00:00
Nick Hill and Claude Fable 5
601fa9a74e
[KV Connector] Support NIXL heterogeneous P/D block sizes for hybrid models ( #49612 )
...
Signed-off-by: Nick Hill <nickhill123@gmail.com >
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
2026-07-28 06:45:02 -07:00
9b9fc4039c
add epilogue hook to flex attention ( #45841 )
...
Signed-off-by: Angel Li <liangel@meta.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com >
Co-authored-by: Michael Goin <mgoin64@gmail.com >
2026-07-28 06:26:55 -07:00
