music-dino and Harry Mellor
a231c5ceac
[Bugfix] Skip fetching revision for model when model and weights_model are different ( #51260 )
...
Signed-off-by: Dino Music <Dino.Music@amd.com >
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-08-07 12:55:50 +00:00
Xiaochang Wu and Kunshang Ji
d5aae2b464
Fix ROCm architecture import on non-ROCm platforms ( #51357 )
...
Signed-off-by: Wu, Xiaochang <xiaochang.wu@intel.com >
Signed-off-by: Xiaochang Wu <xiaochang.wu@intel.com >
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com >
2026-08-07 05:32:56 -07:00
Julien Debache
ae934ba8a5
feat: extended EPLB support for Mistral Large 3 and additional MoE backends ( #48355 )
...
Signed-off-by: jdebache <jdebache@nvidia.com >
2026-08-07 05:32:52 -07:00
Yan Ma
8d9b52f7c2
[XPU] quick fix online quantization UT break ( #51365 )
...
Signed-off-by: Yan Ma <yan.ma@intel.com >
2026-08-07 10:25:31 +00:00
pmanczak and pmanczak
6b5bec7bed
[Misc] Add and enable Triton kernel unit tests on XPU ( #45694 )
...
Signed-off-by: pmanczak <pmanczak@users.noreply.github.com >
Signed-off-by: pmanczak <pawel.manczak@intel.com >
Co-authored-by: pmanczak <pmanczak@users.noreply.github.com >
2026-08-07 02:53:03 -07:00
Nicolò Lucchesi
5ec47f3e48
[PD][PushConnector] Record last activity of remotes to allow clean up of stale ones ( #50234 )
...
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai >
2026-08-07 09:43:29 +00:00
Sebastian Woo and Claude
4f76c8ad9d
[Bugfix][Platform] Stop re-initializing NVML on every device-capability check ( fixes #50381 ) ( #50393 )
...
Signed-off-by: seewoo <seewoo@ucsc.edu >
Co-authored-by: Claude <noreply@anthropic.com >
2026-08-07 08:30:00 +00:00
Hank_ and Cyrus Leung
b8db7f4abd
[Bugfix][Quantization] Fix dynamic INT8 W8A8 MoE config being built as W8A16 ( #50833 )
...
Signed-off-by: Hank <hcc.mayday@gmail.com >
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk >
2026-08-07 01:21:13 -07:00
Wentao Ye
c84789c40b
[Refactor] Remove kernel dead code ( #51051 )
...
Signed-off-by: yewentao256 <zhyanwentao@126.com >
2026-08-07 01:20:19 -07:00
da788334bc
Support DeepSeek-V4 AMD Quark NVFP4 with emulation kernel ( #47972 )
...
Signed-off-by: Jimmy Adams <Adam_ji@outlook.com >
Signed-off-by: Andreas Karatzas <akaratza@amd.com >
Signed-off-by: huji <huidong.ji@amd.com >
Signed-off-by: jimmy-adams <41593649+jimmy-adams@users.noreply.github.com >
Co-authored-by: Andreas Karatzas <akaratza@amd.com >
Co-authored-by: huji <huidong.ji@amd.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-08-07 01:19:31 -07:00
0de0362ea1
[ROCm][CI] Loosen block-FP8 fused MoE test tolerance for large-K shapes ( #48847 )
...
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com >
Signed-off-by: Andreas Karatzas <akaratza@amd.com >
Co-authored-by: Andreas Karatzas <akaratza@amd.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-07 01:19:26 -07:00
Guanyi Chen and Claude
58fcaa0baa
[Feat][Core] Add disk offloading support to SimpleCPUOffloadConnector ( #49644 )
...
Signed-off-by: Guanyi Chen <939416532@qq.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-08-07 15:37:47 +08:00
Aaron Hao and Claude Opus 5
21ea5b4fa1
[rl] Stateful Trainer Send: NCCL + Sparse NCCL [3/N] ( #50902 )
...
Signed-off-by: haoaaron <ahao@anyscale.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-08-07 00:35:59 -07:00
kliuae
43d691ec6b
[ROCm][Perf] Kimi-K3 Shard Latent MoE up-projection for ROCm path ( #51253 )
...
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com >
2026-08-07 06:11:18 +00:00
Chaojun Zhang
b706fd1628
[CI][XPU] Work around intermittent segfault in Intel XPU CI with VLLM_DISABLE_COMPILE_CACHE=1 ( #51337 )
...
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com >
2026-08-07 05:18:25 +00:00
Qianxu Wang and qianxu
c810e5ee99
[Bugfix] Fix Mamba all-mode CPU offload boundary alignment ( #51100 )
...
Signed-off-by: qianxu <admin@picasso-lab.com >
Co-authored-by: qianxu <admin@picasso-lab.com >
2026-08-07 07:37:48 +03:00
Tianyu Guo
dd856e48bb
[Bugfix][EPD][Model Runner V2] Skip gather mm embeddings for encoder only instance ( #51222 )
...
Signed-off-by: Tianyu Guo <guoty@inferact.ai >
2026-08-06 20:40:47 -07:00
Chauncey and Nick Hill
72c0d67657
[Feat] Support thinking_token_budget in Model Runner V2 ( #46727 )
...
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com >
Signed-off-by: Nick Hill <nickhill123@gmail.com >
Co-authored-by: Nick Hill <nickhill123@gmail.com >
2026-08-07 03:36:18 +00:00
Artem Perevedentsev
5ac2684976
[CI] Re-enable FI autotune in GSM8K config for Qwen3.5-35B-A3B ( #51293 )
...
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com >
2026-08-07 02:42:34 +00:00
Kunshang Ji
0406ba22c4
fix pre-commit broken ( #51341 )
...
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com >
2026-08-06 18:17:39 -07:00
e08111211b
[Kernel] Support Nvfp4 Cutedsl Moe Swiglu-oai and Relu2(non-gated) Activation ( #47106 )
...
Signed-off-by: Tiekai Bi <tiekaib@nvidia.com >
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com >
2026-08-06 17:42:45 -07:00
Nick Hill
b1e12d142d
[V1] Copy NaN-in-logits counts to host asynchronously ( #51304 )
...
Signed-off-by: Nick Hill <nickhill123@gmail.com >
2026-08-07 00:05:03 +00:00
Nicolò Lucchesi
d35eb6c440
[CI] Exclude KV-connector subtree from broad source dependencies ( #51046 )
...
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai >
2026-08-06 16:51:10 -07:00
8170c23c4f
[Quantization] Share online weight scales across TP ( #49764 )
...
Signed-off-by: S1ro1 <matej.sirovatka@gmail.com >
Signed-off-by: aoshen02 <aoshen@inferact.ai >
Signed-off-by: Roger Wang <hey@rogerw.io >
Co-authored-by: OpenAI Codex <codex@openai.com >
Co-authored-by: aoshen02 <aoshen@inferact.ai >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
Co-authored-by: Roger Wang <hey@rogerw.io >
2026-08-06 16:34:33 -07:00
Giancarlo Delfin and Nick Hill
27930df9c2
[Model Runner V2] Fix -1 placeholder draft token ids in rejection sam… ( #50939 )
...
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai >
Co-authored-by: Nick Hill <nickhill123@gmail.com >
2026-08-06 16:32:00 -07:00
Simon Mo
9bca7d840d
docs(governance): refresh committers list, add TSC note, update project leads ( #51300 )
2026-08-06 16:28:17 -07:00
Taneem Ibrahim
9464529612
[ModelRunner v2] Enable decoder token-wise pooling ( #50931 )
...
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com >
2026-08-06 22:21:52 +00:00
Tejas
4d341ca829
fix: resolve silent request skipping in PRIORITY scheduling ( #49206 )
...
Signed-off-by: Tejas-Raj01 <rajtejas.xyz@gmail.com >
2026-08-06 22:21:21 +00:00
a07086e403
[Misc] Upgrade fastsafetensors version, fix metadata is null ( #50827 )
...
Signed-off-by: lengrongfu <lenronfu@gmail.com >
Signed-off-by: Nick Hill <nickhill123@gmail.com >
Co-authored-by: Nick Hill <nickhill123@gmail.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-06 14:48:56 -07:00
Nick Hill
c5d470ac4c
[ModelRunner V2] Minor indexing optimizations ( #51210 )
...
Signed-off-by: Nick Hill <nickhill123@gmail.com >
2026-08-06 14:44:13 -07:00
wangxian001 and Nick Hill
d6af803f43
[Bugfix] Fix packed KV block zeroing stride ( #50276 )
...
Signed-off-by: wangxian001 <120719093+wangxian001@users.noreply.github.com >
Signed-off-by: Nick Hill <nickhill123@gmail.com >
Co-authored-by: Nick Hill <nickhill123@gmail.com >
2026-08-06 13:49:06 -07:00
Wentao Ye
adc3e03517
[Mypy Fix] Mypy fix for "vllm/model_executor/models/[aA][bB]" ( #48977 )
...
Signed-off-by: yewentao256 <zhyanwentao@126.com >
2026-08-06 19:30:15 +00:00
d8eabdbfbe
[ROCm][MLA] Use asm decode for non-divisor small head counts ( #50578 )
...
Signed-off-by: vanshbhatia-amd <210711135+vanshbhatia-amd@users.noreply.github.com >
Signed-off-by: Markus Hartikainen <markus.hartikainen@amd.com >
Signed-off-by: Liuyinfeng01 <yinfeliu@amd.com >
Co-authored-by: vanshbhatia-amd <210711135+vanshbhatia-amd@users.noreply.github.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: Markus Hartikainen <markus.hartikainen@amd.com >
Co-authored-by: Liuyinfeng01 <yinfeliu@amd.com >
2026-08-06 14:56:53 -04:00
7b9f2dad89
[Frontend] Watch frontend processes during engine startup ( #43417 )
...
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
Signed-off-by: Nick Hill <nickhill123@gmail.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
Co-authored-by: Nick Hill <nickhill123@gmail.com >
2026-08-06 11:17:24 -07:00
Divakar Verma
4f851bef6c
[ROCm][CI] Update AITER AR+RMS e2e fusion counts for final-norm coverage ( #51273 )
...
Signed-off-by: Divakar Verma <divakar.verma@amd.com >
2026-08-06 13:05:16 -05:00
c56f169d9a
[Bugfix] Keep mamba align prefill chunks block-aligned past last_cache_position ( #51113 )
...
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai >
Co-authored-by: Hernan <kodek@eat1337.com >
Co-authored-by: yanghui1-arch <3053034939@qq.com >
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-06 10:21:00 -07:00
81be2e09ae
[Weight processing] Copy over new_data attributes in replace_parameter ( #49601 )
...
Signed-off-by: Felix Marty <Felix.Marty@amd.com >
Co-authored-by: Claude <noreply@anthropic.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-06 13:03:37 -04:00
b38e111d3e
[Attention][MLA] Per-request scheduling for MLA chunked context ( #50613 )
...
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
Co-authored-by: OpenAI Codex <noreply@openai.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-06 16:45:44 +00:00
Harry Mellor
e7b8d59460
Fully generalise input embedding handling in Transformers modelling backend ( #51247 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-08-06 16:21:24 +00:00
Michael Goin and OpenAI Codex
566c80edf9
[CI] Run basic fullgraph correctness on one GPU ( #51271 )
...
Signed-off-by: mgoin <mgoin64@gmail.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-08-06 12:09:30 -04:00
gnovack
7b4ed49628
attn_res kernel latency improvements ( #50185 )
2026-08-06 08:53:20 -07:00
Chris Leonard and Shengqi Chen
41e7746b82
Update vllm to point to flash-attention commit that builds FA3 with torch stable API. (Retry) ( #49599 )
...
Signed-off-by: Chris Leonard <chleonar@redhat.com >
Signed-off-by: Shengqi Chen <harry-chen@outlook.com >
Co-authored-by: Shengqi Chen <harry-chen@outlook.com >
2026-08-06 08:37:46 -07:00
Ning Xie
62a86318de
[VocabParallelEmbedding] fix extra_repr fields concat ( #51224 )
...
Signed-off-by: Andy Xie <andy.xning@gmail.com >
2026-08-06 05:22:18 -07:00
Liangqiusong
1e05b21d61
Remove the XPU branch of topk_softplus_sqrt ( #51242 )
...
Signed-off-by: xiaolong <xiaolong.guo@intel.com >
2026-08-06 12:18:45 +00:00
AlexHuang and OpenAI Codex
46e6a83ce1
[Bugfix][KV Offload] Clean up resources after initialization failure ( #51227 )
...
Signed-off-by: Alex <jihui.huang@daocloud.io >
Co-authored-by: OpenAI Codex <noreply@openai.com >
2026-08-06 14:42:13 +03:00
yjz and JianDan0212
5fba75aefe
[Bugfix][Model] Add missing fused_qkv_a_proj to Kimi-Linear packed_modules_mapping ( #51249 )
...
Signed-off-by: JianDan0212 <zhangyj0212@gmail.com >
Co-authored-by: JianDan0212 <zhangyj0212@gmail.com >
2026-08-06 11:39:17 +00:00
Sage
865781e627
[Rust Frontend] Add standalone Rust renderer ( #50289 )
2026-08-06 11:23:26 +00:00
ef2615c2e0
[Bugfix][KV Offload] Fall back when MADV_POPULATE_WRITE is unsupported ( #51116 )
...
Signed-off-by: Guy Girmonsky <guygir@gmail.com >
Signed-off-by: Alex <jihui.huang@daocloud.io >
Co-authored-by: Guy Girmonsky <guygir@gmail.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
Co-authored-by: OpenAI Codex <noreply@openai.com >
2026-08-06 13:48:01 +03:00
Lyu Han
22013f74ff
Interns2mobius support ( #51149 )
...
Signed-off-by: Lyu Han <lvhan_028@163.com >
2026-08-06 10:39:35 +00:00
Jared Wen
e07532b035
[MISC][Bench] refactor throughput and reuse serve's get samples ( #50981 )
...
Signed-off-by: JaredforReal <w13431838023@gmail.com >
2026-08-06 10:31:23 +00:00
