 afriedriandAndreas Karatzas
|
2f1cba799e
|
[ROCm] remove VLLM_ROCM_USE_AITER_FP4_ASM_GEMM environment variable; make w4a4 use the preshuffle triton+asm by default (#53141)
Signed-off-by: Andy Friedrich <afriedri@amd.com>
Signed-off-by: afriedri <afriedri@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-28 18:59:53 +00:00 |
|
|
Yongye ZhuandOpenAI Codex
|
d9dabfa351
|
[Kimi-K3][Kernel] Optimize the low-M fused latent MoE tail (#54168)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-28 10:45:36 -07:00 |
|
|
Chipmunk
|
ffe690eca9
|
[MM][CG] Support ViT full CUDA graph for Idefics3 and SmolVLM (#47625)
Signed-off-by: Ryouichi Kurihara <ryouichi.kurihara.628@gmail.com>
|
2026-08-28 17:16:31 +00:00 |
|
|
xuebwang-amd
|
06569a8696
|
[ROCm][Quantization][MOE] Enable fused shared experts for block-quantized FP8 (#53097)
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
|
2026-08-28 09:23:07 -07:00 |
|
|
Michał Ganczarenko
|
d1922cb5a7
|
[Bugfix] Restore multimodal support on the plain "vllm" throughput backend (#52168)
Signed-off-by: Michal Ganczarenko <michal.ganczarenko@intel.com>
|
2026-08-28 10:28:25 +00:00 |
|
|
stefankoncarevic
|
5f213ed159
|
[ROCm][CI] Warm up the RLHF dev server before the pause/resume timing checks (#53594)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
|
2026-08-28 09:07:04 +00:00 |
|
|
Thien Tran
|
f956e1c343
|
[Kimi-K3][Bugfix] Fix low-latency GEMM fallback initialization (#54167)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-08-28 08:32:20 +00:00 |
|
|
stefankoncarevic
|
9236159bb6
|
[ROCm][CI] Keep startup profiling from aborting when free memory grows (#53591)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
|
2026-08-28 00:02:40 -07:00 |
|
|
Qiming Zhang
|
c01b50e390
|
[Test] Fix mock_current_vllm_config missing kernel_config in test_dflash2 (#54132)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
|
2026-08-27 22:28:43 -07:00 |
|
|
maobaolongandCodex
|
6f7df92a8e
|
[CPU][MLA] Fix prefill backend selection so MLA runs end-to-end on CPU (#51471)
Signed-off-by: baoloongmao <baoloongmao@tencent.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-08-28 12:36:55 +08:00 |
|
|
|
e6bfe03ad7
|
Count store offers, not lookups, for CPU offload store_threshold (#52227)
Signed-off-by: okorzh-amd <okorzh-amd@users.noreply.github.com>
Co-authored-by: okorzh-amd <okorzh-amd@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-27 20:21:06 -07:00 |
|
|
haic0andCursor
|
53bf990502
|
[Bugfix][KV Cache] Prevent negative external block allocation (#52707)
Signed-off-by: haic0 <149741444+haic0@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-08-27 20:10:45 -07:00 |
|
|
Roy WangandClaude Fable 5
|
b74ac0bc61
|
[Bugfix] Allocate packed outputs in fused_q_kv_rmsnorm so q_b_proj keeps its low-latency GEMM path at decode (#53109)
Signed-off-by: yasong.wang <yasong.wang@inferact.ai>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-28 02:08:27 +00:00 |
|
|
Elvir Crnčević
|
f3b91f1af2
|
Remove wrongly added e2e test (#54099)
|
2026-08-27 20:04:17 -06:00 |
|
|
Misha GoinandOpenAI Codex
|
5bbc58c0ad
|
[Bugfix] Remove race in fused groupwise RMSNorm quantization (#54111)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-27 19:01:22 -07:00 |
|
|
Kevin H. Luu
|
d04d3e0a07
|
[Bugfix] Revert renderer warmup overlap to avoid fork deadlock (#54023)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
|
2026-08-27 16:36:33 -07:00 |
|
|
qizixiandOpenAI Codex
|
e5377e6727
|
[Bugfix][Model] Fix K3 DSpark config for 96-head drafts (#54005)
Signed-off-by: zixi-qi <zixi@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-27 15:58:28 -07:00 |
|
|
|
7c877062ac
|
[kernel] Integrate FlashInfer BF16 CuTeDSL Low Latency GEMM (#50572)
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-08-27 22:29:12 +00:00 |
|
|
Ronaldandaoshen02
|
479eeb32d2
|
[Bugfix][MRV2] Isolate sleep-mode KV allocations (#53508)
Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
|
2026-08-27 15:08:28 -07:00 |
|
|
Matthew BonanniandOpenAI Codex
|
de9250ac9e
|
[Attention] Enable masked MHA for GLM-5 head dimensions (#53785)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-27 21:17:12 +00:00 |
|
|
Mikhail Podvitskii
|
3a9bfc209f
|
[Bugfix][Parser] Scope reasoning-end detection to the current turn via turn-boundary tokens (#54089)
Signed-off-by: Mikhail Podvitskii <podvitskiymichael@gmail.com>
|
2026-08-27 16:57:32 -04:00 |
|
|
Chauncey
|
7d5769b2d9
|
[Perf][DSv4] Use native CUDA SwiGLU clamp kernel for Humming MoE (throughput +1.40%) (#53685)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-08-27 13:52:45 -07:00 |
|
|
Wentao Ye
|
9818bb3db8
|
[Kimi Perf] Tune hopper low latency gemm kernel, 4%~97% performance improvement (#54088)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-27 16:48:53 -04:00 |
|
|
Jeffrey Wang
|
79378fe6e8
|
[Bugfix] Avoid TCPStore port collision for co-located non-DP Ray engines (#53666)
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
|
2026-08-27 19:58:14 +00:00 |
|
|
Nick Hill
|
4aab2b0ebe
|
[Model Runner V2] Use MRV2 for all models by default (#53183)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-27 11:59:34 -07:00 |
|
|
Summer Yang
|
07242faa46
|
[Attention][DCP] Use FlashInfer native CP for MLA decode (#54012)
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
|
2026-08-27 10:32:45 -07:00 |
|
|
Shanshan Shen
|
32ad1400d7
|
[ROCm][Perf] Fuse SWA q/kv RMSNorm and q FP8 group quant for DeepSeek-V4 (#53540)
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
|
2026-08-27 09:37:54 -07:00 |
|
|
Chauncey
|
d21c5b50a1
|
[Perf][GLM5.2] Fuse sparse MLA Q concatenation with head padding (#53878)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-08-27 11:54:32 -04:00 |
|
|
Nick Hill
|
76c0c6530e
|
[Bugfix][Scheduler] Don't pad spec decode up to max_model_len (#53962)
|
2026-08-27 08:30:22 -07:00 |
|
|
Matthew Bonanni
|
d85708f7a4
|
[1/N][KV Connector] Identify externally transferable KV cache groups (#53779)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-08-27 11:21:24 -04:00 |
|
|
Hert4
|
4a6a3272e8
|
[Bugfix][Frontend] Let pooling requests set padding (#51157)
Signed-off-by: Hert4 <ductransa01@gmail.com>
|
2026-08-27 11:06:20 +00:00 |
|
|
Jiangyun ZhuandOpenAI Codex
|
478ec3ea41
|
[Bugfix][KV Offload] Handle padded GPU cache storage (#54021)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-27 10:52:59 +00:00 |
|
|
|
6c4aa8bec3
|
[RL] Support checkpoint-coordinate sparse NCCL weight updates (#53751)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Signed-off-by: Shuolei Wang <shuoleiwang123@gmail.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-27 18:19:51 +08:00 |
|
|
Hung Hoang (黄兴）
|
acd0af90e8
|
[Bugfix] Raise clear error on interleaved multimodal placeholder overcount (#53999)
Signed-off-by: hungh <hungh@nvidia.com>
|
2026-08-27 09:49:40 +00:00 |
|
|
Charlie Fu
|
fd57c4b7af
|
[Rocm][CI] add dockerfile.xpu to rocm ci artifact (#53949)
Signed-off-by: charlifu <charlifu@amd.com>
|
2026-08-27 01:06:48 -07:00 |
|
|
Canlin Guo
|
aa640684cc
|
[Kimi K3][Kernel] Support DS conv-state layout in fused KDA decode kernel (#53396)
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com>
|
2026-08-26 23:54:50 -07:00 |
|
|
Qiu Chunshuo
|
b3af042abd
|
Bugfix: use PCP slot mappings for PIECEWISE capture (#53869)
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
|
2026-08-27 05:39:36 +00:00 |
|
|
Giancarlo Delfin
|
5acc1c4e4b
|
[Model Runner V2][Spec Decode] Skip DP sync before EAGLE/MTP draft prefill (#53694)
|
2026-08-26 20:59:35 -07:00 |
|
|
Ning Xie
|
ca90b9e7d4
|
[warmup] overlap renderer warmup and engine core initialization (#52764)
Signed-off-by: Andy Xie <andy.xning@gmail.com>
|
2026-08-27 11:42:08 +08:00 |
|
|
omerpaz95andClaude Opus 5
|
f8d38fbc87
|
[EC Connector] EC Offloading Connector use events instead of StepTracker (#49994)
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-08-27 03:41:46 +00:00 |
|
|
Wei Zhao
|
94d96e2446
|
[Bugfix] Release CUDA graph profiling memory before KV cache allocation (#53955)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
|
2026-08-27 01:35:59 +00:00 |
|
|
yzong-rhandBen Browning
|
51d1b45182
|
[Bugfix][GPT-OSS] Fix strict tool-call grammar to accept Harmony renders (#52222)
Signed-off-by: Yifan Zong <yzong@redhat.com>
Co-authored-by: Ben Browning <56071+bbrowning@users.noreply.github.com>
|
2026-08-26 18:05:09 -07:00 |
|
|
vllm-agentandKevin Luu
|
d1e5e66ee3
|
[Bugfix] Restore portable all2all backend default (#53952)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
|
2026-08-26 16:19:49 -07:00 |
|
|
liuzhenwei
|
a27e88c862
|
[XPU][CI] increase timeout of extract_hidden_states tp2 (#53862)
|
2026-08-26 15:57:36 -07:00 |
|
|
Wentao Ye
|
76cfe1cd88
|
[Kimi K3 Perf] Optimize eh_proj linear calculation, 12.9 ~ 25.2% kernel performance improvement (#53942)
|
2026-08-26 17:08:02 -04:00 |
|
|
Venkat Balaji SandBen Browning
|
161ffd37d2
|
[Bugfix] Guard tool call argument JSON parsing in chat message postprocessing (#48922)
Signed-off-by: VBS2004 <venkatbalaji2004@gmail.com>
Co-authored-by: Ben Browning <56071+bbrowning@users.noreply.github.com>
|
2026-08-26 20:26:00 +00:00 |
|
|
xiaohuguo2023andCursor
|
1a085dadf2
|
[ROCm][K3] Extend FP8 asm MLA prefill to non-divisor small head counts (#51040)
Signed-off-by: Xiaohu Guo <Xiaohu.Guo@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-08-26 17:47:16 +00:00 |
|
|
aoshen02
|
17da48596c
|
[Bugfix][DP] Synchronize the device on pause completion (#52914)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
|
2026-08-26 09:50:33 -07:00 |
|
|
Avinash Paulandavininjamay8
|
8d301f075b
|
[Bugfix][ROCm][Disagg] Fix MoRIIO shared KV memory region registration (#53698)
Signed-off-by: avininjamay8 <avpaul@amd.com>
Co-authored-by: avininjamay8 <avpaul@amd.com>
|
2026-08-27 00:10:57 +08:00 |
|
|
Fangzhou Ai
|
657f9b9ce2
|
[ROCm][DSV4][Perf] Fuse DeepSeek V4 C4 compressor GEMMs (#53838)
Signed-off-by: fai <fangzhouai@gmail.com>
|
2026-08-26 23:36:14 +08:00 |
|