 macheroandClaude
|
87b9b5b8d9
|
[Test][VLM] Add batch-invariance tests for Qwen3-VL (#53531)
Signed-off-by: machero <sr1123640465@126.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-30 09:49:41 -04:00 |
|
|
Devon KrismanandClaude Fable 5
|
4f78a8fdd0
|
[Model] Honor cap_pixels_per_frame in Qwen3-VL memory profiling (#54380)
Signed-off-by: Devon Krisman <git@krisman.dev>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-30 08:07:29 +00:00 |
|
|
Canlin Guoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
b383e16396
|
[Bugfix] Reset cached Mamba align metadata on profiling teardown (#54044)
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-30 00:43:20 -07:00 |
|
|
Connor Carpenter
|
7a67941c1d
|
[Rust Frontend][gRPC] Add audio and video media inputs (#53760)
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
|
2026-08-30 11:31:37 +08:00 |
|
|
|
dbf662c9e8
|
[ROCm][MLA] Reach FULL cudagraphs for AITER MLA speculative decoding (#51171)
Signed-off-by: yudigege86 <naqin@amd.com>
Co-authored-by: yudigege86 <naqin@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-29 19:49:55 -07:00 |
|
|
yzong-rh
|
680e2177e4
|
[CI][Ray] Fix flaky multi-node assignment test after placement-group teardown (#53621)
|
2026-08-29 23:48:22 +00:00 |
|
|
Oxana KorzhandClaude Opus 5
|
6cddad414e
|
[CI][Test] Deflake test_mem.py sleep-mode asserts via allocator bookeeping (#54312)
Signed-off-by: Oxana Korzh <okorzh@amd.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-29 12:05:17 -07:00 |
|
|
Giancarlo Delfin
|
fe755c8899
|
[Bugfix][Model Runner V2][Spec Decode] Decouple the draft's gumbel noise stream from the target's (#54282)
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
|
2026-08-29 09:58:29 -07:00 |
|
|
Kaif KohariandCyrus Leung
|
7fbfca2670
|
[Bugfix][Frontend] Only echo the assistant turn in batched chat completions (#52529)
Signed-off-by: Kaif <kaifkohari10@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-08-29 09:44:17 -07:00 |
|
|
Shenglei FuandClaude Fable 5
|
129087ddab
|
[Perf] Reuse topk SparseMatrix routing metadata in GPT-OSS MoE forward (#45457)
Signed-off-by: Shenglei Fu <sfu@confluent.io>
Signed-off-by: Shenglei Fu <117230642+ShengleiFu@users.noreply.github.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-29 12:14:39 -04:00 |
|
|
Nicolò Lucchesi
|
7f4793eaa3
|
[Nixl][PD] DCP support for MLA models (#50611)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-08-29 16:03:53 +00:00 |
|
|
Isotr0py
|
4fc943b867
|
[Multimodal] Deprecate PyAV video decoder backend (#54231)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-08-29 15:13:28 +00:00 |
|
|
|
d3d79ffc1e
|
[Bugfix][Spec Decode] Capture the widest uniform decode batch by default (#50488)
Signed-off-by: Rahul Chalamala <22563365+rchalamala@users.noreply.github.com>
Signed-off-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Signed-off-by: Rahul Chalamala <rahul@modal.com>
Co-authored-by: Janelle Cai <janelle.cai@modal.com>
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: Devin <devin@cognition.ai>
|
2026-08-28 22:38:13 -07:00 |
|
|
|
f4f3bcd4b4
|
[Test] Assert co-located RayExecutorV2 stores publish distinct ports (#54310)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-28 22:13:31 -07:00 |
|
|
Oxana KorzhandClaude Opus 5
|
fb68025138
|
[Bugfix][MRV2] Release model and KV cache on in-process engine shutdown (#54162)
Signed-off-by: Oxana Korzh <okorzh@amd.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-28 22:09:08 -07:00 |
|
|
Hotragn Pettugani
|
3958a420f0
|
[Bugfix][V1] Keep an encoder cache entry until its last occurrence is freed (#54284)
Signed-off-by: hotragn <hotragn.pettugani_2024@woxsen.edu.in>
|
2026-08-29 05:08:01 +00:00 |
|
|
Summer Yang
|
6d4562c59b
|
[Attention][DCP] Enable FlashInfer MLA for DSpark drafting (#54277)
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
|
2026-08-28 21:11:28 -07:00 |
|
|
|
b2f685834a
|
[Hy4] support Hy4-preview model (#54160)
Signed-off-by: chengvjiang <chengvjiang@tencent.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: chengvjiang <chengvjiang@tencent.com>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: russellfeng <russellfeng@tencent.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-08-29 12:07:28 +08:00 |
|
|
Stellar鱼
|
5182f2705b
|
[CI/Build] Use file rendezvous for UniProc loader fixtures (#52367)
Signed-off-by: yu-xin-c <2182712990@qq.com>
|
2026-08-29 11:53:04 +08:00 |
|
|
|
93ab92be0c
|
[Bugfix][AMD] Annotate draft KV cache groups on the hybrid grouping path (#52047)
Signed-off-by: okorzh-amd <okorzh-amd@users.noreply.github.com>
Co-authored-by: okorzh-amd <okorzh-amd@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
|
2026-08-28 21:53:46 -05:00 |
|
|
|
6b110badbb
|
[Bugfix][Mooncake] Save exact Mamba boundary states (#51358)
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Dao Le <daole@inferact.ai>
|
2026-08-29 02:40:53 +00:00 |
|
|
Ronaldandaoshen02
|
16d6c376bc
|
[Bugfix][Models] Register sleep-managed runtime buffers (#53507)
Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
|
2026-08-29 10:32:24 +08:00 |
|
|
Wei ZhaoandYifan Qiao
|
7fd9cc036e
|
[KV Connector] Support MooncakeStore with hybrid DCP prefix caching (#53324)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: wzhao18 <weizha@nvidia.com>
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
|
2026-08-29 02:10:23 +00:00 |
|
|
|
99013d77d3
|
[Bugfix][Distributed] Gate cross-node MNNVL custom all-reduce by group capability (#53253)
Signed-off-by: JulianZJN <148066842+JulianZJN@users.noreply.github.com>
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: Summer Yang <girasoleyang@gmail.com>
|
2026-08-29 08:49:24 +08:00 |
|
|
Oxana KorzhandClaude Opus 5
|
1a16c2ad2c
|
[CI][Test] Deflake the rms_norm scaling-property assertions (#54271)
Signed-off-by: Oxana Korzh <okorzh@amd.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-29 08:08:20 +08:00 |
|
|
Ace EldeibandCodex
|
9662ab0835
|
[Bugfix] Set breakable graph env before Ray actor import (#53293)
Signed-off-by: Ace Eldeib <aeldeib@coreweave.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-08-28 23:11:50 +00:00 |
|
|
Shinichi Hemmi
|
df14152ac6
|
[Model] Support speculative decoding method for PLaMo3 (#54239)
Signed-off-by: Shinichi Hemmi <shemmi@preferred.jp>
|
2026-08-28 22:31:07 +00:00 |
|
|
|
c274d36103
|
[Bugfix] Keep the Moondream3 MoE all-reduce out of the fused-path try (#54152)
Signed-off-by: Oxana Korzh <okorzh@amd.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
|
2026-08-28 15:06:42 -07:00 |
|
|
Summer YangandNick Hill
|
2aac565cae
|
[Core][KV Connector] Start async KV loads after the forward launch when no sync loads are scheduled (#53333)
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-28 21:58:00 +00:00 |
|
|
Nick HillandKimi Code
|
96242aa50d
|
[Bugfix][MRV2] Release layer-bound KV cache memory in shutdown() (#54246)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Kimi Code <noreply@moonshot.ai>
|
2026-08-28 21:27:09 +00:00 |
|
|
|
06cccf8730
|
[Bugfix] Fix int32 token offset overflow in fused SiLU block quant (#53409)
Signed-off-by: Anni <dranox2222@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
|
2026-08-28 16:23:36 -04:00 |
|
|
|
67e86d1e6f
|
[BugFix] Bind RayExecutorV2 TCPStore before publishing its port (#50969)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-28 12:27:22 -07:00 |
|
|
afriedriandAndreas Karatzas
|
2f1cba799e
|
[ROCm] remove VLLM_ROCM_USE_AITER_FP4_ASM_GEMM environment variable; make w4a4 use the preshuffle triton+asm by default (#53141)
Signed-off-by: Andy Friedrich <afriedri@amd.com>
Signed-off-by: afriedri <afriedri@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-28 18:59:53 +00:00 |
|
|
Yongye ZhuandOpenAI Codex
|
d9dabfa351
|
[Kimi-K3][Kernel] Optimize the low-M fused latent MoE tail (#54168)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-28 10:45:36 -07:00 |
|
|
Chipmunk
|
ffe690eca9
|
[MM][CG] Support ViT full CUDA graph for Idefics3 and SmolVLM (#47625)
Signed-off-by: Ryouichi Kurihara <ryouichi.kurihara.628@gmail.com>
|
2026-08-28 17:16:31 +00:00 |
|
|
xuebwang-amd
|
06569a8696
|
[ROCm][Quantization][MOE] Enable fused shared experts for block-quantized FP8 (#53097)
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
|
2026-08-28 09:23:07 -07:00 |
|
|
Michał Ganczarenko
|
d1922cb5a7
|
[Bugfix] Restore multimodal support on the plain "vllm" throughput backend (#52168)
Signed-off-by: Michal Ganczarenko <michal.ganczarenko@intel.com>
|
2026-08-28 10:28:25 +00:00 |
|
|
stefankoncarevic
|
5f213ed159
|
[ROCm][CI] Warm up the RLHF dev server before the pause/resume timing checks (#53594)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
|
2026-08-28 09:07:04 +00:00 |
|
|
Thien Tran
|
f956e1c343
|
[Kimi-K3][Bugfix] Fix low-latency GEMM fallback initialization (#54167)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-08-28 08:32:20 +00:00 |
|
|
stefankoncarevic
|
9236159bb6
|
[ROCm][CI] Keep startup profiling from aborting when free memory grows (#53591)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
|
2026-08-28 00:02:40 -07:00 |
|
|
Qiming Zhang
|
c01b50e390
|
[Test] Fix mock_current_vllm_config missing kernel_config in test_dflash2 (#54132)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
|
2026-08-27 22:28:43 -07:00 |
|
|
maobaolongandCodex
|
6f7df92a8e
|
[CPU][MLA] Fix prefill backend selection so MLA runs end-to-end on CPU (#51471)
Signed-off-by: baoloongmao <baoloongmao@tencent.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-08-28 12:36:55 +08:00 |
|
|
|
e6bfe03ad7
|
Count store offers, not lookups, for CPU offload store_threshold (#52227)
Signed-off-by: okorzh-amd <okorzh-amd@users.noreply.github.com>
Co-authored-by: okorzh-amd <okorzh-amd@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-27 20:21:06 -07:00 |
|
|
haic0andCursor
|
53bf990502
|
[Bugfix][KV Cache] Prevent negative external block allocation (#52707)
Signed-off-by: haic0 <149741444+haic0@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-08-27 20:10:45 -07:00 |
|
|
Roy WangandClaude Fable 5
|
b74ac0bc61
|
[Bugfix] Allocate packed outputs in fused_q_kv_rmsnorm so q_b_proj keeps its low-latency GEMM path at decode (#53109)
Signed-off-by: yasong.wang <yasong.wang@inferact.ai>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-28 02:08:27 +00:00 |
|
|
Elvir Crnčević
|
f3b91f1af2
|
Remove wrongly added e2e test (#54099)
|
2026-08-27 20:04:17 -06:00 |
|
|
Misha GoinandOpenAI Codex
|
5bbc58c0ad
|
[Bugfix] Remove race in fused groupwise RMSNorm quantization (#54111)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-27 19:01:22 -07:00 |
|
|
Kevin H. Luu
|
d04d3e0a07
|
[Bugfix] Revert renderer warmup overlap to avoid fork deadlock (#54023)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
|
2026-08-27 16:36:33 -07:00 |
|
|
qizixiandOpenAI Codex
|
e5377e6727
|
[Bugfix][Model] Fix K3 DSpark config for 96-head drafts (#54005)
Signed-off-by: zixi-qi <zixi@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-27 15:58:28 -07:00 |
|
|
|
7c877062ac
|
[kernel] Integrate FlashInfer BF16 CuTeDSL Low Latency GEMM (#50572)
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-08-27 22:29:12 +00:00 |
|