 vllm-agentandkimi-no-na-wa
|
5bb596201a
|
[CI] Raise Elastic EP Scaling step timeout 30m -> 40m (#57287)
Signed-off-by: kimi-no-na-wa <kimi-no-na-wa@users.noreply.github.com>
Co-authored-by: kimi-no-na-wa <kimi-no-na-wa@users.noreply.github.com>
|
2026-09-18 03:10:38 -07:00 |
|
|
Yuwen ZhouandLi, Jiang <jiang1.li@intel.com>
|
b346479065
|
[CPU] Add CPU FP8 W8A8 linear/MoE support (#49942)
Signed-off-by: yuwenzho <yuwen.zhou@intel.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-09-18 17:59:42 +08:00 |
|
|
meng-amd
|
6df2b1a8c6
|
[Quantization] Support native Quark W4A16 INT4/UINT4 exports in vLLM (#48606)
Signed-off-by: HongWei Meng <HongWei.Meng@amd.com>
|
2026-09-18 17:52:46 +08:00 |
|
|
shaohuaxiandCodex
|
67a8a3f926
|
[Bugfix][CPU] Fix macOS multimodal SHM cache initialization (#57142)
Signed-off-by: 子华 <huaxi.shx@alibaba-inc.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-18 09:05:13 +00:00 |
|
|
olka-amdandClaude Opus 5
|
32636580a6
|
[Bugfix][MLA] TritonMLA: fix illegal memory access on causal multi-token decode (#51065)
Signed-off-by: Oleksandr Kachur <oleksandr.kachur@amd.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-18 03:49:53 -05:00 |
|
|
Thien TranandCodex
|
8da75d6190
|
C3x SM100 FP8 blockwise - Pad activation scales to multiple of 4 (#57377)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-18 08:39:27 +00:00 |
|
|
Biswa PandaandBugen Zhao
|
95d723700b
|
[Rust Frontend] Return sampling masks over gRPC (#56777)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
|
2026-09-18 08:26:17 +00:00 |
|
|
Micah WilliamsonandAndreas Karatzas
|
d5f0a6e829
|
[Bugfix][DBO] Fix DeepEP low-latency profiling crash with DP+EP+DBO (#57502)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-18 06:33:41 +00:00 |
|
|
SunandCodex
|
42a33039eb
|
[Perf] Fuse CohereASR relative attention score accumulation (#55190)
Signed-off-by: levius <2114377220@qq.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-09-18 06:18:41 +00:00 |
|
|
|
39e33db7f3
|
[Frontend] Fix the parsing of missing string= in DeepSeek V4 (#56271)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: lazymio <mio@lazym.io>
|
2026-09-18 05:11:24 +00:00 |
|
|
|
dee37d8911
|
[Frontend] Add --tool-strict-level for server-side control for structural tag activation (#56268)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: lazymio <mio@lazym.io>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-18 04:32:39 +00:00 |
|
|
|
d12c276853
|
[Bugfix][ROCm] Alias SparseAttnIndexerKpool.forward_cuda to forward_native (GLM-5.3-Flash boot crash) (#57425)
Signed-off-by: Mustafa YILDIRIM <mustafa@character.ai>
Co-authored-by: Hermes Agent <hermes@nousresearch.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
|
2026-09-18 03:36:55 +00:00 |
|
|
Juntian LiuandWoosuk Kwon
|
bf13ecc2f7
|
[Perf][MRV2] Share token-to-request mappings across KV cache groups (#57102)
Signed-off-by: Juntian Liu <Juntianl777@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-09-18 03:14:36 +00:00 |
|
|
JasonandChauncey
|
2909ad8fa4
|
[Bugfix] Attach request-level tools to existing system message in DeepSeek V4 Python renderer (#51856)
Signed-off-by: Jason Yao <wsyjh8@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-09-18 11:07:25 +08:00 |
|
|
Simon Danielsson
|
70df48dc3d
|
[Bugfix][KV Cache][GLM-5.3-Flash] Disable slot mapping kernel for the kpool tail buffer (#57317)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-09-17 22:42:54 -04:00 |
|
|
Ren Yuzhou
|
7b94293627
|
[Bugfix][ROCm][KV Offload] Use private pinned tensors for CPU KV offload (#57160)
Signed-off-by: Yuzhou Ren <ryzcqu@outlook.com>
|
2026-09-18 02:35:23 +00:00 |
|
|
Chaunceyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2bbdfcfcfe
|
[Perf][GLM5.3-Flash] Use cooperative top-k for small GLM decode batches (#57327)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-18 10:31:35 +08:00 |
|
|
Woosuk KwonandCodex
|
64563d0ec4
|
[Bugfix][DSv4.1] Preserve NaN-scored candidate block indices (#57454)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-17 19:00:10 -07:00 |
|
|
Matt Mastracci
|
2c88fb131c
|
[Bugfix] DiffusionGemma: hand out stashed logprobs only on the committing step (#57414)
|
2026-09-17 20:24:58 -04:00 |
|
|
Rohan PotdarandClaude
|
213c379fca
|
[ROCm][Bugfix] Gate AITER MXFP8 MoE on the aiter enable flag (#57426)
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-09-18 00:06:05 +00:00 |
|
|
Yan Ma
|
48f663c37f
|
[XPU] Fix incorrect context-key normalization for Qwen DFlash-based models (#56431)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-09-18 07:52:01 +08:00 |
|
|
|
092bdd6d57
|
[Frontend][Core] Add release_kv_cache_memory() API (#44890)
Signed-off-by: Dakai An <dakaian108@gmail.com>
Signed-off-by: AlanFokCo <alanfok2868@gmail.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Signed-off-by: Dakai An <77474977+andakai@users.noreply.github.com>
Co-authored-by: AlanFokCo <alanfok2868@gmail.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-18 07:12:12 +08:00 |
|
|
|
a524f80b1f
|
[AMD][Bugfix] Make the nested-RoPE patch reach automatic validation (#57289)
Signed-off-by: Oxana Korzh <okorzh@amd.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-17 18:09:06 -05:00 |
|
|
Wei Zhao
|
ccde9c61e9
|
[Bugfix] Restore KV cache metadata GET method for external event consumer (#56925)
Signed-off-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>
|
2026-09-17 23:01:35 +00:00 |
|
|
|
e0050f287a
|
[Bugfix][ROCm] Add record_logical_topk_ready to ROCMAiterMLASparseImpl (GLM-5.3-Flash boot crash) (#57252)
Signed-off-by: Mustafa YILDIRIM <mustafa@character.ai>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-17 22:34:56 +00:00 |
|
|
Woosuk KwonandCodex
|
80447d2765
|
[Bugfix][DSv4.1] Fix FlashInfer DSpark non-causal attention (#57432)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-17 15:14:37 -07:00 |
|
|
rasmithandAndreas Karatzas
|
d3074acdda
|
[AMD][CI][The Rock] Fix language models standard for The Rock on mi355 (#53837)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-17 22:13:13 +00:00 |
|
|
|
e8a2a0a8bb
|
[Bugfix][Frontend] Reject stop strings on --tokens-only servers instead of silently ignoring them (#57058)
Signed-off-by: Shimi Bandiel <shimib@google.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-17 22:02:00 +00:00 |
|
|
Misha Goin
|
ac78445bc9
|
[MoE] Encapsulate TRT-LLM BF16 weight layout handling (#57405)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-09-17 17:47:30 -04:00 |
|
|
Misha Goin
|
db7a24c230
|
[Perf] Add fused DFlash2 grouped convolution (#55960)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-09-17 21:38:59 +00:00 |
|
|
|
668d6c3a77
|
[CI] Shard multimodal Processor 1->4 (#56316)
Signed-off-by: Thang Nguyen <thang.nguyen@inferact.ai>
Co-authored-by: Thang Nguyen <thang.nguyen@inferact.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Kimi Code <noreply@moonshot.ai>
|
2026-09-17 14:11:40 -07:00 |
|
|
Maroon AyoubandRobert Shaw
|
9612f77077
|
[Bugfix] Release stale FlashMLA workspace views after growth (#56902)
Signed-off-by: Maroon Ayoub <mayoub@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
|
2026-09-17 16:23:15 -04:00 |
|
|
rasmithandShanshan Shen
|
acc2ed2a5f
|
[ROCm][CI][The Rock 10] Fix (MI355) Quantized Models failure on The Rock 10 with Triton 3.8.x (#54849)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-09-17 15:20:35 -05:00 |
|
|
Doug Brown
|
2b02c6c29b
|
[Model] Add Cohere2MoE Eagle3 auxiliary hidden states (#49819)
Signed-off-by: Doug Brown <doug@github.douggo.com>
|
2026-09-17 20:09:36 +00:00 |
|
|
Misha Goin
|
9a5bd373cf
|
[CI] Retire Weight Loading smoke tests (#57398)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-09-17 16:04:03 -04:00 |
|
|
|
ac2f0ea82c
|
[MoE][Bugfix] Skip SP padded rows in grouped MoE routing (#56079)
Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
|
2026-09-17 19:36:19 +00:00 |
|
|
|
67e5b0acc9
|
[Bugfix][HiSparse][NIXL] Import full blocks without tail prefill on D (#57049)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
|
2026-09-17 15:26:10 -04:00 |
|
|
|
41f9104fa6
|
[DSv4.1] Integrate Mega-Gate from DeepGEMM (#56266)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
|
2026-09-17 12:06:36 -07:00 |
|
|
afriedri
|
a9a7e45f31
|
[ROCm] Restore VLLM_ROCM_USE_AITER_FP4_ASM_GEMM and default w4a4 ASM GEMM back to off (#57055)
Signed-off-by: Andy Friedrich <afriedri@amd.com>
|
2026-09-17 13:39:52 -05:00 |
|
|
Michele Campi
|
6a344d8c85
|
[Bugfix][Metrics] Do not log a 0.0% prefix cache hit rate before any query (#54990)
Signed-off-by: Michele Campi <215741962+MicheleCampi@users.noreply.github.com>
|
2026-09-17 18:19:13 +00:00 |
|
|
Andy LoandOpenAI Codex
|
09c379ab61
|
[Bugfix] Max-load throughput cliff when max_num_seqs is not a multiple of 8 (#57355)
Signed-off-by: Andy Lo <andy@mistral.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-17 18:09:18 +00:00 |
|
|
Sriram KumarandDouglas Lehr
|
ff6b5808c4
|
[ROCm] Resolve the indexer fp8 cache dtype once at import (#53792)
Signed-off-by: Sriram Kumar <sriramkumar.kishorekumar@amd.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
|
2026-09-17 17:51:35 +00:00 |
|
|
Wentao YeandFlora Feng
|
f3aa88d230
|
[Kimi K3 Bug] Fix kimi k3 reasoning parser (#57098)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-09-17 10:05:52 -07:00 |
|
|
|
b2f2bd71ba
|
[CI][Bugfix] Add tp_shard_with_padding to padded MoE reload test mock (#57402)
Signed-off-by: kimi-no-na-wa <kimi-no-na-wa@users.noreply.github.com>
Co-authored-by: kimi-no-na-wa <kimi-no-na-wa@users.noreply.github.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-09-17 13:02:24 -04:00 |
|
|
MattandClaude Opus 5
|
e30bf70c5d
|
[ROCm][CI] Fix Entrypoints Integration (Pooling) tests on TheRock image (#57380)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-17 11:22:39 -05:00 |
|
|
MattandClaude Opus 5
|
fef55fd26d
|
[ROCm][CI] Adapt MoE tests to the triton_kernels 3.8 API (#57385)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-17 11:21:22 -05:00 |
|
|
Taneem IbrahimandHarry Mellor
|
e960ead0aa
|
[Mypy] Fix mypy typing for Transformers models (#54320)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-17 12:11:31 -04:00 |
|
|
YoungandYoung
|
b78fbab4be
|
[Docs] Fix the typos in the document (#57190)
Co-authored-by: Young <yangchh15@163.com>
|
2026-09-17 15:52:10 +00:00 |
|
|
|
d7e755c230
|
[Bugfix] Fix wrong vLLM version reported by pip install (proto-v* tag collision) (#57295)
Signed-off-by: RyanMa29 <ziyang.ma@intel.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-17 08:50:14 -07:00 |
|
|
Zoe923
|
6a7de3ba3a
|
[Bugfix][GDN] Fix CuteDSL BF16 KKT inversion divergence (#53864)
Signed-off-by: Zoe923 <871844693@qq.com>
|
2026-09-17 08:49:56 -07:00 |
|