|
c5b7c069a4
|
[ROCm] Defer tilelang import through its import from vllm.tilelang_utils import tilelang and relaxed has_tilelang (#51159)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-13 13:12:40 -05:00 |
|
|
yzong-rh
|
e6b2a8ad5e
|
[Bugfix][Structured Output] Mask request stop tokens in xgrammar until grammar terminates (#50595)
Signed-off-by: Yifan Zong <yzong@redhat.com>
|
2026-08-13 14:07:59 -04:00 |
|
|
Andreas Karatzas
|
b96bcd0b47
|
[ROCm][CI] Solidify entrypoint LLM lifecycle (#51280)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-13 12:24:02 -05:00 |
|
|
Nick Iusiumbeli
|
83d4c6196a
|
[Bugfix] Declare SupportsEagle3 on KimiLinearForCausalLM (#52171)
Signed-off-by: Nick Iusiumbeli <nickuspro@gmail.com>
|
2026-08-13 16:22:50 +00:00 |
|
|
Thien Tran
|
6014f9e672
|
[Kimi-K3] Add GEMM-RS for sequence parallelism (#52079)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-08-13 09:02:28 -07:00 |
|
|
Ali JaseemandClaude
|
64ca614fe4
|
[Bugfix] Fix --data-parallel-start-rank 0 being treated as unset in create_engine_config (#47692)
Signed-off-by: Syed Ali Jaseem <syedali0057@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-13 15:12:26 +00:00 |
|
|
|
7553aac77b
|
[Frontend] Add routed-experts prompt offset (#51906)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-13 08:09:00 -07:00 |
|
|
Michael Goin
|
2d24355eb8
|
[Bugfix] Fix packed GDN decode launch for large batch-head grids (#52030)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-13 07:19:08 -07:00 |
|
|
|
95c9144424
|
[LoRA][Gemma4] Support vision tower LoRA (#42662)
Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: linitra24 <Joy25810@foxmail.com>
Signed-off-by: linitra24 <joy25810@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: linitra24 <joy25810@gmail.com>
|
2026-08-13 22:07:43 +08:00 |
|
|
yang rui
|
152c913a63
|
[Frontend] Log output token IDs at DEBUG level (#52098)
Signed-off-by: ruirui6946 <142162413+ruirui6946@users.noreply.github.com>
|
2026-08-13 13:11:51 +00:00 |
|
|
JasonCohere
|
5fee0a872d
|
chore: Upstream Cohere parser fixes + tests (#51998)
Signed-off-by: Jason Ozuzu <jasonozuzu@cohere.com>
|
2026-08-13 05:05:36 -07:00 |
|
|
Juan Pérez de Algaba
|
37c3bdf5a7
|
fix(security): enforce audio decode duration limit in NanoNemotronVL (#50221)
Signed-off-by: jperezde <jperezde@redhat.com>
|
2026-08-13 03:31:55 -07:00 |
|
|
Thomas Ortner
|
b8baa31a28
|
Hardware-agnostic model definition via HF transformer backend (1/N) (#49458)
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
|
2026-08-13 11:21:50 +01:00 |
|
|
|
50ba4bc6b2
|
[Feature] Mask Replay (#49577)
Signed-off-by: vx120 <893600387@qq.com>
Signed-off-by: vx120 <57470515+vx120@users.noreply.github.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-13 08:44:31 +00:00 |
|
|
Frank
|
7bc1660bd6
|
[Misc] Use VLLMValidationError in pooling input validation (#51931)
Signed-off-by: frank-suwen <suwenw2@outlook.com>
|
2026-08-13 06:13:25 +00:00 |
|
|
|
903d2efe7e
|
[Attention][MLA] Fuse Kimi-K3 chunked-context K/V packing (#51772)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-12 22:42:57 -07:00 |
|
|
kx
|
2ac1f683f1
|
[BugFix] Reserve the bonus query slot in DFlash scheduling budget (#51256)
Signed-off-by: HF-001 <1670186653@qq.com>
|
2026-08-13 03:50:23 +00:00 |
|
|
Lucas WilkinsonandOpenAI Codex
|
79f3183f86
|
[Bugfix] Bound KV block zeroing launch geometry (#52058)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-13 03:42:26 +00:00 |
|
|
Ziqi Fan
|
15227b934a
|
[Bugfix][KV Offload] Emit self-describing CPU events at KV-group block granularity (#51614)
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
|
2026-08-12 20:28:15 -07:00 |
|
|
Ziqi Fan
|
f9a0f629bd
|
[KV Offload] Expose data-parallel topology to offloading backends (#51879)
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
|
2026-08-12 20:27:26 -07:00 |
|
|
Julien Debache
|
6e502b62cb
|
fix and test EPLB balancedness calculation (#51813)
Signed-off-by: jdebache <jdebache@nvidia.com>
|
2026-08-12 20:27:22 -07:00 |
|
|
|
61826c1c6f
|
[Hardware][Power] Unqualized MoE Backend for Power (VSX) (#51624)
Signed-off-by: Akash kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Antigravity <antigravity@google.com>
|
2026-08-13 10:56:09 +08:00 |
|
|
Kevin H. LuuandOpenAI Codex
|
8eb35c5217
|
[CI] Mirror external test assets in vLLM S3 (#52064)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-13 02:08:59 +00:00 |
|
|
|
5936bac7d7
|
[Bugfix] Report FULL_ATTENTION for uniform-base UniformTypeKVCacheSpecs groups instead of UNKNOWN (#51218)
Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
|
2026-08-13 01:25:23 +00:00 |
|
|
Wentao Ye
|
23f360edaa
|
[CI Bug] Fix ci moe test (#52009)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-12 21:28:53 +00:00 |
|
|
xiao fengandMichael Goin
|
e62abc37d4
|
[Bugfix][Kernel] Fix persistent top-k histogram reuse after short rows (#49139)
Signed-off-by: fxfxfxfxfxfxfxfx <227935476@qq.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
|
2026-08-12 12:54:45 -07:00 |
|
|
|
7f7a32cfec
|
[Spec Decode] DSpark confidence-scheduled verification (#47808)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Signed-off-by: Lucas Wilkinson <wilkinson.lucas@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-12 12:27:48 -07:00 |
|
|
|
19d61b1273
|
[Bugfix] Initialize DeepGemmQuantScaleFMT oracle lazily; bound QuantFP8 UE8M0 packed path to group_size 128 (#51359)
Signed-off-by: BabyDrangoner <148877251+BabyDrangoner@users.noreply.github.com>
Signed-off-by: kiroxu <148877251+BabyDrangoner@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-12 14:27:50 -04:00 |
|
|
stefankoncarevic
|
d20a031d33
|
[Bugfix][ROCm][MoE] Update AITER MXFP4 W4A16 tests to the renamed expert_mask (#51980)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
|
2026-08-12 17:45:45 +00:00 |
|
|
Wentao Ye
|
0fb168e6ee
|
[CI Bug] Fix ci qwen3.5 (#52007)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-12 13:22:09 -04:00 |
|
|
|
9035151d6c
|
[Model] Add native Dots3 NOTE multimodal support (#51255)
Signed-off-by: KurodaKanbei <mistergalahad@gmail.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-08-12 23:13:20 +08:00 |
|
|
Michael Goin
|
8e958902ee
|
[Bugfix] Disable fine-grained prefix-cache hits for incompatible hybrid KV layouts (#51843)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-12 04:08:40 -07:00 |
|
|
dmai-afk
|
4c51ceb11b
|
[Bugfix][Multimodal] Invalidate retained PyNvVideoCodec decoder after failure (#51139)
Signed-off-by: Dat Mai <dmai@nvidia.com>
|
2026-08-12 11:02:10 +00:00 |
|
|
dmai-afk
|
86e2ab50aa
|
[Bugfix][Frontend] Return 400 for invalid PyNvVideoCodec video input (#51120)
Signed-off-by: Dat Mai <dmai@nvidia.com>
|
2026-08-12 10:58:46 +00:00 |
|
|
Tan Pin Siang
|
e60f3c4c13
|
[Bugfix] Fix MiniMax-M3 compressed-tensors FP8 MoE SwiGLU params (#46845)
Signed-off-by: Tan Pin Siang <tanpinsiang@gmail.com>
|
2026-08-12 10:52:30 +00:00 |
|
|
aoshen02
|
4eef91c03c
|
[Model] Support R3 capture with DeepGEMM MegaMoE (#51831)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
|
2026-08-12 01:07:07 -07:00 |
|
|
Matej SirovatkaandJee Jee Li
|
3ac9525507
|
[Bugfix][Quantization] Reuse online NVFP4 MoE kernel across reloads (#50074)
Signed-off-by: S1ro1 <matej.sirovatka@gmail.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-08-12 14:06:53 +08:00 |
|
|
Lucas WilkinsonandOpenAI Codex
|
02ac17851d
|
[Refactor][MRV2] Unify uniform decode token count helper (#51917)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-12 05:58:43 +00:00 |
|
|
aoshen02andCodex
|
f2906b492e
|
[Bugfix] Avoid repeated layerwise reload warning scans (#49505)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Codex <noreply@openai.com>
|
2026-08-12 13:53:50 +08:00 |
|
|
Vinay R DamodaranandClaude Opus 5
|
3ee2df3033
|
[Frontend] Make model optional on all /derender request classes (#51463)
Signed-off-by: Vinay Damodaran <vrdn@hey.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-12 04:48:58 +00:00 |
|
|
|
3962042304
|
[Bugfix][V1][Multimodal] Recover from P0/P1 processor cache drift (#46747) (#46747)
Signed-off-by: William Zhao <williamzh@meta.com>
Signed-off-by: WillZZZy <93454470+WillZZZy@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-12 12:06:57 +08:00 |
|
|
|
7f9173dfa2
|
[ROCm][Perf] Kimi-K3 Fused kernel for KDA decode (#50654)
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
|
2026-08-11 20:39:34 -07:00 |
|
|
Stellar鱼
|
3fa89225bc
|
[CI/Build] Use file rendezvous for local distributed tests (#51652)
Signed-off-by: yu-xin-c <2182712990@qq.com>
|
2026-08-12 10:48:12 +08:00 |
|
|
Matvei PashkovskiiandClaude
|
20727e2841
|
[Hardware][AMD] Enable fused bf16→fp32 router GEMM on ROCm (#50268)
Signed-off-by: Matvei Pashkovskii <mpashkov@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-12 02:46:13 +00:00 |
|
|
Andreas Karatzas
|
23f25aac14
|
[CI] Stabilize tensor IPC multiprocessing tests (#50804)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-12 10:16:43 +08:00 |
|
|
Varun Sundar RabindranathandVarun Sundar Rabindranath
|
f067737b2a
|
[Bugfix][TieredOffloading] : Return HIT_PENDING when KV promotion is triggered (#51840)
Signed-off-by: <>
Co-authored-by: Varun Sundar Rabindranath <varun-sundar-rabindranath@h100-01.nemg-001.lab.rdu2.dc.redhat.com>
|
2026-08-12 05:07:16 +03:00 |
|
|
Aaron HaoandClaude Opus 5
|
793ca6998a
|
[Docs][RL] Rewrite weight-transfer docs; standardize examples (#51729)
Signed-off-by: haoaaron <ahao@anyscale.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-11 18:53:15 -07:00 |
|
|
Micah WilliamsonandAndreas Karatzas
|
045a986f3b
|
[ROCm][CI] Speed Up ROCm Skinny GEMM Tests (reduced parameterizations, (#51877)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-12 01:40:13 +00:00 |
|
|
|
0a94d85a66
|
[Bugfix][MRV2] Require all requests to be decoding for uniform-decode dispatch (#51865)
Signed-off-by: Rahul Chalamala <22563365+rchalamala@users.noreply.github.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Rahul Chalamala <22563365+rchalamala@users.noreply.github.com>
Co-authored-by: Janelle Cai <janelle.cai@modal.com>
|
2026-08-11 17:15:06 -07:00 |
|
|
|
1d2d83a07f
|
[Attention] Add FlashInfer XQA decode support on SM12x (#49718)
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Signed-off-by: Andrii Skliar <andreyws96@gmail.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-11 16:32:49 -07:00 |
|