 aoshen02
|
4eef91c03c
|
[Model] Support R3 capture with DeepGEMM MegaMoE (#51831)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
|
2026-08-12 01:07:07 -07:00 |
|
|
Xin Yang
|
10b7766a90
|
[Attention] Move context_lens_tensor compute into GDN prefill path (#51913)
Signed-off-by: Xin Yang <xyangx@amazon.com>
|
2026-08-12 15:35:44 +08:00 |
|
|
Kunshang Ji
|
10f9b5d74f
|
[CI/Release][XPU] fix workdir path for triton shim job (#51923)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-12 14:41:29 +08:00 |
|
|
Matej SirovatkaandJee Jee Li
|
3ac9525507
|
[Bugfix][Quantization] Reuse online NVFP4 MoE kernel across reloads (#50074)
Signed-off-by: S1ro1 <matej.sirovatka@gmail.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-08-12 14:06:53 +08:00 |
|
|
Lucas WilkinsonandOpenAI Codex
|
02ac17851d
|
[Refactor][MRV2] Unify uniform decode token count helper (#51917)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-12 05:58:43 +00:00 |
|
|
aoshen02andCodex
|
f2906b492e
|
[Bugfix] Avoid repeated layerwise reload warning scans (#49505)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Codex <noreply@openai.com>
|
2026-08-12 13:53:50 +08:00 |
|
|
Vinay R DamodaranandClaude Opus 5
|
3ee2df3033
|
[Frontend] Make model optional on all /derender request classes (#51463)
Signed-off-by: Vinay Damodaran <vrdn@hey.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-12 04:48:58 +00:00 |
|
|
xiangdong
|
a53ad85913
|
[XPU][CI]Change to use global VLLM_DISABLE_COMPILE_CACHE=1 in Intel GPU CI (#51905)
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
|
2026-08-12 12:30:41 +08:00 |
|
|
|
3962042304
|
[Bugfix][V1][Multimodal] Recover from P0/P1 processor cache drift (#46747) (#46747)
Signed-off-by: William Zhao <williamzh@meta.com>
Signed-off-by: WillZZZy <93454470+WillZZZy@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-12 12:06:57 +08:00 |
|
|
Kunshang JiandGitHub Copilot
|
f4e9bb01de
|
[CI/Release][1/N][XPU] Publish XPU Triton shim index (#51759)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: GitHub Copilot <copilot@github.com>
|
2026-08-12 11:45:06 +08:00 |
|
|
|
7f9173dfa2
|
[ROCm][Perf] Kimi-K3 Fused kernel for KDA decode (#50654)
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
|
2026-08-11 20:39:34 -07:00 |
|
|
Max HuandMax Hu
|
d462dee37d
|
[Bugfix][Triton] Make fp8_min/fp8_max constexpr in _quantize_pad_fp8_kernel (#51872)
Signed-off-by: Max Hu <maxhu@nvidia.com>
Co-authored-by: Max Hu <maxhu@nvidia.com>
|
2026-08-12 03:09:54 +00:00 |
|
|
Stellar鱼
|
3fa89225bc
|
[CI/Build] Use file rendezvous for local distributed tests (#51652)
Signed-off-by: yu-xin-c <2182712990@qq.com>
|
2026-08-12 10:48:12 +08:00 |
|
|
Matvei PashkovskiiandClaude
|
20727e2841
|
[Hardware][AMD] Enable fused bf16→fp32 router GEMM on ROCm (#50268)
Signed-off-by: Matvei Pashkovskii <mpashkov@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-12 02:46:13 +00:00 |
|
|
Nick Hill
|
f97e502969
|
[Perf] Avoid more GPU<->CPU syncs on the model execution path (#51738)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-11 19:30:34 -07:00 |
|
|
Andreas Karatzas
|
23f25aac14
|
[CI] Stabilize tensor IPC multiprocessing tests (#50804)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-12 10:16:43 +08:00 |
|
|
Varun Sundar RabindranathandVarun Sundar Rabindranath
|
f067737b2a
|
[Bugfix][TieredOffloading] : Return HIT_PENDING when KV promotion is triggered (#51840)
Signed-off-by: <>
Co-authored-by: Varun Sundar Rabindranath <varun-sundar-rabindranath@h100-01.nemg-001.lab.rdu2.dc.redhat.com>
|
2026-08-12 05:07:16 +03:00 |
|
|
Aaron HaoandClaude Opus 5
|
793ca6998a
|
[Docs][RL] Rewrite weight-transfer docs; standardize examples (#51729)
Signed-off-by: haoaaron <ahao@anyscale.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-11 18:53:15 -07:00 |
|
|
Louie Tsai
|
9b3382685e
|
[Tools] vLLM Recipes conversion : support different data types variants and strategies (#51878)
Signed-off-by: louie-tsai <louie.tsai@intel.com>
|
2026-08-12 01:42:08 +00:00 |
|
|
Micah WilliamsonandAndreas Karatzas
|
045a986f3b
|
[ROCm][CI] Speed Up ROCm Skinny GEMM Tests (reduced parameterizations, (#51877)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-12 01:40:13 +00:00 |
|
|
Simon Danielsson
|
47ececb58e
|
[Perf][ROCm] Dual-stream decode with hipgraphs (#48223)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-08-12 09:32:24 +08:00 |
|
|
PikaPikachu
|
466855a2bf
|
[ROCm] Enable DeepSeek-V4 on gfx11 (#47017)
This PR enables DeepSeek-V4 checkpoints on ROCm gfx11/RDNA devices.
Signed-off-by: Letian Kang <Letian.Kang@amd.com>
|
2026-08-12 08:55:10 +08:00 |
|
|
|
0a94d85a66
|
[Bugfix][MRV2] Require all requests to be decoding for uniform-decode dispatch (#51865)
Signed-off-by: Rahul Chalamala <22563365+rchalamala@users.noreply.github.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Rahul Chalamala <22563365+rchalamala@users.noreply.github.com>
Co-authored-by: Janelle Cai <janelle.cai@modal.com>
|
2026-08-11 17:15:06 -07:00 |
|
|
|
1d2d83a07f
|
[Attention] Add FlashInfer XQA decode support on SM12x (#49718)
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Signed-off-by: Andrii Skliar <andreyws96@gmail.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-11 16:32:49 -07:00 |
|
|
鐘天楽
|
a367cdbca0
|
[Profiler] Add minimal Triton Proton profiling backend (#48789)
Signed-off-by: Luossu <zhluosuu@outlook.com>
|
2026-08-11 14:51:57 -07:00 |
|
|
Lucas WilkinsonandClaude
|
61874f9842
|
[4/N][KV-Cache Layout Refactor] Promote local KV cache specs via a class-changing replace helper (#51612)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-11 17:29:29 -04:00 |
|
|
Richard Zou
|
cb30f6f8dd
|
[Testing] Fix test_sharded_state_loader (#51736)
Signed-off-by: Richard Zou <zou3519@gmail.com>
|
2026-08-11 21:16:09 +00:00 |
|
|
stefankoncarevic
|
3e372c5ff2
|
[Bugfix][ROCm] Give KV-first attention blocks their own page in hybrid models (#51837)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
|
2026-08-11 16:52:30 -04:00 |
|
|
Rohan PotdarandClaude Opus 4.8
|
0f0cb918b7
|
[ROCm][MoE] Fix expert_map vs AITER expert_mask for non-AITER experts under EP (#49758)
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-08-11 15:33:02 -05:00 |
|
|
Andreas Karatzasandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
36f4630d89
|
[Bugfix][MoE] Fix fused block-scale orientation (#50727)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-11 16:05:38 -04:00 |
|
|
Wentao Ye
|
fd04edef3e
|
[Refactor] Delete dead code in models (#51838)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-11 15:44:26 -04:00 |
|
|
Michael Goin
|
ded6c452c3
|
[Bugfix] Support HF-config compat for Inkling (#51850)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-11 15:32:28 -04:00 |
|
|
Harry MellorandAndreas Karatzas
|
b2ab096017
|
[Docs] Fix broken autorefs cross-reference in TurboQuant v2 docstring (#51857)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-11 12:22:56 -07:00 |
|
|
Andreas Karatzas
|
cc668c5b72
|
[CI][Bugfix][V1] Remove stale FlashAttention metadata arguments (#51854)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-11 18:54:56 +00:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
1ab2801dde
|
[ROCm] Remove stale SDPA and skinny GEMM workarounds (#50907)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-11 14:19:16 -04:00 |
|
|
|
4f2f31b82e
|
[Bugfix][Attention] Forward per-head FP8 descales through FA4 (#51363)
Signed-off-by: yiliu30 <yi4.liu@intel.com>
Signed-off-by: Yi Liu <yi4.liu@intel.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-08-11 14:05:20 -04:00 |
|
|
Julien Debache
|
52be12cfac
|
feat: allow shared expert overlapping for FlashInfer one-sided all-to-all (#50569)
Signed-off-by: jdebache <jdebache@nvidia.com>
|
2026-08-11 10:06:22 -07:00 |
|
|
Harry Mellor
|
9cc347ae42
|
Enable MiniCPMV for vLLM in CI (#45042)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-11 16:30:39 +00:00 |
|
|
Taneem IbrahimandWentao Ye
|
ca9c8cbd1b
|
[CI] Support partial torch requirement contexts (#51832)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-08-11 12:25:14 -04:00 |
|
|
Michael Goinandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
e3fe212eaf
|
[Bugfix] Generalize KV block zeroing to AttentionSpec (#51749)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-11 12:13:09 -04:00 |
|
|
Nick Hill
|
513f83e7ec
|
[Bugfix] Take the sliding window from the layer, not the KV cache group (#51756)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-11 09:10:46 -07:00 |
|
|
Harry Mellor
|
c65aa2ee6c
|
Bump Transformers version to 5.15.0 (#51668)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-11 09:00:51 -07:00 |
|
|
Guan-Ming Chiuandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
457a5f34db
|
[Bugfix][MRV2] Support encoder timing stats in model runner V2 (#50020)
Signed-off-by: Guan-Ming (Wesley) Chiu <105915352+guan404ming@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-12 00:00:49 +08:00 |
|
|
|
5426311d91
|
[Kernel][ROCm][Perf] FlyDSL decode-attention kernel for 4-bit TurboQuant KV cache (#47896)
Signed-off-by: root <root@smci355-ccs-aus-m02-09.cs-aus.dcgpu>
Co-authored-by: root <root@smci355-ccs-aus-m02-09.cs-aus.dcgpu>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-11 08:45:39 -07:00 |
|
|
liuzhenweiandKunshang Ji
|
d648236199
|
[XPU][CI] Fix ExampleConnector KV cache device selection (#51806)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-11 23:40:29 +08:00 |
|
|
Jiangyun ZhuandOpenAI Codex
|
5af7c8dad7
|
[Bugfix] Align Qwen GDN gates with speculative tokens (#51812)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-11 23:35:30 +08:00 |
|
|
pmanczakandKunshang Ji
|
5b5eae2394
|
[Misc] Enable test_silu_mul_fp8_quant_deep_gemm on XPU (#49444)
Signed-off-by: pmanczak <pawel.manczak@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-11 23:19:14 +08:00 |
|
|
Wentao Ye
|
4988df2eb8
|
[Config] Update default _max_num_batched_tokens from 8192 to 16384 (#51726)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-11 11:09:34 -04:00 |
|
|
|
0fb9897df1
|
[Bugfix][MoE] Support GELU tanh in FlashInfer B12x MoE (#51819)
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-11 15:07:58 +00:00 |
|
|
Woosuk KwonandOpenAI Codex
|
87668ab69b
|
[Bugfix] Guard DeepSeek V4 MRV1 piecewise CUDA graphs (#51768)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-11 07:34:44 -07:00 |
|