|
1d2d83a07f
|
[Attention] Add FlashInfer XQA decode support on SM12x (#49718)
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Signed-off-by: Andrii Skliar <andreyws96@gmail.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-11 16:32:49 -07:00 |
|
|
鐘天楽
|
a367cdbca0
|
[Profiler] Add minimal Triton Proton profiling backend (#48789)
Signed-off-by: Luossu <zhluosuu@outlook.com>
|
2026-08-11 14:51:57 -07:00 |
|
|
Lucas WilkinsonandClaude
|
61874f9842
|
[4/N][KV-Cache Layout Refactor] Promote local KV cache specs via a class-changing replace helper (#51612)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-11 17:29:29 -04:00 |
|
|
Richard Zou
|
cb30f6f8dd
|
[Testing] Fix test_sharded_state_loader (#51736)
Signed-off-by: Richard Zou <zou3519@gmail.com>
|
2026-08-11 21:16:09 +00:00 |
|
|
stefankoncarevic
|
3e372c5ff2
|
[Bugfix][ROCm] Give KV-first attention blocks their own page in hybrid models (#51837)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
|
2026-08-11 16:52:30 -04:00 |
|
|
Rohan PotdarandClaude Opus 4.8
|
0f0cb918b7
|
[ROCm][MoE] Fix expert_map vs AITER expert_mask for non-AITER experts under EP (#49758)
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-08-11 15:33:02 -05:00 |
|
|
Andreas Karatzasandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
36f4630d89
|
[Bugfix][MoE] Fix fused block-scale orientation (#50727)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-11 16:05:38 -04:00 |
|
|
Wentao Ye
|
fd04edef3e
|
[Refactor] Delete dead code in models (#51838)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-11 15:44:26 -04:00 |
|
|
Michael Goin
|
ded6c452c3
|
[Bugfix] Support HF-config compat for Inkling (#51850)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-11 15:32:28 -04:00 |
|
|
Harry MellorandAndreas Karatzas
|
b2ab096017
|
[Docs] Fix broken autorefs cross-reference in TurboQuant v2 docstring (#51857)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-11 12:22:56 -07:00 |
|
|
Andreas Karatzas
|
cc668c5b72
|
[CI][Bugfix][V1] Remove stale FlashAttention metadata arguments (#51854)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-11 18:54:56 +00:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
1ab2801dde
|
[ROCm] Remove stale SDPA and skinny GEMM workarounds (#50907)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-11 14:19:16 -04:00 |
|
|
|
4f2f31b82e
|
[Bugfix][Attention] Forward per-head FP8 descales through FA4 (#51363)
Signed-off-by: yiliu30 <yi4.liu@intel.com>
Signed-off-by: Yi Liu <yi4.liu@intel.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-08-11 14:05:20 -04:00 |
|
|
Julien Debache
|
52be12cfac
|
feat: allow shared expert overlapping for FlashInfer one-sided all-to-all (#50569)
Signed-off-by: jdebache <jdebache@nvidia.com>
|
2026-08-11 10:06:22 -07:00 |
|
|
Harry Mellor
|
9cc347ae42
|
Enable MiniCPMV for vLLM in CI (#45042)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-11 16:30:39 +00:00 |
|
|
Taneem IbrahimandWentao Ye
|
ca9c8cbd1b
|
[CI] Support partial torch requirement contexts (#51832)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-08-11 12:25:14 -04:00 |
|
|
Michael Goinandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
e3fe212eaf
|
[Bugfix] Generalize KV block zeroing to AttentionSpec (#51749)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-11 12:13:09 -04:00 |
|
|
Nick Hill
|
513f83e7ec
|
[Bugfix] Take the sliding window from the layer, not the KV cache group (#51756)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-11 09:10:46 -07:00 |
|
|
Harry Mellor
|
c65aa2ee6c
|
Bump Transformers version to 5.15.0 (#51668)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-11 09:00:51 -07:00 |
|
|
Guan-Ming Chiuandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
457a5f34db
|
[Bugfix][MRV2] Support encoder timing stats in model runner V2 (#50020)
Signed-off-by: Guan-Ming (Wesley) Chiu <105915352+guan404ming@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-12 00:00:49 +08:00 |
|
|
|
5426311d91
|
[Kernel][ROCm][Perf] FlyDSL decode-attention kernel for 4-bit TurboQuant KV cache (#47896)
Signed-off-by: root <root@smci355-ccs-aus-m02-09.cs-aus.dcgpu>
Co-authored-by: root <root@smci355-ccs-aus-m02-09.cs-aus.dcgpu>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-11 08:45:39 -07:00 |
|
|
liuzhenweiandKunshang Ji
|
d648236199
|
[XPU][CI] Fix ExampleConnector KV cache device selection (#51806)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-11 23:40:29 +08:00 |
|
|
Jiangyun ZhuandOpenAI Codex
|
5af7c8dad7
|
[Bugfix] Align Qwen GDN gates with speculative tokens (#51812)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-11 23:35:30 +08:00 |
|
|
pmanczakandKunshang Ji
|
5b5eae2394
|
[Misc] Enable test_silu_mul_fp8_quant_deep_gemm on XPU (#49444)
Signed-off-by: pmanczak <pawel.manczak@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-11 23:19:14 +08:00 |
|
|
Wentao Ye
|
4988df2eb8
|
[Config] Update default _max_num_batched_tokens from 8192 to 16384 (#51726)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-11 11:09:34 -04:00 |
|
|
|
0fb9897df1
|
[Bugfix][MoE] Support GELU tanh in FlashInfer B12x MoE (#51819)
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-11 15:07:58 +00:00 |
|
|
Woosuk KwonandOpenAI Codex
|
87668ab69b
|
[Bugfix] Guard DeepSeek V4 MRV1 piecewise CUDA graphs (#51768)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-11 07:34:44 -07:00 |
|
|
Jee Jee Li
|
dd7cc85f17
|
Add MoE output contract for MoE tail fusion (#51407)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-08-11 22:23:59 +08:00 |
|
|
Tuukka Sarvi
|
12bea3eedc
|
[Bugfix][ROCm] Fix DeepSeek V4 DSpark probabilistic startup (#51145)
Signed-off-by: Tuukka Sarvi <tuukka.sarvi@amd.com>
|
2026-08-11 22:15:31 +08:00 |
|
|
|
b64a2708b0
|
Bound generation inputs before expensive work (#51447)
Signed-off-by: Clinton Thomas <1033162+KernelClint@users.noreply.github.com>
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-11 22:03:50 +08:00 |
|
|
Louie Tsai
|
5b184f775a
|
connects vLLM Recipes with vLLM's native config-based deployment and benchmark (#51308)
Signed-off-by: louie-tsai <louie.tsai@intel.com>
|
2026-08-11 13:53:51 +00:00 |
|
|
Chaojun Zhang
|
f863387250
|
[XPU] Fix UVA weight offloading (non-pinned-tensor views and static Triton launcher) (#51770)
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
|
2026-08-11 21:48:44 +08:00 |
|
|
Kush Zingade
|
78e7fdd1ab
|
[Bugfix][CPU] Make the Apple Silicon BF16 probe fall back instead of raising (#51627)
Signed-off-by: Kush Zingade <kush.zingade@gmail.com>
|
2026-08-11 21:35:07 +08:00 |
|
|
|
6c95a641e9
|
[2/N][Feat][Perf] Add new warmup infrastructure for JITs. Add predicate filtering for JIT warmup, and migrate Inkling FA4 (#49315)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-11 07:46:07 -04:00 |
|
|
liushujia122
|
d8f840071e
|
[Model] Enable tower and connector LoRA for Keye (#51780)
Signed-off-by: shujialiu <liushujia0122@163.com>
|
2026-08-11 10:35:59 +00:00 |
|
|
AlexHuang
|
0fec3d652b
|
[Bugfix][KV Offload] Centralize shared mmap cleanup in CPU worker (#51622)
Signed-off-by: Alex <jihui.huang@daocloud.io>
|
2026-08-11 13:22:15 +03:00 |
|
|
Dao007foreverandOpenAI Codex
|
ce07118669
|
[Bugfix][Core] Preserve Mamba running CoW after external hits (#51766)
Signed-off-by: Dao Le <Dao007forever@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-11 18:15:24 +08:00 |
|
|
David Holtz
|
490259c1f6
|
profiler: add PrivateUse1 activity support for custom backends (#50977)
Signed-off-by: David Holtz <56723830+dmholtz@users.noreply.github.com>
|
2026-08-11 09:38:58 +00:00 |
|
|
Tianyu GuoandOpenAI Codex
|
3fb7bb46d6
|
[Perf] Avoid repeated multimodal prompt update scans (#51774)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-11 09:23:24 +00:00 |
|
|
zofiaandKunshang Ji
|
52c70b210c
|
[XPU] [Linear] enable torch linear backend for blockwise gemm on xpu (#50826)
Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-11 16:43:33 +08:00 |
|
|
Kyungmin LeeandHarry Mellor
|
529d010351
|
[Doc] Fix typos in speculative decoding docs (#51500)
Signed-off-by: lkm2835 <lkm2835@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-11 09:17:05 +01:00 |
|
|
Yizhou
|
a311916a29
|
[MRV2][Spec] Fuse AR speculator multi-step decodes back into one CUDA graph (#46849)
Signed-off-by: Yizhou Liu <liu_yizhou@outlook.com>
|
2026-08-11 15:06:22 +08:00 |
|
|
Fangzhou Ai
|
1044d19998
|
[ROCm][DSV4] Preserve native MXFP4 TP8 shard allocation (#51473)
Signed-off-by: Fangzhou Ai <fangzhou.ai@amd.com>
|
2026-08-10 23:57:27 -07:00 |
|
|
Harry Mellor
|
be2e274ef5
|
Fix docs on main (#51773)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-10 23:52:04 -07:00 |
|
|
Priyansh JainandAndreas Karatzas
|
2acb055ed7
|
[CPU][Zen] Route BF16 MoE inference through zentorch on AMD (#44201)
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-10 23:20:05 -07:00 |
|
|
Yan MaandKunshang Ji
|
b76cf758db
|
[XPU] install xpu-manager for device monitor (#50831)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-11 14:18:41 +08:00 |
|
|
stefankoncarevicandAndreas Karatzas
|
75903e5067
|
[CI][AMD] Persist the openai-harmony tiktoken vocab cache across jobs (#51666)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-11 06:11:06 +00:00 |
|
|
Wei Zhao
|
608c12473f
|
[Attention] Fix MLA prefill workspace allocation size (#51733)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
|
2026-08-11 05:34:30 +00:00 |
|
|
|
c76a425278
|
[Kernel] Optimize long-context MLA cache gathers (#51739)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-10 22:23:43 -07:00 |
|
|
cherry77-cloudandOpenAI Codex
|
65b7662d3f
|
[Bugfix][Frontend] Report Cohere stop sequences correctly (#51556)
Signed-off-by: cherry77-cloud <1615405@qq.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-11 04:49:49 +00:00 |
|