 Thien Tran
|
f4e6136146
|
[Kimi-K3] Bump FlashKDA to fix unstable inverse (#54859)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-09-02 00:16:29 -07:00 |
|
|
sychen52
|
7c5dc571cb
|
[Attention][DSA] Enable W4A16 DSA (#51724)
Signed-off-by: Shiyang Chen <shiychen@nvidia.com>
|
2026-09-01 12:37:47 +08:00 |
|
|
Matthew BonanniandOpenAI Codex
|
de9250ac9e
|
[Attention] Enable masked MHA for GLM-5 head dimensions (#53785)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-27 21:17:12 +00:00 |
|
|
Matthew BonanniandOpenAI Codex
|
75dea9b4ae
|
[Bugfix] Update FlashMLA for sparse decode workspace fix (#53755)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-27 13:37:29 +00:00 |
|
|
simon-veitner-redhat
|
7156c63bef
|
[SM100] Hdim 256 optimized (#52980)
Signed-off-by: Simon Veitner <sveitner@redhat.com>
|
2026-08-25 20:28:40 -07:00 |
|
|
|
9eb9d9d395
|
[Perf] Support internal prefill checkpoints for Mamba prefix caching, 9%~25% TTFT improvement (#52789)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Ziming Huang <zelda.huanghuang@gmail.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Ziming Huang <zelda.huanghuang@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-22 10:32:40 -07:00 |
|
|
Roger Wang
|
755492e37d
|
Revert "[Kernel] Gemma-4 FA4 FP8 Kernel" (#52987)
|
2026-08-19 10:48:46 -07:00 |
|
|
Li, Jiang
|
e4d61d0d22
|
[CPU] Add AMX-only high-performance MLA backend for DeepSeek V2/V3/R1 (#52616)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
|
2026-08-19 10:28:52 +08:00 |
|
|
kiroxu
|
a18c9b56ff
|
[Kimi-K3][Perf] Update FlashKDA for automatic K2 V-split (#52458)
|
2026-08-16 18:04:38 -07:00 |
|
|
Shane Widanagama
|
d4801990a4
|
[CI/Build] Add warning for unsupported global PTX architecture requests in... (#51901)
|
2026-08-15 07:01:52 -07:00 |
|
|
|
827a2af806
|
[Kernel] Gemma-4 FA4 FP8 Kernel (#48666)
Signed-off-by: Qixiang Lin <qixiangl@nvidia.com>
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
Co-authored-by: Qixiang Lin <qixiangl@nvidia.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
|
2026-08-13 17:42:00 -07:00 |
|
|
Yongye ZhuandKimi Code
|
025d56a11e
|
[Build] Update DeepGEMM pin to deepseek-ai nv_dev tip (#52035)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Kimi Code <noreply@moonshot.ai>
|
2026-08-12 13:49:04 -07:00 |
|
|
Rehan KhanandLi, Jiang <jiang1.li@intel.com>
|
b22afe45ac
|
[CPU] Enable GPTQ and AWQ quantization for s390x (#51148)
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-08-10 11:41:43 +08:00 |
|
|
Jane (Yuan) XuandShengqi Chen
|
f8d03e7741
|
[Bugfix][Build] Patch stable string memleak fix from 2.14 for 2.13 (#51185)
Signed-off-by: Jane Xu <janeyx@meta.com>
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
|
2026-08-08 21:12:39 -07:00 |
|
|
Chris LeonardandShengqi Chen
|
41e7746b82
|
Update vllm to point to flash-attention commit that builds FA3 with torch stable API. (Retry) (#49599)
Signed-off-by: Chris Leonard <chleonar@redhat.com>
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
|
2026-08-06 08:37:46 -07:00 |
|
|
Kevin H. Luu
|
a1657a0235
|
[Bugfix][Build] Fix DeepGEMM CUDA 12.9 FP8 header visibility (#51003)
Signed-off-by: khluu <khluu000@gmail.com>
|
2026-08-04 03:06:04 -07:00 |
|
|
Thien TranandShengqi Chen
|
11f88260a2
|
[Kimi-K3] Migrate FlashKDA to PyTorch stable ABI (#50818)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
|
2026-08-03 17:18:08 -07:00 |
|
|
Li, Jiang
|
c8602c7906
|
[CPU] Refine CPU kernel dispatch (#50801)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
|
2026-08-03 17:42:53 +08:00 |
|
|
|
0a6446005d
|
[CPU] Migrate unquantized MoE to the modular-kernel experts structure (#50133)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Fadi Arafeh <fadi.arafeh@arm.com>
|
2026-08-03 14:55:04 +08:00 |
|
|
Jason Li
|
0055b8bfa3
|
[Attention][MiniMax-M3] Add MSA speculative decode verification (#50032)
|
2026-08-02 13:46:55 -07:00 |
|
|
Jane (Yuan) Xu
|
eb6453d95b
|
[Build] Update pin to build ABI stable FA2 (#50474)
|
2026-07-31 20:09:36 -07:00 |
|
|
Matthew BonanniandOpenAI Codex
|
82ae4164ee
|
[2/N][Attention] Enable masked MHA for sparse MLA prefills (#48770)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-07-31 06:01:24 -07:00 |
|
|
Rehan KhanandLi, Jiang <jiang1.li@intel.com>
|
88bc8fb56f
|
[CPU][s390x] Optimize inference perf and add oneDNN INT8 GEMM for s390x (#50219)
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-07-31 17:49:31 +08:00 |
|
|
|
6724051c57
|
[CI/Build][AMD] Install triton_kernels via CMake (#50328)
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: depthfirst-app[bot] <184448029+depthfirst-app[bot]@users.noreply.github.com>
Co-authored-by: root <root@smci355-ccs-aus-m11-05.cs-aus.dcgpu>
|
2026-07-30 22:05:19 -05:00 |
|
|
+13
|
aeeb36b1f1
|
[New model] Kimi K3 (#50000)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Ziming Huang <zelda.huanghuang@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <mozf@inferact.ai>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Summer Yang <girasoleyang@gmail.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: Bowen Wang <abmfy@icloud.com>
Co-authored-by: gnovack <novackgm@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: xiaozhoupy <peiyuanzhou1994@gmail.com>
Co-authored-by: Roy Wang <yasong.wang@inferact.ai>
Co-authored-by: Jeff (Junze) Ma <93145857+majunze2001@users.noreply.github.com>
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>
|
2026-07-30 03:49:58 -07:00 |
|
|
+12
|
7c6729b769
|
[Model] Add Kimi K3 support: model files and kernels [1/N] (#50089)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Ziming Huang <zelda.huanghuang@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <mozf@inferact.ai>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Summer Yang <girasoleyang@gmail.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: Bowen Wang <abmfy@icloud.com>
Co-authored-by: gnovack <novackgm@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: xiaozhoupy <peiyuanzhou1994@gmail.com>
Co-authored-by: Roy Wang <yasong.wang@inferact.ai>
Co-authored-by: Jeff (Junze) Ma <93145857+majunze2001@users.noreply.github.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-07-29 14:10:58 +08:00 |
|
|
Ayushman Singh
|
74587939b1
|
[Build] Fix CUDA arch detection producing kernel-less builds on SM121 (#49904)
|
2026-07-27 22:01:56 -07:00 |
|
|
Fadi ArafehandLi, Jiang <jiang1.li@intel.com>
|
c314af1abf
|
[CPU][Perf] INT8 Fused MoE Kernel for Arm CPUs (#48637)
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-07-27 05:53:09 +00:00 |
|
|
Tyler Michael SmithandOpenAI Codex
|
8c13ee5735
|
Add sm_107 for Rubin (#49387)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-07-24 11:59:49 -07:00 |
|
|
Andrey Talman
|
c79ff5f918
|
[Build] Bump vllm-flash-attn to C++20-compatible commit for torch-nightly (#49326)
Signed-off-by: Andrey Talman <atalman@fb.com>
|
2026-07-22 13:51:59 +00:00 |
|
|
rongfu.lengandYongye Zhu
|
96a739289e
|
[Bugfix] fix cutalss version upgrade bug, need update MSG new commit (#49016)
Signed-off-by: lengrongfu <lenronfu@gmail.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
|
2026-07-21 13:42:14 -07:00 |
|
|
Chris Leonard
|
97a98006b0
|
Update qutlass cmake for stable abi (#47879)
Signed-off-by: Chris Leonard <chleonar@redhat.com>
|
2026-07-20 18:31:10 -07:00 |
|
|
Matthew Bonanniandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
bd091079cb
|
[Attention] FlashAttention 4 SM100 FP8 kv cache support (#42569)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-20 10:53:27 -07:00 |
|
|
|
5c9f6557d7
|
[Hardware][CPU] Enable granite-4 model on cpu (#47641)
Signed-off-by: Akash Kaothalkar <akashkaothalkar@akashs-mbp.bl1-in.ibm.com>
Signed-off-by: Akash Kaothalkar <akashkaothalkar@dhcp-9-123-5-76.bl1-in.ibm.com>
Signed-off-by: Akash Kaothalkar <akashkaothalkar@Akashs-MBP.lan>
Signed-off-by: Akash kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akashkaothalkar@dhcp-9-123-5-76.bl1-in.ibm.com>
Co-authored-by: Akash Kaothalkar <akashkaothalkar@Akashs-MBP.lan>
Co-authored-by: Akash Kaothalkar <akashkaothalkar@akashs-mbp.bl1-in.ibm.com>
Co-authored-by: Akash kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-07-20 06:15:16 +00:00 |
|
|
Michael Goin
|
c7ce03bcbd
|
[Bugfix] Bump tml-fa4 for cutlass-dsl 4.6 API compatibility (#48988)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-07-18 05:59:33 -07:00 |
|
|
Artem PerevedentsevandMatthew Bonanni
|
7cd1d57b74
|
[CI/Build][Docker] Bump nvidia-cutlass-dsl to 4.6.0 and drop packaging workarounds (#47442)
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-07-16 13:51:41 +00:00 |
|
|
|
6570c9800c
|
[Model] Add Inkling model support [1/N] (#48799)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Giancarlo Delfin <32987265+TheEpicDolphin@users.noreply.github.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <mozf@inferact.ai>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-07-15 23:40:07 -07:00 |
|
|
Jane (Yuan) XuandShengqi Chen
|
37aa52821d
|
Build with ABI stable FlashMLA (#48174)
Signed-off-by: Jane Xu <janeyx@meta.com>
Signed-off-by: Shengqi Chen <i@harrychen.xyz>
Co-authored-by: Shengqi Chen <i@harrychen.xyz>
|
2026-07-14 20:29:28 -07:00 |
|
|
Lucas Wilkinson
|
bec0a4ede6
|
[Revert] [Build] Update vllm ...builds FA3 with torch stable API (#48269)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
|
2026-07-11 05:20:25 +00:00 |
|
|
Matthew BonanniandClaude
|
735def4fcf
|
[Bugfix] Fix FlashMLA dense fp8 metadata crash (num_sm_parts clamp) (#48045)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-10 12:24:52 -07:00 |
|
|
Chris Leonard
|
8347c6e6e1
|
updated flash_attn GIT_TAG to point to torch Stable ABI FA3 commit (#47995)
Signed-off-by: Chris Leonard <chleonar@redhat.com>
|
2026-07-08 10:56:29 -07:00 |
|
|
Yongye ZhuandClaude Opus 4.8
|
9021589498
|
[Minimax-M3] Using tok_sparse_select from MSA instead of triton kernels (#47502)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-07 21:01:12 -07:00 |
|
|
velonica0
|
990c2a0187
|
[RISC-V] Enable BF16 on VLEN=256 hardware (#45243)
Signed-off-by: velonica0 <like@mail.nankai.edu.cn>
|
2026-07-06 06:05:16 +00:00 |
|
|
LiuTongandClaude
|
16f8110935
|
[Bugfix][CPU][RISC-V] Fix VLEN detection for RVV attention path (#47532)
Signed-off-by: liutong <liutong@iscas.ac.cn>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-06 05:58:03 +00:00 |
|
|
Evgeny Parshutin
|
bd8d9021ce
|
[CPU][Build] Enable oneDNN ITT task collection by default for CPU primitive-level profiling (#47467)
Signed-off-by: Evgeny Parshutin <eugeny.parshutin@intel.com>
|
2026-07-03 04:00:19 +00:00 |
|
|
Michael Goin
|
84b9c2762f
|
Update DeepGEMM tag to point to latest nv-dev branch for sm120 support (#47304)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-07-02 18:33:44 +08:00 |
|
|
almayneandLi, Jiang <jiang1.li@intel.com>
|
89e99202f2
|
[CPU][Perf]Added tanh AOR for faster gelu activations. (#44639)
Signed-off-by: Anna Mayne <anna.mayne@arm.com>
Signed-off-by: almayne <anna.mayne@arm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-06-30 23:24:40 -07:00 |
|
|
Roberto L. CastroandLucas Wilkinson
|
248d1fbb71
|
[Feat][1/N] CuTeDSL warmup infrastructure, FA4 MLA (#46182)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
|
2026-06-30 12:17:34 -07:00 |
|
|
Chris Leonard
|
d0f800811b
|
[Build] Update vllm to point to vllm-project/flash-attention commit that builds FA3 with torch stable API. (#46644)
|
2026-06-26 19:42:46 -07:00 |
|
|
Michael GoinandClaude Opus 4.8
|
c6554f321c
|
[CPU] Fix macOS/Apple Silicon hang by enabling OpenMP in the build (#46769)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-26 14:32:21 -04:00 |
|