 Luke AlonsoandLucas Wilkinson
|
0d4ad47981
|
[Kernel] Add B12X causal paged attention backend (#52017)
Signed-off-by: Luke Alonso <lalonso@gmail.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
|
2026-09-01 10:42:02 -04:00 |
|
|
simon-veitner-redhat
|
7156c63bef
|
[SM100] Hdim 256 optimized (#52980)
Signed-off-by: Simon Veitner <sveitner@redhat.com>
|
2026-08-25 20:28:40 -07:00 |
|
|
Cyrus Leung
|
0b19ebcacd
|
[MM] Simplify _apply_hf_processor_main (#53275)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-08-22 01:49:37 -07:00 |
|
|
QWERQWERQWE86
|
58302b4591
|
[Doc] Fix group numbering in Case 3 of hybrid_kv_cache_manager.md (#52160)
Signed-off-by: qwerqwerqwe8688-jpg <xuuuuu2021@163.com>
|
2026-08-19 11:38:34 +00:00 |
|
|
wang.yuqi
|
eac636a7fa
|
[Frontend] Move api_server.py out openai folder (#52131)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-19 09:43:46 +00:00 |
|
|
Bo Liandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
c296851a7d
|
[MoE] Refine FlashInfer one-sided All2All integration (#51924)
Signed-off-by: Bo Li <22713281+bobboli@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-18 00:18:14 +00:00 |
|
|
Shanshan ShenandAndreas Karatzas
|
0ad04cff1b
|
[ROCm][CI] Enable ViT CUDA graph tests on AMD gfx950 GPUs (#52256)
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-17 09:52:02 +08:00 |
|
|
Yizhou
|
a311916a29
|
[MRV2][Spec] Fuse AR speculator multi-step decodes back into one CUDA graph (#46849)
Signed-off-by: Yizhou Liu <liu_yizhou@outlook.com>
|
2026-08-11 15:06:22 +08:00 |
|
|
Khushali Desaiandwang.yuqi
|
dc5101fb1b
|
replace batch_norm to numerically identical without cudnn (#51734)
Signed-off-by: khushali9 <khushali.desai9@gmail.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-11 12:43:20 +08:00 |
|
|
wang.yuqiandCyrus Leung
|
2fa490470d
|
[Model] Fused mm preprocess normalisation on the Device (#50411)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
|
2026-08-06 03:11:14 -07:00 |
|
|
Qiuyang Yue
|
777b01d1a8
|
[MM][CG] Support ViT full CUDA graph for Ernie-4.5-VL image inference (#45254)
Signed-off-by: Qiuyang Yue <yueqiuyang1389@gmail.com>
|
2026-08-06 05:04:19 +00:00 |
|
|
Harry MellorandClaude Opus 5
|
1eb3694521
|
[Docs] Fix two docs build warnings (#51014)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-04 05:29:04 -07:00 |
|
|
wangxiyuan
|
dd11df04f3
|
[Misc] Remove deprecated calculate_kv_scales runtime KV scale calculation (#49389)
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
|
2026-08-03 11:15:13 -04:00 |
|
|
|
0a6446005d
|
[CPU] Migrate unquantized MoE to the modular-kernel experts structure (#50133)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Fadi Arafeh <fadi.arafeh@arm.com>
|
2026-08-03 14:55:04 +08:00 |
|
|
Isotr0pyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
e2fa28594f
|
[1/N] Unify multiple-path encoder cuda graph support (#49934)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-02 10:33:23 +08:00 |
|
|
bnellnm
|
c67fe497a2
|
[Bugfix][Doc] Fix references to FusedMoE in doc (#50701)
Signed-off-by: Bill Nell <bnell@redhat.com>
|
2026-08-02 09:13:06 +08:00 |
|
|
nvbfalk
|
60915c972c
|
[Feature] Add VidCom2 video token pruning (#47750)
Signed-off-by: Benedikt Falk <bfalk@nvidia.com>
|
2026-07-28 03:20:17 +00:00 |
|
|
Matthew Bonanniandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
bf2b45b5d6
|
[Attention] Integrate FlashAttention 4 SM100 headdim 256 support (#42669)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-07-27 18:25:50 +00:00 |
|
|
anthonsuandLinkun Chen
|
70009fb934
|
[MM][CG] Support ViT CUDA Graph for Gemma-4 (#46837)
Signed-off-by: Anthony Su <xsuanthony@gmail.com>
Co-authored-by: Linkun Chen <github@lkchen.net>
|
2026-07-25 15:02:09 -05:00 |
|
|
Harry Mellor
|
3e74c60b9c
|
[Docs] Use gen-files for generated docs content (#49587)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-25 14:43:21 +00:00 |
|
|
Harry Mellor
|
84d26b9ee3
|
[Model] Remove Plamo2 (#49729)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-24 13:54:24 -07:00 |
|
|
Nicolò Lucchesiandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
589a5b884b
|
[PD][NixlPush][Bugfix] Fix blocking handshake call on writer thread (#49221)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-24 01:41:37 -07:00 |
|
|
Euisuh Jeong
|
da54a5bf05
|
[Docs] Fix broken anchor links in serving/pooling/MoE docs (#49654)
Signed-off-by: euisuh <euisuh.jeong@gmail.com>
|
2026-07-24 02:42:56 +00:00 |
|
|
Matthew Bonanniandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
bd091079cb
|
[Attention] FlashAttention 4 SM100 FP8 kv cache support (#42569)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-20 10:53:27 -07:00 |
|
|
Lena OnyshchenkoandCursor
|
47d0597ca2
|
[Misc][Docs] Fix broken csrc kernel links in fusions doc (#47211)
Signed-off-by: oonyshch <xonyshch@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-07-20 09:44:25 +00:00 |
|
|
Julien DenizeandNicolò Lucchesi
|
ce4bdcbda4
|
[Bugfix] Enable FlashAttention MLA prefill for Mistral Small 4 head dims (#48855)
Signed-off-by: juliendenize <julien.denize@mistral.ai>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
|
2026-07-17 18:07:00 +08:00 |
|
|
Matthew Bonanni
|
313d01f507
|
[CI][Bugfix] Fix FlashAttention reported MLA dimension support (#48631)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-07-14 21:33:02 +00:00 |
|
|
tomerg-nvidiaandNickLucche
|
7a74a9662b
|
[NIXL] Avoid reading expired blocks in bidirectional turn-2 read (#47021)
Signed-off-by: Tomer Gilad <tgilad@nvidia.com>
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-07-14 13:03:41 +00:00 |
|
|
Matthew BonanniandClaude Opus 4.8
|
c4f5cd60da
|
[1/N] Add dense MHA path for sparse MLA short sequences (#47327)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-07-14 00:29:56 +00:00 |
|
|
Pavani MajetyandJingyi Yang
|
7fc97042c3
|
Add DCP + Eagle support for Tokenspeed MLA backends (#48180)
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
Signed-off-by: Jingyi Yang <girasoleyang@gmail.com>
Co-authored-by: Jingyi Yang <girasoleyang@gmail.com>
|
2026-07-13 11:46:02 -07:00 |
|
|
Martin Hickey
|
f7fc0ca993
|
[Frontend] Add endpoint plugins framework (#47454)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
|
2026-07-08 10:00:41 +08:00 |
|
|
|
cbb5f045be
|
[ROCm][CI] Refresh ROCm base images when docker rocm_base changes (#46904)
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: Codex <codex@example.invalid>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Rohan138 <rohanpotdar138@gmail.com>
Co-authored-by: Codex <codex@example.invalid>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
|
2026-07-07 03:10:50 -07:00 |
|
|
Cheng Jiangandchengvjiang
|
95a248faed
|
[Attention Backend] HPC_ATTN backend support mtp and dynamic scheduled attention (#47433)
Signed-off-by: chengvjiang <chengvjiang@tencent.com>
Co-authored-by: chengvjiang <chengvjiang@tencent.com>
|
2026-07-05 18:18:25 -07:00 |
|
|
Dan BlanaruandMatthew Bonanni
|
d29125c085
|
Xqa decode kernels (#43232)
Signed-off-by: Dan Blanaru <48605845+DanBlanaru@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-07-02 12:32:05 -07:00 |
|
|
xaguilar-amd
|
09663abde0
|
[ROCm][MLA] Fuse MLA q/kv RMSNorm + FP8 per-token quant in the FP8 attention path (#44977)
Signed-off-by: Xavier Aguilar <xavier.aguilarfruto@amd.com>
Signed-off-by: Xavier Aguilar <Xavier.AguilarFruto@amd.com>
|
2026-07-02 13:00:41 +08:00 |
|
|
|
c5200d3565
|
[Attention][DSA] support dcp for FLASHINFER_MLA_SPARSE (#46076)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Jingyi Yang <girasoleyang@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: GirasoleY <girasoleyang@gmail.com>
Co-authored-by: Jingyi Yang <girasoleyang@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-01 00:32:20 -04:00 |
|
|
|
8cf7c4d8ad
|
[Attention Backend] add HPC-Ops Attention backend (#46020)
Signed-off-by: chengvjiang <chengvjiang@tencent.com>
Co-authored-by: chengvjiang <chengvjiang@tencent.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-06-30 18:17:43 +08:00 |
|
|
Woosuk Kwon
|
a309d4fe60
|
Support DCP with FlashInfer MLA (#43729)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-06-29 13:24:29 -07:00 |
|
|
Harry Mellor
|
f6bb8682ee
|
Fix docs on main (#47009)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-06-29 15:50:57 +08:00 |
|
|
SoyaazzandIsotr0py
|
4559c43a95
|
[MM][CG] Gemma3 Encoder CUDA Graph (#43591)
Signed-off-by: JisoLya <523420504@qq.com>
Signed-off-by: Soyaazz <523420504@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
|
2026-06-29 04:52:00 +00:00 |
|
|
Shanshan ShenandIsotr0py
|
35e6c86caa
|
[Bugfix][MM][CG] Enable dual-path ViT CUDA graph for Step3-VL (#46034)
Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
|
2026-06-28 00:06:43 -07:00 |
|
|
|
ddd3855a28
|
[MoE Backend] add HPC-Ops MoE backend (#45924)
Signed-off-by: chengvjiang <chengvjiang@tencent.com>
Co-authored-by: chengvjiang <chengvjiang@tencent.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
|
2026-06-27 11:18:07 +08:00 |
|
|
Micah WilliamsonandRohan138
|
d980a3cc6e
|
[ROCm] Fix AITER_UNIFIED_ATTN Dispatching After AITER Bump (#46780)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Co-authored-by: Rohan138 <rohanpotdar138@gmail.com>
|
2026-06-26 02:09:56 -07:00 |
|
|
wang.yuqi
|
5e3dad04b1
|
[Misc] Move the legacy api_server.py to the examples directory. (#46783)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-06-26 07:43:29 +00:00 |
|
|
guybdandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2396d91e93
|
[CPU][Spec Decode] Enable DFlash SD for CPU (#44029)
Signed-off-by: guybd <guy.boudoukh@intel.com>
Signed-off-by: Guy Boudoukh <guy.boudoukh@intel.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-25 15:32:48 +08:00 |
|
|
Ashwin PhadkeandHarry Mellor
|
d511b5bae9
|
Chore: Fix minor doc sentence, grammar, quote errors (#40469)
Signed-off-by: Ashwin Phadke <23502062+ashwin-phadke@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-06-24 18:58:24 +00:00 |
|
|
Nemani Harsha Vardhan
|
7dc036058b
|
[Doc] Document Qwen3.6 (dense + MoE) ViT CUDA graph support (#44720)
Signed-off-by: harsha20032020 <nhvardhan2020@gmail.com>
|
2026-06-24 14:35:08 +00:00 |
|
|
JartXandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
70749fdcca
|
[Feature] Triton INT4 per-token-head KV cache quantization (#40835)
Signed-off-by: JartX <sagformas@epdcenter.es>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-24 10:21:25 +00:00 |
|
|
Dakai An
|
dc0d318177
|
[Attention] Add FLASH_ATTN_MLA_SPARSE backend for Hopper sparse MLA (#46189)
Signed-off-by: Dakai An <dakaian108@gmail.com>
|
2026-06-24 09:33:10 +00:00 |
|
|
Mike G
|
56e5797511
|
[Quant] Enable modelopt_mixed on Turing (SM75) (#45375)
Signed-off-by: Mike G <180722391+mikekg@users.noreply.github.com>
|
2026-06-22 19:30:49 -07:00 |
|