 TJian
|
1806d1adfc
|
[ROCm] [DSv4] [Perf] Support DeepSeek v4 MTP (#43385)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
|
2026-05-24 18:43:08 +08:00 |
|
|
Michael Goin
|
10d264a2b9
|
Revert "[Misc] add humming to dependencies" (#43492)
|
2026-05-23 14:21:13 -07:00 |
|
|
Siddharth BedekarandOpenAI Codex
|
4438b6e7dc
|
[MoE] Migrate W4A8 CT to oracle kernel setup (#42680)
Signed-off-by: Siddharth Bedekar <bedeksid@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-05-23 13:56:01 -04:00 |
|
|
Hua HuangandIsotr0py
|
a0be71ee47
|
[MM] Enable FlashInfer metadata support for Qwen2.5-VL vision attention (#42787)
Signed-off-by: Hua Huang <huah@nvidia.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
|
2026-05-23 16:08:40 +00:00 |
|
|
|
5bb8d2767a
|
[Kernel] Batch invariant NVFP4 linear using cutlass (#39912)
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
|
2026-05-23 09:41:12 -04:00 |
|
|
GuangYaoZheng
|
3f3e862681
|
fix(eagle3): read norm_before_fc from eagle_config for NVIDIA checkpoint (#42143)
Signed-off-by: FERRARIZHENG <popkart06@gmail.com>
|
2026-05-23 08:21:34 +00:00 |
|
|
Wei-Ming Chen
|
09a219c075
|
[ModelOpt] Support Qwen3.5/3.6 VLM quantized prefix mapping (#42546)
Signed-off-by: weimingc <17592131+meenchen@users.noreply.github.com>
|
2026-05-23 06:23:31 +00:00 |
|
|
Taneem Ibrahim
|
3a1c062151
|
[Misc] Added missing return type annotations to improve mypy and IDE tooling (#43383)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-05-23 13:28:22 +08:00 |
|
|
Qiming ZhangandKunshang Ji
|
54d153637b
|
[XPU] reudce host overhead of XPU MOE (#42915)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-05-23 13:09:34 +08:00 |
|
|
Ma JianandKunshang Ji
|
a5bbd81e2e
|
[XPU]feat: enable FP8 block-scaled quantization on XPU (#42952)
Signed-off-by: Ma Jian <jian1.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-05-23 12:33:18 +08:00 |
|
|
Andreas Karatzas
|
d28bdf9344
|
[ROCm][CI] Fix ROCm LoRA Transformers fallback with full CUDA graphs (#41577)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-05-23 04:31:32 +00:00 |
|
|
Itay Alroy
|
6d30655b13
|
elastic_ep: stage/commit MoE quant method on reconfigure (#40881)
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
|
2026-05-22 18:57:26 -04:00 |
|
|
Ma JianandKunshang Ji
|
8de5cabeb7
|
[XPU]fix: add XPU platform guards to DeepSeek-V4 ops (#42950)
Signed-off-by: Ma Jian <jian1.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-05-23 06:29:45 +08:00 |
|
|
Juhi Mittal
|
e203006a8b
|
[Quantization][ModelOpt] W4A16 NVFP4 fused MoE + mixed-precision dispatch (#42566)
Signed-off-by: Juhi Mittal <juhim@nvidia.com>
|
2026-05-22 20:51:49 +00:00 |
|
|
haosdentandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
4e597b7491
|
[Bugfix] Clear error message for FP8 torchao quantization on unsupported GPUs (#36854)
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-05-22 20:09:17 +00:00 |
|
|
Artem Perevedentsev
|
23f7b11bf4
|
[Bugfix] Detect wrong libcute_dsl_runtime.so variant in FlashInfer GDN (#43427)
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
|
2026-05-22 19:33:33 +00:00 |
|
|
Isotr0py
|
f0feb15e7f
|
[Multimodal] Simplify ViT CUDA graph interfaces (#41234)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
|
2026-05-22 22:31:00 +08:00 |
|
|
sychen52
|
fb21d8b4f9
|
Add NVFP4 MOE support for Deepseek V4. (#42209)
Signed-off-by: Shiyang Chen <shiychen@nvidia.com>
|
2026-05-22 07:21:51 -07:00 |
|
|
Keyi LiandKeyi Li
|
79ff0ffa98
|
[BugFix] wire make_empty_intermediate_tensors on AyaVision and Voxtral (#43118)
Signed-off-by: Keyi Li <likey6688@gmail.com>
Co-authored-by: Keyi Li <likey6688@gmail.com>
|
2026-05-22 05:26:41 -07:00 |
|
|
|
b3c7ffcab8
|
[Misc] Replace assert with proper exceptions for security and validation in pooling (#43286)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-05-22 18:43:33 +08:00 |
|
|
Ma JianandKunshang Ji
|
d3d1cf6972
|
[XPU]feat: add XPU fallback for MoE topk routing and MXFP4 backend (#42951)
Signed-off-by: Ma Jian <jian1.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-05-22 10:22:45 +00:00 |
|
|
wangxiyuan
|
7e1b45a092
|
[Attention] Mamba attention module refactor (#41126)
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
|
2026-05-22 17:13:12 +08:00 |
|
|
haosdent
|
025d4f5cd2
|
[CI] Fix "test_awq_load[gemma4-moe-*]" failure (#43296)
Signed-off-by: haosdent <haosdent@gmail.com>
|
2026-05-22 07:13:59 +00:00 |
|
|
tc-mb
|
fa1ff88b31
|
[Model] Fix MiniCPM-V 4.6 vit_merger qkv weight loading (#43213)
Signed-off-by: tc-mb <tianchi_cai@icloud.com>
|
2026-05-21 22:44:06 -07:00 |
|
|
Furkan F
|
e746a2eebf
|
[Model] Use AutoWeightsLoader for Voyage (#42972)
Signed-off-by: Furkan Fidan <dev@yufufi.com>
|
2026-05-22 05:28:23 +00:00 |
|
|
Xiaochang WuandKunshang Ji
|
8c8b1825eb
|
[XPU] Enable multiple key kernels for sparse attention (#37888)
Signed-off-by: Xiaochang Wu <xiaochang.wu@intel.com>
Signed-off-by: Wu, Xiaochang <xiaochang.wu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-05-22 12:02:51 +08:00 |
|
|
Chengze FanandLu Fang
|
2998a047aa
|
[Bugfix] Fix DSV4 Base model swiglu limit issue in FP8 path (#42855)
Signed-off-by: Chengze Fan <chengze@meta.com>
Signed-off-by: Chengze Fan <fancz2002@gmail.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
|
2026-05-21 19:43:01 -07:00 |
|
|
|
17b69828a0
|
[Core] Add native ModelExpress load format (#43105)
Signed-off-by: Zheng Luo <zheluo@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
|
2026-05-21 16:05:01 -04:00 |
|
|
Wentao Ye
|
b29cbf0652
|
[Perf] zeros -> empty to remove additional fill (#42988)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-05-21 16:00:29 -04:00 |
|
|
Michael Goin
|
9b54e50e2c
|
[Deprecation] Mark env vars covered by --moe-backend / --linear-backend (#43148)
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
|
2026-05-21 12:51:12 -07:00 |
|
|
Wentao YeandIsotr0py
|
68e07d5916
|
[Bug] Fix ci issue assert output_size is not None AssertionError (#43261)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-05-21 16:58:09 +08:00 |
|
|
zhangxin81
|
edafea3555
|
Fix FlashInfer TRTLLM NvFP4 monolithic MoE routing (#43223)
Signed-off-by: zhangxin81 <115389973+zhangxin81@users.noreply.github.com>
|
2026-05-21 01:17:12 -07:00 |
|
|
zexplorerhjandzexplorerhj
|
b719b1635b
|
Update KDA chunk prefill decay to use exp2 semantics (#43195)
Signed-off-by: zexplorerhj <19794632+zexplorerhj@users.noreply.github.com>
Co-authored-by: zexplorerhj <19794632+zexplorerhj@users.noreply.github.com>
|
2026-05-21 01:16:27 -07:00 |
|
|
Luciano MartinsandLuciano Martins
|
2b75a73b8e
|
[Perf][Gemma4] Batch vision encoder calls for image and video processing (#43169)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
|
2026-05-20 21:22:06 -07:00 |
|
|
|
e45df8c3f7
|
[Bugfix] Fix Qwen3.5 GatedDeltaNet in_proj_ba Marlin failure at TP>=2 (#36329)
Signed-off-by: Adi McM Sonus Flow <biuro@sonusflow.pl>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-20 21:22:01 -07:00 |
|
|
Michael Goin
|
5774aad9c5
|
[Perf][gpt-oss] Downgrade triton_kernels to v3.5.1 (#43135)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-05-20 14:13:12 -07:00 |
|
|
Flora Feng
|
2a43b407c5
|
[Bugfix][CI] Add missing import of pad_nvfp4_activation_for_cutlass in flashinfer (#43237)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
|
2026-05-20 11:59:12 -07:00 |
|
|
Wentao YeandMatthew Bonanni
|
53ff50fcd3
|
[Perf] Optimize CutlassFP8ScaledMMLinearKernel when padding needed by pre-weight processing, 13.5% TTFT improvement (#42651)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-05-20 11:57:42 -07:00 |
|
|
meena-at-workandClaude Sonnet 4.6
|
363fc84407
|
Integrate flashinfer b12x MoE and FP4 GEMM kernels for SM120/121 (#40082)
Signed-off-by: Meenakshi Venkataraman <meenakshiv@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
|
2026-05-20 17:21:11 +00:00 |
|
|
Dipika Sikka
|
df84fb07a6
|
Remove additional dead code as a follow-up to #42889 (#43144)
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
|
2026-05-20 10:01:45 -04:00 |
|
|
Benjamin Chislett
|
0a508743d4
|
[Spec Decode] Support non-MTP speculation for NemotronH (#43130)
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
|
2026-05-20 09:15:52 -04:00 |
|
|
Artem Perevedentsev
|
1cb224430b
|
[GDN] Enable FI Blackwell GDN prefill kernel (#40717)
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
|
2026-05-20 01:46:55 -07:00 |
|
|
|
117afeea46
|
Fix error in Dynamic NTK scaling (#41277)
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-05-19 17:27:54 -04:00 |
|
|
Doğaç Eldenk
|
1242196295
|
[Model] Support post-norm architecture for EAGLE-3 supeculators (#42764)
Signed-off-by: Doğaç Eldenk <dogacel@gmail.com>
|
2026-05-19 13:39:00 -07:00 |
|
|
Wei Zhaoandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
9aaf83ef50
|
[CI failure] Temporarily disable using persistent cache for flashinfer autotune (#43119)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-05-19 11:44:32 -07:00 |
|
|
Jinzhen Lin
|
8200fbe1ac
|
[Misc] add humming to dependencies (#42540)
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
|
2026-05-19 08:36:47 -07:00 |
|
|
Wang Yiwen
|
1c6158083a
|
[Model] Openvla support (#42654)
Signed-off-by: Wang Yiwen <121547057+yiwen101@users.noreply.github.com>
|
2026-05-19 08:17:42 -07:00 |
|
|
Nick Hill
|
b82e908b4c
|
[Perf][4/n] Eliminate various GPU<->CPU syncs (#42347)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-05-19 10:35:54 -04:00 |
|
|
Shanshan Shen
|
ef54a4d604
|
[Misc][MM] Remove redundant code in CLIPAttention (#43046)
Signed-off-by: shen-shanshan <467638484@qq.com>
|
2026-05-19 08:43:16 +00:00 |
|
|
Taneem Ibrahim
|
4a4fdabe28
|
[Misc] Aligning tokwise pooler heads for consistency (#43041)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-05-19 06:16:42 +00:00 |
|