 yjzandJianDan0212
|
5fba75aefe
|
[Bugfix][Model] Add missing fused_qkv_a_proj to Kimi-Linear packed_modules_mapping (#51249)
Signed-off-by: JianDan0212 <zhangyj0212@gmail.com>
Co-authored-by: JianDan0212 <zhangyj0212@gmail.com>
|
2026-08-06 11:39:17 +00:00 |
|
|
Sage
|
865781e627
|
[Rust Frontend] Add standalone Rust renderer (#50289)
|
2026-08-06 11:23:26 +00:00 |
|
|
|
ef2615c2e0
|
[Bugfix][KV Offload] Fall back when MADV_POPULATE_WRITE is unsupported (#51116)
Signed-off-by: Guy Girmonsky <guygir@gmail.com>
Signed-off-by: Alex <jihui.huang@daocloud.io>
Co-authored-by: Guy Girmonsky <guygir@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-06 13:48:01 +03:00 |
|
|
Lyu Han
|
22013f74ff
|
Interns2mobius support (#51149)
Signed-off-by: Lyu Han <lvhan_028@163.com>
|
2026-08-06 10:39:35 +00:00 |
|
|
Jared Wen
|
e07532b035
|
[MISC][Bench] refactor throughput and reuse serve's get samples (#50981)
Signed-off-by: JaredforReal <w13431838023@gmail.com>
|
2026-08-06 10:31:23 +00:00 |
|
|
anhtra3889andKhang Ngo
|
872fd5973e
|
[Bugfix][LoRA] Guard TrtLlm BF16 MoE LoRA gate on activation type (#51002)
Signed-off-by: Anh Tran <anhtra@nvidia.com>
Co-authored-by: Khang Ngo <khngo@nvidia.com>
|
2026-08-06 18:12:54 +08:00 |
|
|
wang.yuqiandCyrus Leung
|
2fa490470d
|
[Model] Fused mm preprocess normalisation on the Device (#50411)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
|
2026-08-06 03:11:14 -07:00 |
|
|
Matej Sirovatka
|
9c22668436
|
[Quantization] Preserve precision in online NVFP4 expert packing (#50029)
Signed-off-by: S1ro1 <matej.sirovatka@gmail.com>
|
2026-08-06 02:23:54 -07:00 |
|
|
Chaojun ZhangandKunshang Ji
|
276f0bb5c1
|
[XPU] Register fake meta kernel for fp4_gemm (#50946)
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-06 17:18:42 +08:00 |
|
|
maobaolongandLi, Jiang <jiang1.li@intel.com>
|
13726c80fe
|
[CPU] Add MLA backend so DeepSeek-V2/V3 can run on CPU (#49453)
Signed-off-by: baoloongmao <baoloongmao@tencent.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-08-06 16:51:41 +08:00 |
|
|
Wentao Ye
|
ad5280255b
|
[GLM Perf] DSv32/glm use skip topk for MTP case, 2.0x kernel performance improvement (#50904)
|
2026-08-06 01:48:36 -07:00 |
|
|
|
2dfb8ba590
|
[Perf][CUDA] Programmatic dependent launch for the DSA decode kernels (#50230)
Signed-off-by: Peiyuan Zhou <peiyuanzhou1994@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-06 00:53:17 -07:00 |
|
|
zofiaandopencode
|
febea17f6a
|
[Model] Fix weight prefix mapping for native Qwen3.5 text-only checkp… (#50355)
Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
Co-authored-by: opencode <opencode@anomaly.co>
|
2026-08-06 07:40:44 +00:00 |
|
|
|
470297c143
|
[HPC Attention Backend] hpc attention backend support bf16 kv cache with fp8 weight (#50980)
Signed-off-by: chengvjiang <chengvjiang@tencent.com>
Co-authored-by: chengvjiang <chengvjiang@tencent.com>
Co-authored-by: VAthree <56064364+VAthree@users.noreply.github.com>
|
2026-08-06 15:40:14 +08:00 |
|
|
Andreas Karatzas
|
7e724dca89
|
[ROCm] Fix AITER all-reduce fusion coverage (#50802)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-06 14:52:23 +08:00 |
|
|
Canlin Guo
|
5370461649
|
[BugFix][KV Cache] Fix hybrid prefix caching with hidden-state extraction (#51108)
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com>
|
2026-08-06 06:42:37 +00:00 |
|
|
zofiaandKunshang Ji
|
8060260e1d
|
[Linear] [Kernel] add block-wise scaled_mm (#49932)
Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-06 14:40:26 +08:00 |
|
|
liuzhenweiandKunshang Ji
|
8c0f029ac7
|
[XPU] update warning of XPU Graph (#50236)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-06 06:33:33 +00:00 |
|
|
Gabriel WuandYongye Zhu
|
2e35c529b8
|
[Bugfix][Quantization] Fix MXFP4 conversion for FlashInfer CUTLASS (#51038)
Signed-off-by: Zihua Wu <13583761+lucifer1004@users.noreply.github.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
|
2026-08-05 23:19:22 -07:00 |
|
|
JooHo Lee
|
c0202c5603
|
[Bugfix][Spec Decode] Auto-enable async scheduling for draft models (#48341)
Signed-off-by: BWAAEEEK <jooho414@gmail.com>
|
2026-08-06 13:51:40 +08:00 |
|
|
|
b976e980ef
|
[XPU] Route AWQ linear through choose_mp_linear_kernel (#50840)
Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
Co-authored-by: opencode <noreply@opencode.ai>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-06 13:50:11 +08:00 |
|
|
liuzhenwei
|
2a0323b4e0
|
[XPU][Test] Support MultiConnector accuracy testing on XPU (#51160)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
|
2026-08-06 13:49:48 +08:00 |
|
|
|
d779835a11
|
[XPU] Support MXFP8 linear weights for INC DeepSeek V4 model (#48476)
Signed-off-by: Wu, Xiaochang <xiaochang.wu@intel.com>
Signed-off-by: Xiaochang Wu <xiaochang.wu@intel.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-06 13:17:48 +08:00 |
|
|
Qiuyang Yue
|
777b01d1a8
|
[MM][CG] Support ViT full CUDA graph for Ernie-4.5-VL image inference (#45254)
Signed-off-by: Qiuyang Yue <yueqiuyang1389@gmail.com>
|
2026-08-06 05:04:19 +00:00 |
|
|
Li JuqiandCyrus Leung
|
821717118f
|
[BugFix][Pooling] Skip weight-prefix probe when model has WeightsMapper (#50890)
Signed-off-by: Juqi Li <2223621784@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-08-05 21:12:33 -07:00 |
|
|
Yunzhu LuandCyrus Leung
|
f84df12c6a
|
[Bugfix][MM] Fix MiniCPM-V placeholder replacement and image processor loading on Transformers v5 (#48413)
Signed-off-by: YunzhuLu <lucia.yunzhu@gmail.com>
Signed-off-by: Yunzhu Lu <lucia.yunzhu@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-08-05 21:12:00 -07:00 |
|
|
Chauncey
|
22170354d8
|
[Feature] Parse request priority from HTTP header (#51089)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-08-05 21:10:29 -07:00 |
|
|
baodi
|
2e09247c2d
|
[Docs] List Intel XPU attention backends (#51215)
Signed-off-by: baodii <di.bao@intel.com>
|
2026-08-06 10:58:28 +08:00 |
|
|
liuzhenwei
|
d54b58cc48
|
[Hardware] Use torch.accelerator.empty_host_cache() for host cache cl… (#51107)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
|
2026-08-06 10:27:57 +08:00 |
|
|
Giancarlo Delfin
|
81bc196913
|
[Model Runner V2] Cache draft logits in model's LM head dtype (#50910)
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
|
2026-08-05 19:12:46 -07:00 |
|
|
Jee Jee Li
|
f85c1d2f84
|
K3: remove the add operation for megamoe path (#51146)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-08-06 01:48:25 +00:00 |
|
|
Aarushi Jain
|
71f975af43
|
[ROCm][CI] Add MLA decode accuracy and determinism tests (#50480)
Signed-off-by: aarushjain29 <Aarushi.Jain2@amd.com>
|
2026-08-05 20:35:56 -05:00 |
|
|
Thien TranandOpenAI Codex
|
9f3169960a
|
[MoE] Align TRTLLM MXFP4 autotune buckets (#50942)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-05 18:17:53 -07:00 |
|
|
|
b50fdebce0
|
[Bugfix] Fix level-2 sleep/wake/reload with enable_lora=True (#39935)
Signed-off-by: Silen Naihin <silen.naihin@gmail.com>
Co-authored-by: Dakai An <dakaian108@gmail.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
|
2026-08-06 09:13:10 +08:00 |
|
|
aoshen02andAndy Lo
|
8cfa01cdd2
|
[BugFix] Dense multinode DP rescope with regression test (#49212)
Signed-off-by: Andy Lo <andy@mistral.ai>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Andy Lo <andy@mistral.ai>
|
2026-08-05 18:12:03 -07:00 |
|
|
gabriel-peracioandKimi K3
|
47a4e410ba
|
[Bugfix][Spec Decode] Fix NaN handling in rejection sampler tl.argmax (#50183)
Signed-off-by: Gabriel Peracio <gabriel@sigsonic.com>
Co-authored-by: Kimi K3 <noreply@moonshot.ai>
|
2026-08-05 18:01:09 -07:00 |
|
|
LZWandRoger Wang
|
d36f24b66a
|
[KV Connector][Mooncake] Add tenant ID support to MooncakeStoreConnector (#48069)
Signed-off-by: lzw <2994587066@qq.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
|
2026-08-05 17:31:18 -07:00 |
|
|
|
7c77868cdf
|
[Bugfix] Size and iterate w13 by shard count for non-gated MoE (#51125)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Matej Sirovatka <matej.sirovatka@gmail.com>
Co-authored-by: Rishi Puri <riship@nvidia.com>
Co-authored-by: Hsiao-Yuan Chen <littlecircle0730@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-05 17:24:47 -07:00 |
|
|
QiuandLucas Wilkinson
|
811622c410
|
[Refactor][PCP] Make PCPManager construction extensible (#50066)
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
|
2026-08-05 23:05:14 +00:00 |
|
|
Tianyu Guo
|
b30291cf0c
|
[EPD] Remove duplicate image preprocessing in EPD and enable preprocess on GPU (#50390)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
|
2026-08-05 15:59:54 -07:00 |
|
|
Rohan PotdarandClaude Opus 4.8
|
38ebd97bca
|
[ROCm] Relax MLA rope+cache test tolerances for bf16 (#51083)
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-08-05 17:50:52 -05:00 |
|
|
Wentao Ye
|
877975897d
|
[K3 Perf] Combine multiple all gather together for SP, 1.5~3x kernel level performance improvement (#51070)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-05 17:42:41 -04:00 |
|
|
bnellnm
|
373fe8b83e
|
[MoE Refactor] Remove MoE legacy code (#51078)
Signed-off-by: Bill Nell <bnell@redhat.com>
|
2026-08-05 14:35:36 -07:00 |
|
|
Micah WilliamsonandAndreas Karatzas
|
4282fe52d5
|
[ROCm][CI] Add More AITER quantization/MoE kernel tests (#49375)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-05 21:27:33 +00:00 |
|
|
Netanel Haber
|
482c613423
|
[Bugfix][Humming] Preserve ModelOpt FP8 weight dimensions (#51093)
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
|
2026-08-05 14:08:55 -07:00 |
|
|
Wentao Ye
|
e76b71f659
|
[CI Bug] Fix pydantic_core._pydantic_core.ValidationError: Input should be a valid integer (#51179)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-05 20:57:47 +00:00 |
|
|
stefankoncarevicandAndreas Karatzas
|
65addac701
|
[ROCm][CI] Keep rocprofiler-sdk out of DeepEP HT MoE test workers (#51173)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-05 15:28:41 -05:00 |
|
|
Rohan PotdarandClaude Opus 4.8
|
c2d8009044
|
[ROCm] Work around DeepEP teardown SIGSEGV in MoE test harness (#51174)
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-08-05 14:44:42 -05:00 |
|
|
Michael Goin
|
e6d67fddb4
|
[CI] Prune PyTorch Fullgraph Test (#51074)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-05 12:27:27 -07:00 |
|
|
Michael GoinandOpenAI Codex
|
8f158d0ee2
|
[MoE] Share apply_moe_activation support metadata (#44359)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-05 12:05:47 -07:00 |
|