 JohnQinAMD
|
6dfd87f596
|
[ROCm][DSv4.1] Keep the Engram tables in host memory on ROCm (#57491)
|
2026-09-21 10:17:11 +08:00 |
|
|
Zhou ZihangandJee Jee Li
|
3e67044972
|
[Doc] Refresh Kthena integration guide (#57314)
Signed-off-by: Zhou Zihang <z@mcac.cc>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-09-21 01:42:55 +00:00 |
|
|
|
1185254851
|
[Bugfix][KV Connector] Propagate cache reset failure during sleep (#54581)
Signed-off-by: CrazyCoder <18235787078@163.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-21 09:25:02 +08:00 |
|
|
jiangkuaixue123andCodex
|
7ddd461a28
|
[Docs] Add ECMooncakeConnector usage example for EPD (#57742)
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-21 09:15:02 +08:00 |
|
|
Yifan QiaoandClaude Fable 5.1
|
d2983f2f16
|
[Bugfix][Spec Decode] Stop dummy draft decode steps from writing KV through stale block-table rows (#56734)
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-21 01:06:25 +00:00 |
|
|
Woosuk KwonandCodex
|
9b49f92344
|
[Perf][DSV4.1] Overlap mHC coefficients for small TP batches (#57603)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-20 17:33:17 -07:00 |
|
|
YiSheng5andKunshang Ji
|
17e50b9b76
|
[XPU][UT]Bugfix when the process can't see all the world_size meet accuracy issue. (#57779)
Signed-off-by: yisheng <yi.sheng@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-21 06:50:25 +08:00 |
|
|
YukioZzz
|
9679173788
|
[KVConnector][MoRIIO] Transfer hybrid mamba/KDA recurrent state in READ mode (#51052)
Signed-off-by: Yichao Zhu <Yichao.Zhu@amd.com>
|
2026-09-20 17:30:34 -04:00 |
|
|
|
01f1f58f10
|
[ROCm][CI] Query HIP device memory for test GPU teardown waits. (#57450)
Signed-off-by: Sheral Kumar <shekumar@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-20 15:20:39 -05:00 |
|
|
Wentao Ye
|
4868312128
|
[Refactor] Remove dead kernel code (#57621)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-09-20 10:39:23 -07:00 |
|
|
roikoren755andmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
49ee12d742
|
[Misc] Rename --enable-mamba-fine-grained-prefix-cache (#53945 follow-up) (#57382)
Signed-off-by: Roi Koren <roik@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-20 09:50:34 -07:00 |
|
|
|
7d99c2c4fd
|
[Feature][Humming] Humming feature integration (#56685)
Signed-off-by: jinzhen.ljz <jinzhen.ljz@antgroup.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
|
2026-09-20 08:11:01 -07:00 |
|
|
Isotr0py
|
27757dde02
|
[DSV4.1] Add encoder cuda graph support for deepseek-v4.1-flash (#56625)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-20 21:51:13 +08:00 |
|
|
ZyannandAbatom
|
9b2f34cad4
|
[Feature] support bf16 MoE router and mxfp4 MoE for MiMo V2 (#57784)
Signed-off-by: Zyann7 <62597503+Zyann7@users.noreply.github.com>
Co-authored-by: Abatom <182586866+Abatom@users.noreply.github.com>
|
2026-09-20 13:25:56 +00:00 |
|
|
|
10e6a7f210
|
[Frontend] Expose per-request spec decode metrics in generate API (#43310)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Codex <codex@openai.com>
|
2026-09-20 12:21:33 +00:00 |
|
|
Chauncey
|
bf01fc4a31
|
[GLM-5.3-Flash] Route kpool indexer top-k through the shared SparseIndexerTopk dispatcher (#57546)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-09-20 11:17:59 +00:00 |
|
|
|
f648eed23d
|
[Bugfix][KV Offload] Skip non-prefix-cacheable groups in SimpleCPUOffload (GLM-5.3-Flash kpool tail and QSA) (#56810)
Signed-off-by: Jared Wen <jaredwen@inferact.ai>
Signed-off-by: Jared Wen <w13431838023@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Zhewen Li <zhewenli@inferact.ai>
|
2026-09-20 10:58:55 +00:00 |
|
|
|
1b9fa3eaa8
|
[Perf][GLM] Fuse the kpool tail slot mapping into one Triton kernel (#57534)
Signed-off-by: Jared Wen <jaredwen@inferact.ai>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-20 18:20:55 +08:00 |
|
|
|
db1bfdd4fb
|
[Bugfix][GLM-5.3-Flash] Address kpool tail blocks by the padded indexer stride in the NVIDIA prefill seed kernel (#57477)
Signed-off-by: Jared Wen <w13431838023@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-20 18:15:04 +08:00 |
|
|
mahird3
|
0748d3bd57
|
[Model][LoRA] Enable LoRA support for VoyageQwen3BidirectionalEmbedModel (#57708)
Signed-off-by: Mahir Dursunoglu <142054011+mahird3@users.noreply.github.com>
|
2026-09-20 09:50:00 +00:00 |
|
|
Misha GoinandErinYin
|
e5fce7b56b
|
[Core][Kernel] Share persistent workspaces for Marlin and Humming (#57421)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: ErinYin <liang.yin@daocloud.io>
|
2026-09-20 17:28:33 +08:00 |
|
|
yinfengLiuandShanshan Shen
|
0e110f696d
|
[ROCm][DSV4][Perf] Use FP8 WO_A output projection (#54894)
Signed-off-by: Liuyinfeng01 <yinfeliu@amd.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-09-20 09:13:55 +00:00 |
|
|
Dilber
|
27b7757f63
|
[Bugfix][Frontend] Bound the prompt after multimodal expansion (#57076)
Signed-off-by: Dilber P Shakir <dilbersha@gmail.com>
|
2026-09-20 08:52:27 +00:00 |
|
|
Mi Jiazhiandjiazhimi
|
e378275a8f
|
[Model] Pass intermediate_tensors to the model when capturing CUDA gr… (#57745)
Co-authored-by: jiazhimi <jiazhimi@tencent.com>
|
2026-09-19 23:23:29 -07:00 |
|
|
Yan Ma
|
d05da62e9c
|
[XPU] fix incorrect gdn kernel log for XPU path (#54871)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-09-20 14:00:31 +08:00 |
|
|
Matt MastracciandClaude Fable 5.1
|
601e1c7c51
|
[Perf] Give a prefill-only batch the model state's number of logit rows (#57416)
Signed-off-by: Matt Mastracci <matthew@mastracci.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-20 04:58:30 +00:00 |
|
|
|
0c90804c0b
|
[Bugfix] DiffusionGemma: cast the self-conditioning soft embed to the buffer dtype (#57462)
Signed-off-by: Matt Mastracci <matthew@mastracci.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
|
2026-09-20 04:58:02 +00:00 |
|
|
|
92b40f5a14
|
[CPU][Perf] refactor paged attention for Arm CPUs (#56045)
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-09-20 12:25:13 +08:00 |
|
|
|
70fc7bd695
|
[Feature][EPD] Support dynamic EPD (EC-connector) proxy (#54176)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-20 12:24:41 +08:00 |
|
|
Fangzhou AiandShanshan Shen
|
1596fa5f88
|
[ROCm][DSv4.1][Perf] Reuse the decode topk ragged metadata across layers (#57434)
Signed-off-by: Fangzhou Ai <fangzhou.ai@amd.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-09-20 11:46:33 +08:00 |
|
|
Louie Tsai
|
03f8301387
|
Add one-step recipe serving (#57306)
Signed-off-by: louie-tsai <louie.tsai@intel.com>
|
2026-09-20 11:24:09 +08:00 |
|
|
YiSheng5andKunshang Ji
|
1c3ef2ad4c
|
[XPU][UT]Fix test_mnnvl_alltoall device and distributed backend (#57591)
Signed-off-by: yisustc <yi.sheng@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-20 10:53:00 +08:00 |
|
|
YiSheng5andKunshang Ji
|
f4fc5aae7f
|
[XPU][UT]Using the device_control_env_var to restrict visible device on different platform (#57581)
Signed-off-by: yisheng <yi.sheng@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-20 10:52:50 +08:00 |
|
|
Fanli Lin
|
708c2495c0
|
[Test][Core] Compute the expected hybrid prefix-cache hit instead of hard-coding it (#57467)
Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
|
2026-09-20 10:16:12 +08:00 |
|
|
|
a7fda4c88b
|
[Bugfix] Fix SM100 fp8_ds_mla cache scales (#49435)
Signed-off-by: Ariel Bereslavsky <arielb@getimpala.ai>
Signed-off-by: Ariel Bereslavsky <ariel@getimpala.ai>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Ariel Bereslavsky <arielb@getimpala.ai>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-19 17:15:07 -07:00 |
|
|
|
674b6d95d6
|
[CI][Bugfix] Fix MoE reprocess test mock after #57405's kernel refactor (#57641)
Signed-off-by: kimi-no-na-wa <kimi-no-na-wa@users.noreply.github.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: kimi-no-na-wa <kimi-no-na-wa@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-09-19 21:42:21 +00:00 |
|
|
Wentao Ye
|
36fa72d2d0
|
[GLM5.3 Perf] Size the GLM-5 sparse indexer decode workspace, 3072 MiB GPU memory saved (#57701)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-09-19 16:57:01 -04:00 |
|
|
|
133b71e0be
|
[Bugfix] Take padded path for ragged decode batches in sparse_attn_indexer (#52500)
Signed-off-by: pavelzak <pavel.zakharov@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-09-19 20:14:29 +00:00 |
|
|
|
5302d1fe40
|
[Model Runner V2] Support custom logits processors (#56497)
Signed-off-by: David Cheung <d7cheung@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-09-19 17:46:49 +00:00 |
|
|
Cyrus Leung
|
751f6807d9
|
[Refactor] Use dynamic MM cache in processor (#57674)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-09-19 15:38:00 +00:00 |
|
|
Lio Einaudi
|
41c4a3ed4e
|
[Kernel][Perf] Add sm_120 (RTX PRO 6000 / RTX 50) tuned configs for batch-invariant persistent matmul (#57456)
Signed-off-by: LioEinaudi <zhao3024667639@gmail.com>
|
2026-09-19 09:30:55 -04:00 |
|
|
|
fbe8a157fb
|
[ROCm][Perf] Enable the AITER GDN decode fast path for flat qkvz layouts (#53623)
Signed-off-by: Mikko Tukiainen <Mikko.Tukiainen@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
|
2026-09-19 06:05:04 -07:00 |
|
|
vllmellm
|
211e252d0b
|
[Bugfix][Model] Fix MiMo-V2.5 fused fp8 qkv_proj sharding (pre-shard count is num_key_value_heads; MTP path too) (#57508)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
|
2026-09-19 06:05:00 -07:00 |
|
|
siyuandIsotr0py
|
4cc15f2121
|
[Quantization] Let ModelOpt MXFP8 layers load pre-processed weights Purpose (#57316)
Signed-off-by: liusy58 <mg21330037@smail.nju.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
|
2026-09-19 09:16:39 +00:00 |
|
|
Aditya Ganesh Kumar
|
a5a30471ff
|
[Tests] Cover get_unhashed_block_ids_all_groups (#55928)
Signed-off-by: Aditya Ganesh Kumar <adty910@gmail.com>
|
2026-09-19 09:13:54 +00:00 |
|
|
Woosuk Kwon
|
c3b4844634
|
[Docs] Explain pointer-alignment JIT specialization in Triton skill (#57669)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-09-19 00:53:42 -07:00 |
|
|
Woosuk Kwon
|
38537331d3
|
[Bugfix][DSA] Avoid runtime JIT for offset candidate end buffers (#57667)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-09-19 00:27:11 -07:00 |
|
|
Ryan RockandAndreas Karatzas
|
59e6682c21
|
[CI][AMD] Bump torchao to v18 for Python 3.14 (#53009)
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-19 07:13:16 +00:00 |
|
|
Jiang WuandJiang Wu
|
6af44e2887
|
[Bugfix][CPU] Fix DeepSeek V4.1 import without Triton (#57654)
Signed-off-by: Jiang Wu <245355730+JiangLLM@users.noreply.github.com>
Co-authored-by: Jiang Wu <245355730+JiangLLM@users.noreply.github.com>
|
2026-09-19 05:46:13 +00:00 |
|
|
|
a8d1aa9c99
|
[Bugfix][Multimodal] Frame the multi-modal hash digest input (#54283)
Signed-off-by: hotragn <hotragn.pettugani_2024@woxsen.edu.in>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-18 21:06:48 -07:00 |
|