 Harry MellorandClaude Opus 5
|
78300cdabf
|
[Bugfix][Docs] Package glm5next nvidia subtree and fix its docstrings (#55214)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-03 21:25:26 -07:00 |
|
|
Jeff (Junze) MaandOpenAI Codex
|
e35298628f
|
[Bugfix][KV Connector] Fix DecodeBenchConnector prefix block selection (#54878)
Signed-off-by: Jeff Ma <jeffjma@umich.edu>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-04 04:05:58 +00:00 |
|
|
|
156050598e
|
[ROCm][CI] Bump ROCk base to ROCm 10.0 (#55246)
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Co-authored-by: Randall Smith <Randall.Smith@amd.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-09-04 03:38:07 +00:00 |
|
|
omerpaz95andClaude Opus 5
|
8a0a7ee40a
|
[EC Connector] P2P NIXL + CPU EC Connector (#47941)
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-04 11:23:56 +08:00 |
|
|
aoshen02andaoshen02
|
69cf055936
|
[Performance][DSv4] Size dequant gather launch grid by rows (#55061)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen524@gmail.com>
|
2026-09-03 20:06:34 -07:00 |
|
|
Ziming HuangandOpenAI Codex
|
a26b71d868
|
[Bugfix][PD] Pad resumed speculative decode requests (#55126)
Signed-off-by: Ziming Huang <48115868+ZeldaHuang@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-04 11:05:33 +08:00 |
|
|
bnellnmandTyler Michael Smith
|
25268f0c9c
|
[KVConnector] Add retention interval to OffloadingConnector (#51886)
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
|
2026-09-04 02:42:20 +00:00 |
|
|
|
7dc30f5a66
|
[ROCm][CI] Build and publish TheRock nightly docker images (#55014)
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-03 21:34:22 -05:00 |
|
|
|
d9e2b5238d
|
[Core][KV Events] Echo session_id on GPU BlockStored events (#51381)
Signed-off-by: liuguangli <liuguangli35@gmail.com>
Signed-off-by: jinx-machinepulse <2679622408@qq.com>
Co-authored-by: liuguangli <liuguangli35@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-04 02:22:50 +00:00 |
|
|
Yunxiao NingandOpenAI Codex
|
19c018ec05
|
[Bugfix][DCP] Materialize prefill keys on non-owner ranks (#54908)
Signed-off-by: 云挚 <ningyunxiao.nyx@antgroup.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-04 02:12:07 +00:00 |
|
|
|
560ef78bfe
|
[Perf][Model Runner V2] Compact sampling masks on GPU instead of unpacking the full-vocab bitmask on CPU (#54901)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Signed-off-by: vx120 <893600387@qq.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: vx120 <893600387@qq.com>
|
2026-09-03 19:03:36 -07:00 |
|
|
Bugen Zhao
|
d6bce42983
|
[Rust Frontend] Report reasoning tokens in chat completion usage (#54883)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-03 16:47:24 -07:00 |
|
|
|
579aef4e8d
|
[ROCm] Bump AITER to 0.1.21.post1 (#52826)
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Signed-off-by: fai <fangzhouai@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: fai <fangzhouai@gmail.com>
|
2026-09-03 16:28:40 -07:00 |
|
|
Yongye ZhuandClaude Fable 5
|
bc2ee48073
|
[Perf] Prefetch the weight before the PDL wait in fused_q_kv_rmsnorm (#55020)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-09-03 15:40:16 -07:00 |
|
|
Yongye ZhuandClaude Fable 5
|
9509fc8ae6
|
[Perf][Kimi-K3] Cut MLA decode concat/cache epilogue latency (#54896)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-09-03 15:39:58 -07:00 |
|
|
|
c7e6e36fa9
|
[Rust Frontend] Add support for TLS in render server (#54999)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Richard <noreply@moonshot.cn>
Signed-off-by: Wen Zhou <wenzhou@redhat.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-03 21:56:44 +00:00 |
|
|
|
6fdee17f84
|
[CI] Zen5 image build (#50314)
Signed-off-by: Chinmay Kulkarni <Chinmay.Kulkarni@amd.com>
Signed-off-by: andy-neuma <alinfoot@redhat.com>
Co-authored-by: Chinmay Kulkarni <Chinmay.Kulkarni@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-09-03 17:34:35 -04:00 |
|
|
Taneem Ibrahim
|
e41011129b
|
[CI] Avoid logging test server environment values (#54379)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-09-03 17:00:29 -04:00 |
|
|
|
cee0f92c02
|
[ROCm][Perf] Optimize MiniMax-M3 decode indexer and top-k (#54682)
Signed-off-by: fai <fangzhouai@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-03 13:20:18 -07:00 |
|
|
Ning XieandCyrus Leung
|
2a336d8239
|
[warmup] overlap renderer warmup and engine core initialization (#54557)
Signed-off-by: Andy Xie <andy.xning@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-09-03 19:44:21 +00:00 |
|
|
|
fc8f10792c
|
Fix DeepSeek V4 FlashMLA auto KV cache dtype (#45091)
Signed-off-by: elehayym <huangxh1618@gmail.com>
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: elehayym <huangxh1618@gmail.com>
Co-authored-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
|
2026-09-03 19:29:14 +00:00 |
|
|
Will EatonandBugen Zhao
|
2db1c4dc31
|
[Rust Frontend] Support --lora-modules for static adapter loading (#54837)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Will Eaton <weaton@redhat.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-03 19:12:45 +00:00 |
|
|
Bugen Zhaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
21a2211040
|
[Rust Frontend] Use token-attributed text in reasoning and unified parsers (#54884)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-04 02:05:05 +08:00 |
|
|
Fangzhou Ai
|
8bf39632b8
|
[ROCm][Perf] Add low-M FP32 router GEMM for gfx950 (#54845)
|
2026-09-03 10:42:25 -07:00 |
|
|
|
b7624069ff
|
[Fusion] Manual ActivationQuantFusionPass initial application (#51415)
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: ElizaWszola <ewszola@redhat.com>
|
2026-09-03 13:37:31 -04:00 |
|
|
sychen52andVadim Gimpelson
|
d4d703caf9
|
[Bugfix][Model] Fix FP8 PLE loading in mixed ModelOpt checkpoints (#54882)
Signed-off-by: Shiyang Chen <shiychen@nvidia.com>
Co-authored-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>
|
2026-09-03 21:09:39 +04:00 |
|
|
Bolin SunandClaude Fable 5
|
d410fc12f3
|
[Kernel] Enable Kimi-K3 SiTU on the CuteDSL MoE backend and the SM107 low-latency GEMM plan (#54606)
Signed-off-by: Bolin Sun <bolins@nvidia.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-09-03 16:49:31 +00:00 |
|
|
Jiangyun Zhu
|
98ed0856f3
|
[Model] add GLM-5.3-Flash support (#53906)
|
2026-09-03 09:40:35 -07:00 |
|
|
Yifan Jiang
|
da8ec28268
|
[Bugfix][KV Offload] Do not let a recurrent group's unhashed block truncate the load boundary (#52807)
Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
|
2026-09-03 19:08:46 +03:00 |
|
|
mevince
|
4ae6228284
|
[Bugfix][KV Connector] Populate SimpleCPUOffload BlockStored metadata (#54325)
|
2026-09-03 15:58:07 +00:00 |
|
|
Nick Hill
|
e55b93f296
|
[Core] Deprecate "all" mamba cache mode (#55041)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-09-03 08:56:59 -07:00 |
|
|
Jeff (Junze) MaandOpenAI Codex
|
31e9c13685
|
[Bugfix][KV Connector] Safely fill circular buffers in DecodeBench (#54879)
Signed-off-by: Jeff Ma <jeffjma@umich.edu>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-03 15:16:22 +00:00 |
|
|
bhsueh_NV
|
edc0fb7e03
|
Optimize PLE MTP metadata transfers (#55054)
|
2026-09-03 08:02:59 -07:00 |
|
|
Nick Hillandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
bf95f58d10
|
[Core] Triton kernel for small-batch top-p only masking (#54651)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-03 07:52:47 -07:00 |
|
|
JasonCohereandCursor
|
bb363db9a5
|
feat: Add support for reasoning_token_count to reasoning parser (#54982)
Signed-off-by: Jason Ozuzu <jasonozuzu@cohere.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-03 05:02:49 -07:00 |
|
|
SunandCodex
|
848ab131bc
|
[Perf] Accumulate Conformer attention scores with baddbmm (#55062)
Signed-off-by: levius <2114377220@qq.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-09-03 04:17:52 -07:00 |
|
|
Taneem Ibrahim
|
758c79e1c5
|
[Bugfix] Retain vocab embeddings during replacement (#55083)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-09-03 04:17:38 -07:00 |
|
|
|
ee0a4c46ae
|
[Bugfix] Account for PCP in multi-node world size validation (#55111)
Signed-off-by: DebugSy <532151398@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-03 10:52:42 +00:00 |
|
|
Giancarlo Delfin
|
facd9a74a1
|
[Model Runner V2][Spec Decode] Skip DP sync for all speculator uniform decodes (#54856)
|
2026-09-03 10:32:33 +00:00 |
|
|
djramic
|
0d3ede3e3b
|
[Bugfix][Model] Enable torch.compile for StableLM (#54969)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
|
2026-09-03 03:21:54 -07:00 |
|
|
|
c21751c90b
|
[Kernel] Warm up Qwen GDN gated RMSNorm (#54251)
Signed-off-by: Zupeng Wang <71580390+zupengwang@users.noreply.github.com>
Co-authored-by: OpenAI <support@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-03 18:19:48 +08:00 |
|
|
Andreas Karatzas
|
4cc0cb6f76
|
[CI][AMD] Avoid expandable segments in LoRA TP tests (#55094)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-09-03 09:55:10 +00:00 |
|
|
Harry Mellor
|
e6eb9074e9
|
[CI] Bump Transformers version to 5.16.1 (#53905)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-03 02:12:43 -07:00 |
|
|
Andreas Karatzas
|
096d8e8ce6
|
[ROCm][CI] Add MiniMax reduce RMS kernel coverage (#55057)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-03 04:07:59 -05:00 |
|
|
Bowen Tan
|
1f76efaa21
|
[Model] Add K2-Horizon model support (#55063)
|
2026-09-03 01:17:08 -07:00 |
|
|
|
092334c828
|
[Bugfix] Wait for offload keys before storing chunks (#52923)
Signed-off-by: chuanzhisongshu <49055103+982945902@users.noreply.github.com>
Co-authored-by: lishuo121 <lishuo121@jd.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-09-03 11:07:35 +03:00 |
|
|
Derek WeitzelandClaude Fable 5.1
|
859dd39512
|
[Bugfix][Core] Wait for the previous PP tensor sends before the next forward pass (#54962)
Signed-off-by: Derek Weitzel <djw8605@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-03 08:01:36 +00:00 |
|
|
Clinton ThomasandLucas Bourtoule
|
ee17d0d869
|
Use server-generated keys for late-interaction query caches (#51445)
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com>
|
2026-09-03 07:15:58 +00:00 |
|
|
waizuichougouandNick Hill
|
3f1af35e01
|
[Bugfix][Multimodal] Handle prefix-covered items in SHM worker cache (#54994)
Signed-off-by: waizuichougou <2082431897@qq.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-09-03 06:39:34 +00:00 |
|
|
Taneem Ibrahim
|
27a94d1ce4
|
[CI] Fix DeepSeek-V4 registry platform guard (#55042)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-09-03 03:27:01 +00:00 |
|