 Isotr0pyandShanshan Shen
|
8352b2427f
|
[Multimodal] Optimize encoder cudagraph padding logic (#58925)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-10-08 03:38:09 +00:00 |
|
|
Simon DanielssonandDouglas Lehr
|
87d9996abe
|
[ROCm][Perf][GLM-5.3-Flash] BF16 splitk kernel for sparse MLA decode (#58584)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
|
2026-10-07 21:37:51 -05:00 |
|
|
bnkaiteamandFlora Feng
|
3722645539
|
[Bugfix][Frontend] Accept successful 2xx responses for batch output uploads (#60507)
Signed-off-by: bnkaiteam <bnkaiteam@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-10-08 02:32:35 +00:00 |
|
|
|
caff2b44cb
|
[BugFix] Pick the DP world-group port at bind time via the coordination store (#51018)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-10-08 02:30:35 +00:00 |
|
|
wangxiyuanandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
a4b14e57b6
|
[Platform] Allow BackendEnum dynamic register (#41091)
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-08 09:56:19 +08:00 |
|
|
MattandClaude Opus 5.5
|
9dba339d07
|
[Bugfix][ROCm] Keep MLA derived weights in place on weight reload (#60389)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-07 20:38:06 -05:00 |
|
|
Nicolò Lucchesi
|
8733a21d55
|
[Core] Bound execute_dummy_batch RPC waits by the execute-model timeout (#60398)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-10-08 01:22:04 +00:00 |
|
|
Junyi Yaoandsfeng33
|
fdfc171a74
|
[Bugfix][ToolParser] Stream every tool call when one delta completes several (#60354)
Signed-off-by: Junyi Yao <j.yao@wustl.edu>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: sfeng33 <4florafeng@gmail.com>
|
2026-10-08 01:07:35 +00:00 |
|
|
|
2dd887426e
|
[Bugfix][Frontend] Do not modify caller params in LLM.score() (#59959)
Signed-off-by: 叮当猫 <2756823972@qq.com>
Signed-off-by: apex-mochen <2756823972@qq.com>
Co-authored-by: DeepSeek Harness <noreply@deepseek.com>
Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-10-08 09:03:08 +08:00 |
|
|
Kang NahoonandFlora Feng
|
1995c0fcd0
|
[Bugfix][Frontend] Apply output_config and thinking in Anthropic count_tokens (#59180)
Signed-off-by: Kang Nahoon <ejrtks102020@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-10-08 00:24:20 +00:00 |
|
|
Nicolò Lucchesi
|
a58bdd0d4e
|
[Perf] JIT monitor: hook TileLang JITImpl.compile instead of __call__ (#58685)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-10-08 00:11:59 +00:00 |
|
|
|
8faac3dd2a
|
[Bugfix] [Spec Decode] DeepSeek V4/V4.1 NVFP4: keep ignored MTP/DSpark experts on MXFP4 (#59655)
Signed-off-by: Shobhit Verma <shobhitv@nvidia.com>
Signed-off-by: v-shobhit <161510941+v-shobhit@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
|
2026-10-08 00:10:32 +00:00 |
|
|
YueshenZandsfeng33
|
ed825aafc0
|
[Bugfix][Frontend] Fix Responses namespace aliases in named tool calling (#59723)
Signed-off-by: Shen <312058264+YueshenZ@users.noreply.github.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: sfeng33 <4florafeng@gmail.com>
|
2026-10-08 00:07:52 +00:00 |
|
|
Dhairyashil R Gandsfeng33
|
d6fe5dca68
|
[Bugfix][Parser] Emit buffered post-reasoning text when no tool parser is configured (#58911)
Signed-off-by: Dhairyashil R G <18738735+dhairyashilRG@users.noreply.github.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: sfeng33 <4florafeng@gmail.com>
|
2026-10-07 23:21:51 +00:00 |
|
|
|
ef63c23d35
|
[Bugfix][DSv4.1] Skip SWA bounded replay for KV loads that carry the window (#59197)
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 15:28:42 -07:00 |
|
|
|
f38c6778ce
|
[quantization] Add per-token NVFP4 quantization MoE support for ReLU2 (#56740)
Signed-off-by: Xuanteng Huang <xuantengh@nvidia.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-10-07 22:01:09 +00:00 |
|
|
|
b803edbc9f
|
[Model] Streamline EmbeddingGemma 2 config resolution and harmonize Triton prefill attention (#60289)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-10-07 14:56:40 -07:00 |
|
|
Simon Danielsson
|
947dd62c07
|
[CI] Fix failing test_deepseek_v4_rocm_dspark* tests (#60462)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-10-07 14:18:19 -07:00 |
|
|
Rui
|
08567505b0
|
[Bugfix][KV Offload] Restore KVCR construction through the secondary-tier factory (#58088)
|
2026-10-07 21:36:57 +02:00 |
|
|
|
e572e02d21
|
[UX] Skip checkpoint shards an MTP head does not load (#60152)
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 15:16:19 -04:00 |
|
|
Moein Khazraee
|
17c70c8953
|
[KV Offload] Update KVCR adapter to pool-and-index API (#59899)
|
2026-10-07 21:14:07 +02:00 |
|
|
|
b9767299db
|
[Bugfix] Respect Inductor deterministic mode in combo-kernel defaults (#59074)
Signed-off-by: cheesecake <farzanaman99@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 20:08:11 +01:00 |
|
|
Giancarlo Delfin
|
6ee9be6b3c
|
[Spec Decode] Rename AR speculators to StandaloneAR / TargetDependentAR (#60335)
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
|
2026-10-07 14:01:59 -04:00 |
|
|
|
fba462e008
|
[Bugfix]Fix FlashInfer warmup crash: autotune(tuning_buckets=...) must round M up, not down (Invalid MXFP8 split-K tactic with spec-decode) (#58165)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 14:01:21 -04:00 |
|
|
|
554340f3d3
|
[Attention] Support NVFP4 KV cache on SM8x and SM12x with FlashInfer (#46963)
Signed-off-by: lesj0610 <lesj0610@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: lesj0610 <lesj0610@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-10-07 13:24:21 -04:00 |
|
|
|
3d6853b32c
|
[Bugfix] Seed hybrid mamba state index with mamba_block_size on prefix-cache hits (#55601)
Signed-off-by: pondzikk <pondzik@gmail.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: ptorsten <1652174+ptorsten@users.noreply.github.com>
|
2026-10-07 17:09:50 +00:00 |
|
|
Harry MellorandClaude Opus 5.5
|
a8260cbc5c
|
[CI] Bump Transformers version to 5.19.0 (#60381)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 10:01:41 -07:00 |
|
|
MohitAMDandCursor
|
240ee8de9e
|
[Bugfix][KV Connector][ROCm] Fix MoRI-IO KV block-offset for speculative decoding (MTP) (#55053)
Signed-off-by: Mohit Deopujari <Mohit.Deopujari@amd.com>
Signed-off-by: MohitAMD <mohit.deopujari@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-10-07 11:33:30 -05:00 |
|
|
xaguilar-amdandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
9367d8b969
|
[Bugfix][MLA] Scope DSpark non-causal capability to builder layers (#57992)
Signed-off-by: Xavier Aguilar <xavier.aguilarfruto@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-07 10:22:32 -05:00 |
|
|
stefankoncarevic
|
71f9a74920
|
[CI][ROCm] Re-enable the DSv4.1 decoder replay graph test on ROCm (#60392)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
|
2026-10-07 09:57:52 -05:00 |
|
|
Mikko TukiainenandCursor
|
548597367e
|
[ROCm][Perf] Add AITER FlyDSL GDN prefill backend (#57560)
Signed-off-by: Mikko Tukiainen <Mikko.Tukiainen@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-10-07 09:44:22 -05:00 |
|
|
Micah WilliamsonandFangzhou Ai
|
f6e3944e31
|
[ROCm][DSv4] AITER MegaMoEV2 Integration For DeepSeek V4 (#59685)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Fangzhou Ai <31551580+Fangzhou-Ai@users.noreply.github.com>
|
2026-10-07 09:35:53 -05:00 |
|
|
|
c83935b300
|
[Bugfix][Model Loader] Support reload_weights with runai_streamer load format (#58124)
Signed-off-by: Viktor Koukouliev <vkoukouliev@nvidia.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-10-07 14:04:35 +00:00 |
|
|
00CC
|
5281e49908
|
[ROCm][Perf] Enable medium-skinny dispatch in RDNAHybridW4A16LinearKernel (#52619)
Signed-off-by: tangzzycc <3081129260@qq.com>
|
2026-10-07 13:21:43 +00:00 |
|
|
Divakar VermaandAndreas Karatzas
|
efb8d85f24
|
[ROCm][CI] Add FP32 rounding slack to accuracy test near-tie upper bounds (#60292)
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-10-07 08:19:22 -05:00 |
|
|
|
2a54f6b625
|
[ROCm][Perf][GLM-5.3-Flash] Enable AITER fused shared experts on gfx950 (#59221)
Signed-off-by: Jin Tao <jin.tao@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Simon Danielsson <70206058+simondanielsson@users.noreply.github.com>
|
2026-10-07 20:53:40 +08:00 |
|
|
stefankoncarevic
|
3ca00a8261
|
[CI] Skip EmbeddingGemma2 pooling tests needing transformers >= 5.19.0 (#60371)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
|
2026-10-07 10:22:31 +00:00 |
|
|
Kevin H. LuuandClaude Opus 5.5
|
02d8a94e61
|
[CI][ROCm] Skip DSv4.1 decoder replay graph test on ROCm (#60378)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 02:38:31 -07:00 |
|
|
|
df417f780a
|
[Bugfix][MoRIIO] Exclude synchronous READ destinations from KV zeroing (#59164)
Signed-off-by: Yichao Zhu <Yichao.Zhu@amd.com>
Signed-off-by: whx-sjtu <xiaowang990929@gmail.com>
Signed-off-by: Hexiang Wang <56632993+whx-sjtu@users.noreply.github.com>
Co-authored-by: Yichao Zhu <Yichao.Zhu@amd.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
|
2026-10-07 16:35:56 +08:00 |
|
|
|
42ecc8eebe
|
[CI][RL] Consolidate RL entrypoint tests under tests/entrypoints/rl (#59948)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 08:29:09 +00:00 |
|
|
stefankoncarevic
|
90f4936d9e
|
[CI/Build] Widen the ragged prefill scoring tolerance, drop batch invariance (#60192)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
|
2026-10-07 16:21:47 +08:00 |
|
|
|
e6fc81bc78
|
[Bugfix][Scheduler] Let pooling chunked prefill use full context (#48039)
Signed-off-by: Tommy <tran.tommy@hotmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-10-07 07:32:00 +00:00 |
|
|
SrirajandClaude
|
43b4aaea3e
|
[Bugfix][Frontend] Return 4xx for client errors in /cohere/v2/chat (#60309)
Signed-off-by: sricursion <sricursion@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-10-07 04:55:34 +00:00 |
|
|
Turner JabbourandClaude Sonnet 5
|
aecb717f10
|
[CI] Allowlist-shrink batch 2: wire 9 tests/models/ files into Buildkite, fix 2 stale bugs found (#59050)
Signed-off-by: Turner Jabbour <doubleujabbour@gmail.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
|
2026-10-06 21:16:53 -07:00 |
|
|
Mohammad HijjawiandCyrus Leung
|
ef014bdf06
|
[Bugfix][Frontend] Return logprobs in Cohere Chat v2 responses (#59072)
Signed-off-by: Mohammad Hijjawi <mohammad.hijjawi1997@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-10-07 04:13:52 +00:00 |
|
|
Hyukjoon LeeandClaude Opus 5.5
|
2342343746
|
[ROCm][DCP] Default MLA DCP verify to the round-robin asm decode where it applies (#59965)
Signed-off-by: hyukjlee <hyukjlee@amd.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 03:10:54 +00:00 |
|
|
|
8a26869bca
|
[Bugfix] Index Mamba align state copies by request slot in MRV2 (#60210)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Karl0007 <44745209+Karl0007@users.noreply.github.com>
Co-authored-by: Yongqin Wang <yongqinwang@roblox.com>
|
2026-10-07 02:32:46 +00:00 |
|
|
|
956960f85f
|
[Perf][MRV2] Avoid stream syncs in NonUvaBuffer host-to-device copies (#60215)
Signed-off-by: cheesecake <farzanaman99@gmail.com>
Co-authored-by: William Joyner <133391209+joynerwk03@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 01:51:12 +00:00 |
|
|
Robert ShawandClaude Code
|
283d76d56a
|
[Bugfix] Widen ep_gather output offset to int64 (#58373)
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Claude Code <noreply@anthropic.com>
|
2026-10-07 01:45:04 +00:00 |
|
|
|
fe51194e2d
|
[Bugfix][MiniMax-M3] Fence decode indexer shared-memory stage reuse (#60194)
Signed-off-by: Vladimir Anisimov <vanisimov@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-10-07 01:35:12 +00:00 |
|