 Paweł Mańczak
|
4cf1307e72
|
[XPU] Add tuned Mamba SSU configs for 2 more B70 shapes (#57565)
Signed-off-by: pmanczak <pawel.manczak@intel.com>
|
2026-10-08 16:36:05 +08:00 |
|
|
Ting SUN
|
0f112d1800
|
[Bugfix][Pooling] Preserve cache_salt for chunked embeddings (#47696)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
|
2026-10-08 07:33:28 +00:00 |
|
|
Alec
|
29ae81fe83
|
[Rust Frontend] Preserve explicit zero sampling values in gRPC requests (#60115)
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
|
2026-10-08 07:27:47 +00:00 |
|
|
Rehan KhanandBob
|
fd0216d3b5
|
[Bugfix][CPU] Fix fused Gumbel-max wrapping-window bias (#60221)
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
Co-authored-by: Bob <bob@ibm.com>
|
2026-10-08 15:15:53 +08:00 |
|
|
ARAVINDHAN Tandlinitra24
|
e58f8dde7f
|
[Bugfix] Use FusedMoEWithLoRA for shared MoE LoRAs on 3D models (#60098)
Signed-off-by: ARAVINDHAN T <arvindhant01@gmail.com>
Co-authored-by: linitra24 <renshuang.zhou@daocloud.io>
|
2026-10-08 15:04:32 +08:00 |
|
|
xiangdong
|
032d39e9b4
|
[XPU][CI] Split Intel jobs to improve B50 utilization (#58817)
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
Signed-off-by: xiangdong <40376367+zxd1997066@users.noreply.github.com>
|
2026-10-08 14:53:37 +08:00 |
|
|
stefankoncarevicandAndreas Karatzas
|
814301b268
|
[Bugfix][Quant] Read safetensors headers of checkpoints with other file names (#60411)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-10-08 01:38:41 -05:00 |
|
|
Vadim GimpelsonandClaude
|
ee406adf0c
|
[Bugfix] Fix ZeroDivisionError in Qwen3-VL video sampling when the source fps is unknown (#60501)
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-10-08 06:28:44 +00:00 |
|
|
|
f226af0e11
|
[Bugfix] Eliminate frontend ZMQ port TOCTOU with inherited listeners (#54113)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-08 06:25:27 +00:00 |
|
|
|
fb2ac82458
|
[ROCm][DSv4.1][Perf] Replace the Torch prefill combine with the shared combine_topk_swa_indices kernel (#56638)
Signed-off-by: JohnQinAMD <yanyuan.qin@amd.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Ren Yuzhou <54501155+yuzhouo7@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
|
2026-10-08 14:15:18 +08:00 |
|
|
Shanshan Shen
|
95307ac6d4
|
[Doc] Update ViT CUDA graph design doc (#60519)
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
|
2026-10-08 14:00:58 +08:00 |
|
|
Jiahan Chang (Cyrus)
|
816173ca9d
|
[Kernel] Remove WAR for LL CuTeDSL BF16 GEMM (#60434)
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
|
2026-10-08 05:38:07 +00:00 |
|
|
|
81198e97ba
|
[Refactor] Abstract DeepGemm MegaMOE backend (#58053)
Signed-off-by: Hui Shi <kalinshi@tencent.com>
Co-authored-by: LuneExplorer <liyihan23@mails.tsinghua.edu.cn>
Co-authored-by: ArmageddonKnight <bojian@cs.toronto.edu>
|
2026-10-08 05:05:39 +00:00 |
|
|
|
4ac0179f8a
|
[ROCm][Perf] Use native merge_attn_states kernel on gfx942/gfx950 (#60159)
Signed-off-by: mghanimi <mghanimi@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
|
2026-10-08 04:49:49 +00:00 |
|
|
|
775792f2d5
|
[Bugfix] Reland #53020: tie lm_head.weight for Nemotron Parse when checkpoint omits it (#60272)
Signed-off-by: Anish Kumar <aniskumar@nvidia.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-10-08 04:40:55 +00:00 |
|
|
|
4187ade7b8
|
[Frontend] Consolidate rl entrypoints. (#57849)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 21:37:11 -07:00 |
|
|
|
1fbbfa1657
|
[Bugfix][Kimi-K3] Declare max_tp_shards on the DSpark MLA KV cache spec (#59733)
Signed-off-by: hyukjlee <hyukjlee@amd.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Summer Yang <girasoleyang@gmail.com>
|
2026-10-08 00:33:32 -04:00 |
|
|
MattandClaude Opus 5.5
|
5dd4a628dd
|
[ROCm][Bugfix] Map sleep-mode cuMem memory for the host (#60367)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-08 04:26:12 +00:00 |
|
|
Isotr0pyandShanshan Shen
|
8352b2427f
|
[Multimodal] Optimize encoder cudagraph padding logic (#58925)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-10-08 03:38:09 +00:00 |
|
|
Simon DanielssonandDouglas Lehr
|
87d9996abe
|
[ROCm][Perf][GLM-5.3-Flash] BF16 splitk kernel for sparse MLA decode (#58584)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
|
2026-10-07 21:37:51 -05:00 |
|
|
bnkaiteamandFlora Feng
|
3722645539
|
[Bugfix][Frontend] Accept successful 2xx responses for batch output uploads (#60507)
Signed-off-by: bnkaiteam <bnkaiteam@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-10-08 02:32:35 +00:00 |
|
|
|
caff2b44cb
|
[BugFix] Pick the DP world-group port at bind time via the coordination store (#51018)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-10-08 02:30:35 +00:00 |
|
|
wangxiyuanandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
a4b14e57b6
|
[Platform] Allow BackendEnum dynamic register (#41091)
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-08 09:56:19 +08:00 |
|
|
MattandClaude Opus 5.5
|
9dba339d07
|
[Bugfix][ROCm] Keep MLA derived weights in place on weight reload (#60389)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-07 20:38:06 -05:00 |
|
|
Nicolò Lucchesi
|
8733a21d55
|
[Core] Bound execute_dummy_batch RPC waits by the execute-model timeout (#60398)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-10-08 01:22:04 +00:00 |
|
|
Junyi Yaoandsfeng33
|
fdfc171a74
|
[Bugfix][ToolParser] Stream every tool call when one delta completes several (#60354)
Signed-off-by: Junyi Yao <j.yao@wustl.edu>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: sfeng33 <4florafeng@gmail.com>
|
2026-10-08 01:07:35 +00:00 |
|
|
|
2dd887426e
|
[Bugfix][Frontend] Do not modify caller params in LLM.score() (#59959)
Signed-off-by: 叮当猫 <2756823972@qq.com>
Signed-off-by: apex-mochen <2756823972@qq.com>
Co-authored-by: DeepSeek Harness <noreply@deepseek.com>
Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-10-08 09:03:08 +08:00 |
|
|
|
9e3e37cb3c
|
[TEST][XPU][CI] disable tests of unsupported quantization (#60383)
Signed-off-by: microslaw <you@example.com>
Co-authored-by: microslaw <you@example.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-10-08 08:56:28 +08:00 |
|
|
Kang NahoonandFlora Feng
|
1995c0fcd0
|
[Bugfix][Frontend] Apply output_config and thinking in Anthropic count_tokens (#59180)
Signed-off-by: Kang Nahoon <ejrtks102020@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-10-08 00:24:20 +00:00 |
|
|
Kevin H. LuuandSherlock
|
1283362e76
|
[CI] Add headroom and selection coverage for H200 fast lanes (#56775)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Sherlock <sherlock@raft.ai>
|
2026-10-07 17:17:56 -07:00 |
|
|
Nicolò Lucchesi
|
a58bdd0d4e
|
[Perf] JIT monitor: hook TileLang JITImpl.compile instead of __call__ (#58685)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-10-08 00:11:59 +00:00 |
|
|
|
8faac3dd2a
|
[Bugfix] [Spec Decode] DeepSeek V4/V4.1 NVFP4: keep ignored MTP/DSpark experts on MXFP4 (#59655)
Signed-off-by: Shobhit Verma <shobhitv@nvidia.com>
Signed-off-by: v-shobhit <161510941+v-shobhit@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
|
2026-10-08 00:10:32 +00:00 |
|
|
YueshenZandsfeng33
|
ed825aafc0
|
[Bugfix][Frontend] Fix Responses namespace aliases in named tool calling (#59723)
Signed-off-by: Shen <312058264+YueshenZ@users.noreply.github.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: sfeng33 <4florafeng@gmail.com>
|
2026-10-08 00:07:52 +00:00 |
|
|
www6vandsfeng33
|
38dc8ee500
|
[Bugfix] Validate tool-parser/tokenizer compatibility at startup (#59749)
Signed-off-by: www6v <www6v@126.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: sfeng33 <4florafeng@gmail.com>
|
2026-10-07 23:46:41 +00:00 |
|
|
Dhairyashil R Gandsfeng33
|
d6fe5dca68
|
[Bugfix][Parser] Emit buffered post-reasoning text when no tool parser is configured (#58911)
Signed-off-by: Dhairyashil R G <18738735+dhairyashilRG@users.noreply.github.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: sfeng33 <4florafeng@gmail.com>
|
2026-10-07 23:21:51 +00:00 |
|
|
Artem Perevedentsev
|
4ac5a36a8e
|
[CI/Build][NVIDIA] Build NIXL with NIXL EP from source in Rubin image (#60090)
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
|
2026-10-08 02:44:17 +04:00 |
|
|
|
ef63c23d35
|
[Bugfix][DSv4.1] Skip SWA bounded replay for KV loads that carry the window (#59197)
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 15:28:42 -07:00 |
|
|
Nicolò LucchesiandMistral Vibe
|
d169c5a903
|
[Docs] Add disagg PD flow-example guidance to /pr-checklist skill (#60111)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: Mistral Vibe <noreply@mistral.ai>
|
2026-10-07 22:16:05 +00:00 |
|
|
|
f38c6778ce
|
[quantization] Add per-token NVFP4 quantization MoE support for ReLU2 (#56740)
Signed-off-by: Xuanteng Huang <xuantengh@nvidia.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-10-07 22:01:09 +00:00 |
|
|
|
b803edbc9f
|
[Model] Streamline EmbeddingGemma 2 config resolution and harmonize Triton prefill attention (#60289)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-10-07 14:56:40 -07:00 |
|
|
Simon Danielsson
|
947dd62c07
|
[CI] Fix failing test_deepseek_v4_rocm_dspark* tests (#60462)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-10-07 14:18:19 -07:00 |
|
|
Thang NguyenandKimi
|
b47ec440bc
|
[CI] Stamp provenance labels on the torch-nightly image so Initialized Snapshot E2E can run (#59487)
Signed-off-by: Thang Nguyen <thangnguyenvn647@gmail.com>
Co-authored-by: Kimi <noreply@moonshot.cn>
|
2026-10-07 14:15:39 -07:00 |
|
|
Misha GoinandClaude Opus 5.5
|
a982c81e3e
|
[Bugfix] Limit GlmMoeDsaForCausalLM fp8 KV cache default to SM100 (#60281)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 13:37:13 -07:00 |
|
|
Rui
|
08567505b0
|
[Bugfix][KV Offload] Restore KVCR construction through the secondary-tier factory (#58088)
|
2026-10-07 21:36:57 +02:00 |
|
|
|
e572e02d21
|
[UX] Skip checkpoint shards an MTP head does not load (#60152)
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 15:16:19 -04:00 |
|
|
Moein Khazraee
|
17c70c8953
|
[KV Offload] Update KVCR adapter to pool-and-index API (#59899)
|
2026-10-07 21:14:07 +02:00 |
|
|
|
b9767299db
|
[Bugfix] Respect Inductor deterministic mode in combo-kernel defaults (#59074)
Signed-off-by: cheesecake <farzanaman99@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 20:08:11 +01:00 |
|
|
Jinzhen LinandKevin H. Luu
|
32fbfa15e8
|
[Bugfix][Quantization] Accept folded NVFP4 scales for Humming A16 (#60337)
Signed-off-by: jinzhen.ljz <jinzhen.ljz@antgroup.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
|
2026-10-07 11:04:43 -07:00 |
|
|
Giancarlo Delfin
|
6ee9be6b3c
|
[Spec Decode] Rename AR speculators to StandaloneAR / TargetDependentAR (#60335)
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
|
2026-10-07 14:01:59 -04:00 |
|
|
|
fba462e008
|
[Bugfix]Fix FlashInfer warmup crash: autotune(tuning_buckets=...) must round M up, not down (Invalid MXFP8 split-K tactic with spec-decode) (#58165)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 14:01:21 -04:00 |
|