 Misha GoinandClaude
|
e3a29aa9b3
|
[Bugfix][MoE] Size the permute scratch from its inputs (#60447)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-10-08 15:32:07 -04:00 |
|
|
SeongJun LeeandMisha Goin
|
fff10d2072
|
[Attention] Allow an NVFP4 KV cache on SM90 with fa2 (#60620)
Signed-off-by: lesj0610 <lesj0610@gmail.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-10-08 12:16:22 -07:00 |
|
|
Kevin LiandMisha Goin
|
fc494822ea
|
[Test][Quantization] Gate CUTLASS W4A8 kernel tests to SM90 (#58878)
Signed-off-by: Kevin Li <kevinbean99@gmail.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-10-08 19:14:35 +00:00 |
|
|
Divakar VermaandAndreas Karatzas
|
18751bc6a7
|
[ROCm][CI] Add coverage for AiterExperts token padding: inf/nan garbage rows (#59334)
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-10-08 19:11:45 +00:00 |
|
|
Aarushi JainandAndreas Karatzas
|
9bbc581560
|
[Bugfix] Close MessageQueue zmq resources via finalizer to avoid exit (#60472)
Signed-off-by: aarushjain29 <aarushi.jain2@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-10-08 13:53:00 -05:00 |
|
|
Yeonwoo SungandFlora Feng
|
56e6da2c47
|
[Bugfix][Frontend] Honor stop_token_ids on the Responses API (#56592)
Signed-off-by: YeonwooSung <neos960518@gmail.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-10-08 18:47:30 +00:00 |
|
|
Ning XieandSimon Mo
|
c4a5ff5c18
|
[Frontend] shutdown engine core and its sub processes asap when initializing (#52299)
Signed-off-by: Andy Xie <andy.xning@gmail.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
|
2026-10-08 11:46:01 -07:00 |
|
|
Misha GoinandClaude
|
30c7405890
|
[MoE] MXFP4 oracle: add CUTLASS W4A4 backend and BF16 activation fallback (#60079)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-10-08 11:39:09 -07:00 |
|
|
|
d8fa463e2b
|
[Bugfix][Prefix caching] Fix inconsistent hybrid Mamba prefix cache boundaries (#60533)
Signed-off-by: Wei Zhao <weizha@aws-cmh-slurm-1-login-01.cm.cluster>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Wei Zhao <weizha@aws-cmh-slurm-1-login-01.cm.cluster>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-08 18:33:48 +00:00 |
|
|
|
1664c4f444
|
[Bugfix][MiniMax-M3] Guard sparse decode sentinel indices (#54597)
Signed-off-by: Kyle Liang <kylliang@nvidia.com>
Signed-off-by: Kyle Liang <kyleliang-nv@users.noreply.github.com>
Co-authored-by: Kyle Liang <kyleliang-nv@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-08 18:27:57 +00:00 |
|
|
Francisco Javier ArceoandMisha Goin
|
705e124c05
|
[Bugfix] Followup to #59299: preserve Unicode in structured decision state prompts (#60651)
Signed-off-by: Francisco Javier Arceo <4163062+franciscojavierarceo@users.noreply.github.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-10-08 11:00:03 -07:00 |
|
|
Elvir CrnčevićandMisha Goin
|
8674a794c7
|
[Perf] Enable Kimi K3 shared expert sharding with DeepEP v2 (#56875)
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-10-08 16:42:15 +00:00 |
|
|
stefankoncarevic
|
f4dde3132c
|
[CI][ROCm] Reuse AITER's prebuilt MoE module in the modular-kernel harness (#60633)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
|
2026-10-08 11:18:05 -05:00 |
|
|
|
9f3d70e081
|
[Quantization] Enable shared expert fusion compatibility with online shared_expert quantization (showcase: along Quark MXFP4 routed experts) (#55686)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Signed-off-by: fxmarty-amd <felmarty@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-10-08 12:04:46 -04:00 |
|
|
Mikko TukiainenandCursor
|
e2414ec1db
|
[ROCm][Qwen4Exp] Use fused PLE Triton kernels on the AMD backend (#60021)
Signed-off-by: Mikko Tukiainen <Mikko.Tukiainen@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-10-08 15:47:56 +00:00 |
|
|
|
e41d5d5543
|
[Bugfix] Don't warn about missing watermark config for default requests (#60412)
Signed-off-by: Simon Veitner <sveitner@redhat.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
|
2026-10-08 15:29:20 +00:00 |
|
|
Haokai MaandClaude
|
0751f5272f
|
[Bugfix] Scope deprecated CLI argument warnings to the parser that defines them (#59917)
Signed-off-by: Tyler Ma <158780265+TylerMa-debugg@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-10-08 15:29:04 +00:00 |
|
|
Woosuk Kwon
|
194bd72be7
|
[Compile] Remove torch.compile-based sequence parallelism and AsyncTP (#60517)
|
2026-10-08 08:28:23 -07:00 |
|
|
wangxiyuanandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
072d49bb6e
|
[Platform] Support platform-specific MLA prefill backend selection (#56959)
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-08 15:25:21 +00:00 |
|
|
JartX
|
994b8b77be
|
[Bugfix][ROCm] RDNA3 W4A16 MoE: handle the N-first CT weight layout (#60388)
Signed-off-by: JartX <sagformas@epdcenter.es>
|
2026-10-08 15:06:39 +00:00 |
|
|
kliuae
|
d80ddaac73
|
[ROCm][Perf] Kimi-K3 Store only the current rank's shards in latent MoE up-proj (#59591)
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
|
2026-10-08 14:55:20 +00:00 |
|
|
|
d33872dfeb
|
[Feat] Structured decisions endpoint (/v1/systemone) (#59299)
Signed-off-by: Matt Mastracci <matthew@mastracci.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Francisco Javier Arceo <4163062+franciscojavierarceo@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Francisco Javier Arceo <4163062+franciscojavierarceo@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-10-08 14:48:12 +00:00 |
|
|
yhcheong (vllmellm)
|
273e099693
|
[Bugfix][ROCm] Select page-aligned kernel blocks for pooled indexers so the block table addresses storage pages (GLM-5.3-Flash) (#59412)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
|
2026-10-08 14:44:58 +00:00 |
|
|
zzaebok
|
2f7f05c256
|
[Bugfix][MoRIIO] Prevent remote KV reload after decoder preemption (#53250)
Signed-off-by: Jaebok Lee <jaebok9541@naver.com>
|
2026-10-08 22:28:16 +08:00 |
|
|
|
daa9085143
|
[KV Connector][NIXL] Register HiSparse host pool under single TP Rank (#60161)
Signed-off-by: Pravein Govindan Kannan <pravein.govindan.kannan@ibm.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-08 07:25:02 -07:00 |
|
|
Matthew BonanniandClaude Opus 5.5
|
4ed4c4433b
|
[Bugfix][HiSparse] Drop the unaccounted, write-only prefill mirror staging buffer (#60429)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-08 14:00:49 +00:00 |
|
|
Vineeth Sai VarikuntlaandHarry Mellor
|
194da61de1
|
[Bugfix] Reject negative --device-ids indices instead of selecting the wrong device (#49053)
Signed-off-by: Vineeth Sai <vineethsai4444@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-10-08 13:01:25 +00:00 |
|
|
|
458ba2edf8
|
[ROCm][Kimi-K3] Fuse AttnRes output with per-token FP8 input quantization (#59069)
Signed-off-by: whx-sjtu <xiaowang990929@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Fangzhou Ai <31551580+Fangzhou-Ai@users.noreply.github.com>
|
2026-10-08 12:01:47 +00:00 |
|
|
|
73c742b09c
|
[Bugfix] Make disable_any_whitespace actually disable whitespace on xgrammar (#58067)
Signed-off-by: Stu Cao <stu@primeintellect.ai>
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Artem Perevedentsev <aperevedents@nvidia.com>
|
2026-10-08 14:41:14 +03:00 |
|
|
Andy Lo
|
ba77c4c130
|
[Bugfix][Attention] Preserve small FP8 softmax weights in Triton attention (#60156)
Signed-off-by: Andy Lo <andy@mistral.ai>
|
2026-10-08 12:35:22 +02:00 |
|
|
Nicolò Lucchesi
|
e161a0798c
|
[Perf][Core] Reduce free KV cache queue overhead (#60269)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-10-08 10:17:11 +00:00 |
|
|
wang.yuqi
|
459764104d
|
[Frontend] Move offline_utils.py to entrypoints/common. (#58052)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-10-08 09:56:05 +00:00 |
|
|
Muhammad Usman MateenandMisha Goin
|
e73895a5df
|
[Bugfix] Make suppress_stdout redirect fd 1 instead of sys.stdout.fileno() (#59336)
Signed-off-by: usmanmateen <usmanmateen255@gmail.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-10-08 09:52:50 +00:00 |
|
|
Kevin H. LuuandClaude Opus 5.5
|
24be8c0bca
|
[CI] Remove dead in-tree TPU (torch_xla) CI scripts (#60591)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-08 02:42:07 -07:00 |
|
|
Jiangyun ZhuandClaude Opus 5.5
|
e265b77982
|
[CI][Mamba] Use well-conditioned prompts for FlashInfer ReplaySSM parity tests (#60515)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-08 17:39:56 +08:00 |
|
|
|
7816afdb25
|
[Bugfix][Core] Drain async KV loads in pause(mode="wait"), and pause the drain test only once a request is in flight (#60572)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-08 09:33:41 +00:00 |
|
|
Harry MellorandClaude Opus 5.5
|
21d9758459
|
Remove Python 3.10 support now that it is EOL (#60402)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-08 02:30:52 -07:00 |
|
|
Rehan KhanandBob
|
fd0216d3b5
|
[Bugfix][CPU] Fix fused Gumbel-max wrapping-window bias (#60221)
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
Co-authored-by: Bob <bob@ibm.com>
|
2026-10-08 15:15:53 +08:00 |
|
|
stefankoncarevicandAndreas Karatzas
|
814301b268
|
[Bugfix][Quant] Read safetensors headers of checkpoints with other file names (#60411)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-10-08 01:38:41 -05:00 |
|
|
Vadim GimpelsonandClaude
|
ee406adf0c
|
[Bugfix] Fix ZeroDivisionError in Qwen3-VL video sampling when the source fps is unknown (#60501)
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-10-08 06:28:44 +00:00 |
|
|
|
f226af0e11
|
[Bugfix] Eliminate frontend ZMQ port TOCTOU with inherited listeners (#54113)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-08 06:25:27 +00:00 |
|
|
|
fb2ac82458
|
[ROCm][DSv4.1][Perf] Replace the Torch prefill combine with the shared combine_topk_swa_indices kernel (#56638)
Signed-off-by: JohnQinAMD <yanyuan.qin@amd.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Ren Yuzhou <54501155+yuzhouo7@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
|
2026-10-08 14:15:18 +08:00 |
|
|
Jiahan Chang (Cyrus)
|
816173ca9d
|
[Kernel] Remove WAR for LL CuTeDSL BF16 GEMM (#60434)
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
|
2026-10-08 05:38:07 +00:00 |
|
|
|
81198e97ba
|
[Refactor] Abstract DeepGemm MegaMOE backend (#58053)
Signed-off-by: Hui Shi <kalinshi@tencent.com>
Co-authored-by: LuneExplorer <liyihan23@mails.tsinghua.edu.cn>
Co-authored-by: ArmageddonKnight <bojian@cs.toronto.edu>
|
2026-10-08 05:05:39 +00:00 |
|
|
|
775792f2d5
|
[Bugfix] Reland #53020: tie lm_head.weight for Nemotron Parse when checkpoint omits it (#60272)
Signed-off-by: Anish Kumar <aniskumar@nvidia.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-10-08 04:40:55 +00:00 |
|
|
|
4187ade7b8
|
[Frontend] Consolidate rl entrypoints. (#57849)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 21:37:11 -07:00 |
|
|
|
1fbbfa1657
|
[Bugfix][Kimi-K3] Declare max_tp_shards on the DSpark MLA KV cache spec (#59733)
Signed-off-by: hyukjlee <hyukjlee@amd.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Summer Yang <girasoleyang@gmail.com>
|
2026-10-08 00:33:32 -04:00 |
|
|
MattandClaude Opus 5.5
|
5dd4a628dd
|
[ROCm][Bugfix] Map sleep-mode cuMem memory for the host (#60367)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-08 04:26:12 +00:00 |
|
|
Isotr0pyandShanshan Shen
|
8352b2427f
|
[Multimodal] Optimize encoder cudagraph padding logic (#58925)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-10-08 03:38:09 +00:00 |
|
|
Simon DanielssonandDouglas Lehr
|
87d9996abe
|
[ROCm][Perf][GLM-5.3-Flash] BF16 splitk kernel for sparse MLA decode (#58584)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
|
2026-10-07 21:37:51 -05:00 |
|