 Flora Feng
|
d98c8c030b
|
[Bugfix] Parse DSML tool calls when the model omits the tool_calls wrapper (#55954)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
|
2026-09-08 17:38:04 -07:00 |
|
|
Michael LazosandOpenAI Codex
|
28a73ccfba
|
[Kernel] Add NVFP4 support to the torch linear backend (#53319)
Signed-off-by: Michael Lazos <mlazos@meta.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-08 20:30:05 -04:00 |
|
|
Nick Hill
|
4aadb0f14d
|
[Core] Enhance cpu<->gpu sync checking to include paged async copies (#53491)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-09-08 17:26:21 -07:00 |
|
|
Qidong SuandOpenAI Codex
|
9e137d8d23
|
[Kernel] Enable optimized FlashInfer add-RMSNorm NVFP4 fusion (#51925)
Signed-off-by: Qidong Su <qidongs@nvidia.com>
Signed-off-by: Qidong Su <soodoshll@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-08 17:20:32 -07:00 |
|
|
Jing Wang
|
c268198715
|
[Bugfix][Spec Decode] Preserve target parallel config (DCP) for DSpark (#55472)
Signed-off-by: Jing Wang <jingwang96@qq.com>
|
2026-09-08 16:59:10 -07:00 |
|
|
Taneem Ibrahim
|
5af4cc33ec
|
[Bugfix] Fix OpenPangu multimodal embedding merge (#55941)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-09-08 23:53:59 +00:00 |
|
|
|
9c2d21046b
|
[Bugfix][Spec Decode] Honour the draft's moe_backend on Model Runner V2 (#54788)
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-08 16:50:07 -07:00 |
|
|
|
c0d8d5413e
|
[Transformers] Generalize merged-column linear fusion (#55301)
Signed-off-by: BANANASJIM <bananasjim1@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-08 23:49:37 +00:00 |
|
|
|
60ad959b6f
|
Fix block FP8 MTP in ModelOpt mixed checkpoints (#55513)
Signed-off-by: Shiyang Chen <shiychen@nvidia.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-08 22:47:21 +00:00 |
|
|
Chaitanya Sri Krishna Lolla
|
28a2ccee78
|
[ROCm][DI][CI] Enable WideEP Intranode tests (#53195)
Signed-off-by: lcskrishna <lollachaitanya@gmail.com>
|
2026-09-08 17:06:36 -05:00 |
|
|
Kevin H. Luu
|
05e52f6336
|
[CI] Fix ARM64 test dependency builds with GCC 15 (#55877)
Signed-off-by: khluu <khluu000@gmail.com>
|
2026-09-08 14:27:13 -07:00 |
|
|
|
bf339618d1
|
[Misc] Bump openai to >=2.25.0 to support namespace tools types (#49104)
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-09-08 14:11:12 -07:00 |
|
|
Wentao Ye
|
bfb443a6b6
|
[Kimi Bug] Fix kda ima Triton Error [CUDA]: an illegal memory access was encountered (#55924)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-09-08 14:07:54 -07:00 |
|
|
Flora FengandWentao Ye
|
0a742da274
|
[Perf] Eliminate full-history reasoning scans for structured outputs (#55223)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-09-08 14:07:22 -07:00 |
|
|
Flora FengandWentao Ye
|
29f46ac475
|
[Perf] Eliminate full-history reasoning scans for structured outputs (#55223)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-09-08 14:07:16 -07:00 |
|
|
djramicandKevin H. Luu
|
73f61d12aa
|
[CI][ROCm] Increase timeouts for AMD MI300 jobs (#55919)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
|
2026-09-08 14:06:05 -07:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
db3814a4f2
|
[Attention] Require explicit DCP support from attention implementations (#55780)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-08 14:04:27 -07:00 |
|
|
Andreas Karatzas
|
cb22234687
|
[CI] Reuse ColQwen3 models across pooling tests (#55889)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-09-08 14:03:54 -07:00 |
|
|
|
d29c88f162
|
[Core] Let SWA layers take the primary block size to avoid inflating the KV block LCM (#53007)
Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-08 16:44:43 -04:00 |
|
|
|
808353f477
|
[CI] Split long misc test groups by command (#52346)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-08 13:44:14 -07:00 |
|
|
Andreas Karatzas
|
18615ad1ee
|
[Bugfix] Handle null RoPE parameters for NoPE layers (#55949)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-08 20:20:05 +00:00 |
|
|
|
e0aaef85f3
|
[2/N][KV Connector][NIXL] Support per-region transfer geometry (#53780)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-08 16:01:12 -04:00 |
|
|
Roderick Wuandmgoin
|
2c9d68f80b
|
[Quant][Kernel] Remove GPTQ Group/Dynamic Activation Ordering (#54809)
Signed-off-by: Roderick-Wu <roderickwu2003@gmail.com>
Signed-off-by: Roderick Wu <roderickwu2003@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
|
2026-09-08 12:45:12 -07:00 |
|
|
shikamd123
|
1a522b6949
|
[ROCm] [Docker] Upgrade default AINIC repo to ship libionic 54.0-187-1 (#54112)
Signed-off-by: Shiksha Patel <shiksha.patel@amd.com>
|
2026-09-08 19:21:18 +00:00 |
|
|
sychen52andCyrus Leung
|
1b2c591cd0
|
[Bugfix] speedup nvfp4 kv for FMHA (#55031)
Signed-off-by: Shiyang Chen <shiychen@nvidia.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-09-08 17:25:42 +00:00 |
|
|
Raya Elena Solanoandmgoin
|
bcca76e7db
|
[Test] Dequantize NVFP4 KV cache scales in the layout the kernel writes (#55908)
Signed-off-by: Raya Elena Solano <raya.solano@mbinf.de>
Co-authored-by: mgoin <mgoin64@gmail.com>
|
2026-09-08 17:13:39 +00:00 |
|
|
|
8ebc5b0a18
|
[Bugfix] Fix NVFP4 fused SiLU+mul scale allocation and global scale direction (#55643)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: khluu <khluu000@gmail.com>
Co-authored-by: jiahao <jxia77@terpmail.umd.edu>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
|
2026-09-08 08:26:07 -07:00 |
|
|
Wentao Ye
|
6b15bea080
|
[Refactor] Remove utils dead code (#53941)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-09-08 11:22:09 -04:00 |
|
|
Qiu Chunshuo
|
7c2f1ff495
|
[Core] Scope PCP-DP validation to GPU manager (#54523)
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
|
2026-09-08 08:18:01 -07:00 |
|
|
Canlin GuoandOpenAI Codex
|
8e1f97e709
|
[Qwen3.8-Flash-Next] Tune FP8 TP2/TP4 Triton MoE on B200 (#55890)
Signed-off-by: Canlin <canlinguosdu@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-08 22:45:18 +08:00 |
|
|
linitra24
|
b105d8284f
|
[LoRA] Clarify target module matching logic (#55865)
Signed-off-by: linitra24 <renshuang.zhou@daocloud.io>
|
2026-09-08 07:30:15 -07:00 |
|
|
Wentao Ye
|
07950d4734
|
[Kimi Bug] Fix kimi k3 startup cuda graph issue with recoverSSM (#55774)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-09-08 10:29:53 -04:00 |
|
|
Roberto L. CastroandCodex
|
6ddbab03de
|
[4/N][warmup][DSv4] Migrate common attention kernels (#50176)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-09-08 10:25:48 -04:00 |
|
|
Sherif WalyandNicolò Lucchesi
|
f998862d46
|
[Bugfix] Fix Kimi K3 loading with interleaved weight streams (#53379)
Signed-off-by: Sherif Waly <sherif.waly@mistral.ai>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@mistral.ai>
|
2026-09-08 16:08:51 +02:00 |
|
|
Mohit SinglaandCodex
|
613ab20f7f
|
[Model] Enable torch.compile for Sarvam MLA (#55817)
Signed-off-by: mohit-sarvam <mohit@sarvam.ai>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-08 22:01:30 +08:00 |
|
|
|
263c4ff95f
|
[Bugfix][Spec Decode] Cache the Mamba state at the block-grid position of EAGLE resume (#53945)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: Adam Shaver <ashaver@nvidia.com>
Signed-off-by: akshaver <168006157+akshaver@users.noreply.github.com>
Co-authored-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: roikoren755 <26850796+roikoren755@users.noreply.github.com>
|
2026-09-08 09:59:58 -04:00 |
|
|
|
414057a3d3
|
[Bugfix] Apply attention sinks in the Transformers backend (#52156)
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-08 13:54:07 +00:00 |
|
|
|
472d8c9125
|
[Perf] Fuse DeepEncoder relative bias in Triton attention (#55629)
Signed-off-by: levius <2114377220@qq.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-08 13:22:04 +00:00 |
|
|
Andy LoandOpenAI Codex
|
5ebce2391e
|
[Bugfix][KV Offload] Respect prefix-cache bypass in SimpleCPUOffload (#54998)
Signed-off-by: Andy Lo <andy@mistral.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-08 13:14:19 +00:00 |
|
|
Stefano Castagnetta
|
f6326f53bd
|
[Perf][GDN] Enable the FlashInfer GDN prefill kernel on SM12x (#55715)
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
|
2026-09-08 12:26:03 +00:00 |
|
|
Shanshan Shen
|
25047604fe
|
[ROCm][Perf] Remove AITER paged-MQA outputs guard for DeepSeek-V4 (#55808)
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
|
2026-09-08 06:58:26 -05:00 |
|
|
Kevin H. Luu
|
34b9899c8f
|
[CI] Increase ColQwen3 pooling test memory budget on H200 MIG (#55878)
Signed-off-by: khluu <khluu000@gmail.com>
|
2026-09-08 11:39:01 +00:00 |
|
|
Stefano Castagnetta
|
13cf9e05c1
|
[Perf][Quant][NVFP4] Prefer W4A4 linear kernels over weight-only ones on SM120/121 (#55170)
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
|
2026-09-08 15:06:45 +04:00 |
|
|
jimmy-adams
|
e41a17e606
|
[ROCm][Quantization] Support AMD Quark per-block FP8 for fused MoE layers (#52263)
Signed-off-by: huji <huidong.ji@amd.com>
Signed-off-by: jimmy-adams <41593649+jimmy-adams@users.noreply.github.com>
|
2026-09-08 10:30:26 +00:00 |
|
|
Kevin H. LuuandCodex
|
5db652225f
|
[Bugfix] Validate extension integers before engine serialization (#55606)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-08 16:30:06 +08:00 |
|
|
Kevin H. LuuandCodex
|
96eccb8f49
|
[CI] Restore clean GPU state before OAI Triton MoE tests (#55453)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-08 01:15:21 -07:00 |
|
|
Taoyu ZhuandShanshan Shen
|
ce6c241ddc
|
[ROCm][Perf][M3] Fused allreduce+GemmaRMSNorm fast path (#54787)
Signed-off-by: Taoyu Zhu <zhutaoyu97@gmail.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-09-08 07:21:49 +00:00 |
|
|
ahmed xijiaat
|
81dabe2e5d
|
[Bugfix][KV Offload] Validate SWA coverage at unaligned cache-hit boundaries (#55712)
Signed-off-by: xijiade.aihemaiti <3146335281@qq.com>
|
2026-09-08 10:15:48 +03:00 |
|
|
Adababyandshaolila
|
5133e1d285
|
[Frontend] Migrate input-validation errors to VLLMValidationError (harmony/mistral/chat_utils/params) (#55735)
Signed-off-by: shaolila <shaolila@buaa.edu.cn>
Co-authored-by: shaolila <shaolila@buaa.edu.cn>
|
2026-09-08 06:45:40 +00:00 |
|
|
aoshen02
|
755541443f
|
[Bugfix][ROCm] Mask paged attention V cache padding (#53856)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
|
2026-09-08 14:39:23 +08:00 |
|