Venky and Claude Opus 5.5
d7c55116ac
[CI] Fix MiniMax-M3 PP aux-state test mock after #58648 ( #59508 )
...
Signed-off-by: venkywonka <23023424+venkywonka@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-09-30 17:34:52 -07:00
Kevin H. Luu and Claude Opus 5.5
8bc31bd210
[CI] Deflake the multi-API-server metrics test and Mooncake PD ports ( #59507 )
...
Signed-off-by: khluu <khluu000@gmail.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-09-30 17:22:58 -07:00
jackLei
21c08ac458
[CI] Deflake shutdown wait-timeout test by synchronizing on request admission ( #58125 )
...
Signed-off-by: jackLei0901 <42642542+jackLei0901@users.noreply.github.com >
2026-10-01 00:10:03 +00:00
Aarushi Jain and Andreas Karatzas
26ce58b48c
[ROCm][CI] Sync two AMD test groups between test-amd.yaml and test_areas ( #59499 )
...
Signed-off-by: aarushjain29 <aarushi.jain2@amd.com >
Co-authored-by: Andreas Karatzas <akaratza@amd.com >
2026-09-30 18:58:07 -05:00
Benjamin Chislett and Copilot
8fb16ea5a6
[Docs] Add PR checklist skill for coding agents ( #57084 )
...
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com >
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com >
2026-09-30 14:47:28 -07:00
Andrii Skliar and Andrii Skliar
deb148e730
[Mamba] Add FlashInfer ReplaySSM support for MTP ( #52928 )
...
Signed-off-by: Andrii Skliar <askliar@nvidia.com >
Co-authored-by: Andrii Skliar <askliar@nvidia.com >
2026-09-30 21:41:17 +00:00
kliuae and Nick Hill
7e583e615c
[Bugfix][Core] Fix mamba prefill checkpoint block reservation and prompt-end eviction in align mode ( #59175 )
...
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com >
Co-authored-by: Nick Hill <nickhill123@gmail.com >
2026-09-30 21:26:54 +00:00
Venky and Claude Opus 5.5
42f0c17ea7
[Bugfix][PP][Spec Decode] MiniMax-M3 EAGLE3 aux-state relay at PP > 1 and per-stage FlashInfer autotune ( #57197 )
...
Signed-off-by: venkywonka <23023424+venkywonka@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-01 01:14:24 +04:00
73c7cae4d7
[Bugfix][HiSparse] Stop the host pool feeding device KV cache residency metrics ( #58725 )
...
Signed-off-by: Yueh-Ting Chen <yueh.ting.chen@gmail.com >
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com >
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-09-30 20:50:01 +00:00
Nils Matteson
51048b13ce
[Docs] Clarify snapshot runtime image support ( #59127 )
...
Signed-off-by: Nils Matteson <nilsmatteson@icloud.com >
2026-09-30 20:31:21 +00:00
3eb6cec22a
[Bugfix][HiSparse] Adopt GPU prefix copies after the hit's allocation ( #59282 )
...
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-30 15:43:09 -04:00
84f738f187
[Perf][MiniMax-M3] Triton indexer: decode grid retune + SM12.0 split-K ( #56151 )
...
Signed-off-by: venkywonka <23023424+venkywonka@users.noreply.github.com >
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
Co-authored-by: Zijing Liu <liuzijing2014@gmail.com >
Co-authored-by: Kyle Liang <199154931+kyleliang-nv@users.noreply.github.com >
2026-09-30 23:33:23 +04:00
djramic and Andreas Karatzas
b56b54bc54
[ROCm][CI] Relax simple-nemotron-h-8b GSM8K threshold on ROCm ( #59477 )
...
Signed-off-by: Djordje Ramic <djoramic@amd.com >
Co-authored-by: Andreas Karatzas <akaratza@amd.com >
2026-09-30 19:27:21 +00:00
Matthew Bonanni and Claude Opus 5.5
a21a3f2ec7
[CI] Add supports_multimodal_inputs to test_executor_replace's mock config ( #59476 )
...
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-09-30 19:04:47 +00:00
Chaojun Zhang and Kunshang Ji
aba01ef1f7
[XPU][CI] Skip test_core_engine_actor_manager.py on Intel CI ( #59338 )
...
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com >
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com >
2026-09-30 13:23:02 -05:00
Aarushi Jain and Andreas Karatzas
ed3f6d1a56
[ROCm][CI] Remove duplicate MI355 DPX jobs ( #59256 )
...
Signed-off-by: aarushjain29 <aarushi.jain2@amd.com >
Co-authored-by: Andreas Karatzas <akaratza@amd.com >
2026-09-30 17:51:20 +00:00
Aarushi Jain and Andreas Karatzas
b33e1cb172
[ROCm]Transpose compressed-tensors MoE weights on device ( #59253 )
...
Co-authored-by: Andreas Karatzas <akaratza@amd.com >
2026-09-30 12:44:40 -05:00
8f24ab30a3
[ROCm][Kimi-K3][Perf] Fuse MLA decode KV-cache write and Q-prep via AITER ( #57640 )
...
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com >
Co-authored-by: Claude <noreply@anthropic.com >
Co-authored-by: Andreas Karatzas <akaratza@amd.com >
2026-09-30 12:20:05 -05:00
stefankoncarevic
d2fb35f66e
[CI][ROCm] Drop the duplicate OAI Triton MoE run from FP8 MoE Kernels ( #59237 )
...
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com >
2026-09-30 16:24:08 +00:00
Thien Tran and mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
8873ac83bb
[Docs] Add @gau-nernst to CODEOWNERS and committers ( #59369 )
...
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-30 16:23:40 +00:00
0f8b398158
[watermarking] add context deduplication support to speculative decoding ( #56807 )
...
Signed-off-by: Raphael Rialland <raphael.rialland@mistral.ai >
Signed-off-by: Simon Veitner <sveitner@redhat.com >
Co-authored-by: Simon Veitner <sveitner@redhat.com >
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com >
2026-09-30 12:22:10 -04:00
73a5831127
[Frontend] Port chat_parsing core from Transformers ( #58602 )
...
Signed-off-by: Yoni Gozlan <yonigozlan@users.noreply.github.com >
Co-authored-by: Yoni Gozlan <yonigozlan@users.noreply.github.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-10-01 00:21:02 +08:00
rasmith
42a3dd5fec
[ROcm][BugFix][The Rock] Update The Rock dockerfile to most recent Triton 3.8 ( #59287 )
...
Signed-off-by: Randall Smith <Randall.Smith@amd.com >
2026-09-30 11:15:03 -05:00
Yueh-Ting (eop) Chen and Matthew Bonanni
ff1b87cca2
[Bugfix][HiSparse] Preserve host prefix publication after request completion ( #59007 )
...
Signed-off-by: Yueh-Ting Chen <yueh.ting.chen@gmail.com >
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com >
2026-09-30 16:14:51 +00:00
Wei Zhao and Codex
279012f94d
[Docs] Add @wzhao18 to NVIDIA integration and kv offloading code owners ( #59456 )
...
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com >
Co-authored-by: Codex <codex@openai.com >
2026-09-30 16:12:12 +00:00
Eldar Kurtić
c32513b99d
Add support for unquantized ngram in CT format ( #59431 )
2026-09-30 16:08:31 +00:00
rasmith and Misha Goin
c4df37dfcc
[ROCm][BugFix][The Rock] Fix mori build for the rock ( #59372 )
...
Signed-off-by: Randall Smith <Randall.Smith@amd.com >
Co-authored-by: Misha Goin <mgoin64@gmail.com >
2026-09-30 10:51:40 -05:00
Juan Pérez de Algaba and Cursor
cff08b461e
[Security] Fix chat template resource-exhaustion DoS (GHSA-4hhp-h66f-… ( #50300 )
...
Signed-off-by: jperezde <jperezde@redhat.com >
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-09-30 08:32:00 -07:00
Harry Mellor and Claude Opus 5.5
fc2c801ad9
Disable mypy arg-type and assignment checks in tests ( #59428 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-09-30 15:18:50 +00:00
Yida Weng and Grok
17e9295dd5
[BugFix][Multimodal] Pick worst-case DeepSeek-V4 VL dummy image size ( #59271 ) ( #59373 )
...
Signed-off-by: Yida Weng <84164537+YidaWeng@users.noreply.github.com >
Co-authored-by: Grok <grok@x.ai >
2026-09-30 15:09:11 +00:00
Sergey Shlyapnikov
4e1182a3a6
[ROCm][MoE] Pad the AITER MoE intermediate size at allocation time, and round the expert-group count to a kernel that exists ( #55368 )
...
Signed-off-by: Sergei Shliapnikov <sergei.shliapnikov@amd.com >
2026-09-30 23:08:21 +08:00
Simon Danielsson and mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2df122e65e
[ROCm][Perf][GLM-5.3-Flash] "Fit kpool top-k indices to AITER" with a single Triton kernel ( #58008 )
...
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-30 09:45:00 -05:00
aoshen02 and Claude Opus 5.5
643bbef55c
[Refactor] Share workspace and model runner init between GPU and XPU workers ( #59200 )
...
Signed-off-by: aoshen02 <aoshen@inferact.ai >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-09-30 14:29:12 +00:00
Juan Pérez de Algaba and Cursor
eef8b15d7c
[Security] Bump pyjwt and rand for remaining GHSAs ( #59427 )
...
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-09-30 14:26:16 +00:00
Qiu Chunshuo and Lucas Wilkinson
98b45c1a94
[Feat] Support PP with PCP in GPU Model Runner V2 ( #59139 )
...
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com >
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com >
2026-09-30 10:21:56 -04:00
Giulio De Pasquale and Isotr0py
2e52a558f0
[Bugfix][Core] Schedule encoder-only prompts larger than one step ( #59029 )
...
Signed-off-by: Giulio De Pasquale <git@depasquale.giugl.io >
Co-authored-by: Isotr0py <2037008807@qq.com >
2026-09-30 22:04:28 +08:00
Chaojun Zhang and Kunshang Ji
02a3c6dfc5
[Test] Skip IPC weight-transfer test on XPU platforms ( #59379 )
...
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com >
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com >
2026-09-30 21:50:40 +08:00
Cyrus Leung
677e3f5d50
[CI/Build] Fix pre-commit ( #59426 )
2026-09-30 13:45:28 +00:00
Varun Sundar Rabindranath
5463fe4962
[KV-Offloading][TP] : Expand replicated_layout detection to multi-group MLA ( #57652 )
2026-09-30 09:11:03 -04:00
f28a508162
[Feature][Rust Frontend] Add Shutdown control RPC ( #59316 )
...
Co-authored-by: Bugen Zhao <i@bugenzhao.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
Signed-off-by: Julien Darve <jdarve@NVIDIA.com >
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
2026-09-30 12:49:25 +00:00
Harry Mellor and Claude Opus 5.5
b22494cc0c
[Docs] Reinstate docs build gate for PRs ( #59411 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-09-30 13:41:53 +01:00
effdea9a53
[MM][Mistral] Add compile support for Pixtral vision encoders ( #57168 )
...
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com >
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@mistral.ai >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-30 20:27:12 +08:00
almayne and Li, Jiang <jiang1.li@intel.com>
93dd80f636
[CPU] Conv1d optimised kernel for aarch64 ( #54093 )
...
Signed-off-by: Anna Mayne <anna.mayne@arm.com >
Co-authored-by: Li, Jiang <jiang1.li@intel.com >
2026-09-30 20:23:42 +08:00
df5668e5c9
[XPU] Dispatch nn.LayerNorm to fused SYCL kernel via CustomOp ( #57172 )
...
Signed-off-by: Michal Ganczarenko <michal.ganczarenko@intel.com >
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com >
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-09-30 12:19:33 +00:00
Juan Pérez de Algaba and Cursor
a4c4bb418e
[Security] Bump remaining Dependabot packages (excl. ignored) ( #59315 )
...
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-09-30 05:16:31 -07:00
3d5625cc3c
[Security] Authenticate shared-memory multimodal cache handles ( #59357 )
...
Signed-off-by: Clinton Thomas <1033162+KernelClint@users.noreply.github.com >
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com >
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk >
2026-09-30 05:16:26 -07:00
Rukhaiya2004 and Li, Jiang <jiang1.li@intel.com>
72e7874fa6
[Hardware][Power] Enable W4A16 (AWQ & GPTQ) quantization on POWER10 using VSX ( #59149 )
...
Signed-off-by: Rukhaiya <bibirukhaiya123@gmail.com >
Co-authored-by: Li, Jiang <jiang1.li@intel.com >
2026-09-30 19:44:48 +08:00
yuvalluria and Claude Sonnet 4.6
863475eb9c
docs: add gemma-2, SmolLM2, Qwen2.5-Coder, Llama-3.2-1B to batch invariance tested models ( #54441 )
...
Signed-off-by: Yuval Luria <yluria@redhat.com >
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com >
2026-09-30 11:13:23 +00:00
Jakub Zakrzewski and Codex
5a4351ab09
[MM] Keep device input normalization fused when encoder compilation is enabled ( #59195 )
...
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com >
Co-authored-by: Codex <codex@openai.com >
2026-09-30 11:08:24 +00:00
5225f1bacb
[MyPy][3/N] Fix MyPy errors in test groups (part 3) ( #55939 )
...
Signed-off-by: Taimys <ffy2281693949@gmail.com >
Signed-off-by: Luyi Xiao <81631911+luyixiao95@users.noreply.github.com >
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Codex <noreply@openai.com >
Co-authored-by: Luyi Xiao <81631911+luyixiao95@users.noreply.github.com >
Co-authored-by: Taimys <ffy2281693949@gmail.com >
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-09-30 11:06:07 +00:00
