 lzhan011andFlora Feng
|
9bf4e51030
|
[Bugfix][Frontend] Malformed $defs in a tool schema should be a 400, not a 500 (#54850)
Signed-off-by: lzhan011 <35493221+lzhan011@users.noreply.github.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-10-06 01:37:20 +00:00 |
|
|
amd-xavierwangandTJian
|
efd001756b
|
[ROCm] Disable AITER attention query quantization on RDNA3 (#57750)
Signed-off-by: xawang <xawang@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
|
2026-10-06 01:37:18 +00:00 |
|
|
|
2537629eb2
|
[Bugfix][KVConnector][NIXL] Size per-region replicate flags by each region's block count (#60107)
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-10-06 01:27:50 +00:00 |
|
|
|
0e8f8ecba8
|
[Bugfix][KVConnector][NIXL] Return NumPy descriptors from mixed-memory local registration (#60108)
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-10-06 01:23:20 +00:00 |
|
|
|
4e198cef83
|
[TEST][XPU][CI] Fix ci uva kernel test instability (#60041)
Signed-off-by: Your Name <you@example.com>
Co-authored-by: Your Name <you@example.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-10-06 09:19:01 +08:00 |
|
|
|
97bd8c74eb
|
[ROCm][DSv4.1][Perf] One-pass dequantize and a gather-sized grid for the compressed K cache (#56720)
Signed-off-by: JohnQinAMD <yanyuan.qin@amd.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-05 17:57:46 -07:00 |
|
|
|
b2863c0de9
|
[Kimi-K3] Use the fused K/V pack kernel on the decode-context-parallel prefill path (#56881)
Signed-off-by: Brandon Zhang <31413216+brandonfzhang@users.noreply.github.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>
|
2026-10-06 00:13:55 +00:00 |
|
|
Mai Hoàng ĐứcandFlora Feng
|
5cd8a2626b
|
[Bugfix][Structured Output] Cap JSON schema nesting to prevent 500s and API-server stalls (#60036)
Signed-off-by: Mazukiri <maihoangduc04@gmail.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-10-06 00:06:59 +00:00 |
|
|
Aarushi JainandAndreas Karatzas
|
fa423b614c
|
[CI][ROCm] Wait for engine teardown between LM Eval models (#60100)
Signed-off-by: aarushjain29 <aarushi.jain2@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-10-05 23:39:59 +00:00 |
|
|
MasonandYongye Zhu
|
6dd813e0b7
|
[Bugfix][MoE] Allow MiniMax2 routing in TRTLLM BF16 monolithic backend (#59571)
Signed-off-by: Mason Pitt <bradley.b.pitt@gmail.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
|
2026-10-05 16:24:14 -07:00 |
|
|
|
0eac152707
|
[Bugfix] Route every speculation-capable row through the speculative path so recurrent state stays consistent (#56531)
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-06 03:03:44 +04:00 |
|
|
Ting SUNandFlora Feng
|
4a705c7b54
|
[Bugfix][Frontend] Preserve logprobs when top_logprobs is null (#47838)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-10-05 22:43:31 +00:00 |
|
|
Kevin H. LuuandClaude Opus 5.5
|
89a00995c9
|
[CI] Read each profiler round's trace as it stops in test_gpu_profiler (#59769)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-05 15:25:11 -07:00 |
|
|
RomeJayandFlora Feng
|
2e06395fd3
|
[Bugfix][Frontend] Build tool-call grammars from the tools the prompt renders (#59879)
Signed-off-by: Rongjie Jiang <j1870831863@outlook.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-10-05 22:01:03 +00:00 |
|
|
Martin HickeyandFlora Feng
|
3fb1cd796b
|
[Frontend] Extract parse and assembly out of batch chat derender (#60073)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-10-05 21:57:45 +00:00 |
|
|
|
2e3154aa18
|
[HiSparse] Log steady-state max concurrency and expose host-tier utilization gauges (#58949)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-10-05 14:20:32 -07:00 |
|
|
Matthew BonanniandClaude Opus 5.5
|
8542c3eff5
|
[CI] Fix test_mixed_warmup_gate after #57053 (#60116)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-05 21:17:00 +00:00 |
|
|
Yida WengandFlora Feng
|
18c8a65edd
|
[BugFix][Frontend] Pass reasoning_ended through render → generate (#60059) (#60062)
Signed-off-by: Yida Weng <84164537+YidaWeng@users.noreply.github.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-10-05 20:39:25 +00:00 |
|
|
Wentao Ye
|
74c5cbcd7b
|
[Bugfix][MRV2][Spec Decode] Honor dynamic K in autoregressive speculators, 1.2~1.3x kernel perf improvement (#57053)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-10-05 14:54:11 -04:00 |
|
|
Raphaël RiallandandSimon Veitner
|
c32495d58f
|
[watermark] compatibility validation (#56801)
Signed-off-by: Raphael Rialland <raphael.rialland@mistral.ai>
Signed-off-by: Simon Veitner <sveitner@redhat.com>
Co-authored-by: Simon Veitner <sveitner@redhat.com>
|
2026-10-05 14:37:13 -04:00 |
|
|
Giancarlo Delfin
|
88f3c601b3
|
[Docs] Add reviewer area of interest for TheEpicDolphin (#60092)
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
|
2026-10-05 18:35:19 +00:00 |
|
|
aoshen02andClaude Opus 5.5
|
d09ff77637
|
[Bugfix] Give each data-parallel engine its own global RNG streams (#59788)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-05 17:38:18 +00:00 |
|
|
|
877ddcc456
|
[Bugfix][Spec Decode] Reserve the bonus KV slot for fill-in DSpark (#59105)
Signed-off-by: Evgeny Savinov <notime.sea@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
|
2026-10-05 17:35:51 +00:00 |
|
|
akii96
|
182247257f
|
[ROCm][Perf] Use a stacked hipBLASLt GEMM for the bf16x3 router (#52668)
Signed-off-by: Aakif Nawaz <aakif.nawaz@amd.com>
|
2026-10-05 17:28:07 +00:00 |
|
|
Matthew BonanniandClaude Opus 5.5
|
54d93af9fb
|
[Bugfix][HiSparse] Reject cudagraph_mode=FULL at startup (#59688)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-05 12:42:27 -04:00 |
|
|
Sohaib Ahmed
|
64cb683842
|
[Model] Add Nemotron 3.5 ASR transcription support (#59827)
Signed-off-by: Sohaib-Ahmed21 <sohaibahmed1919@gmail.com>
|
2026-10-05 16:28:09 +00:00 |
|
|
stefankoncarevicandAndreas Karatzas
|
87954c5b04
|
[CI/Build] Declare the video modality on the CohereCompass reference model (#60063)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-10-05 16:25:42 +00:00 |
|
|
Mikko TukiainenandCursor
|
d23af12cb1
|
[ROCm][Perf] Reach the fused QSA pre-indexer from the AMD path (#57947)
Signed-off-by: mjkvaak-amd <mjkvaak-amd@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-10-05 16:22:29 +00:00 |
|
|
bzsuniandcjackal
|
528772a4bf
|
[Bugfix][Core] Retain encoder cache references for repeated multimodal inputs (#59942)
Signed-off-by: bzsuni <bingzhe.sun@daocloud.io>
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
Co-authored-by: cjackal <44624812+cjackal@users.noreply.github.com>
|
2026-10-05 15:52:46 +00:00 |
|
|
charlesli640
|
edde9d2ce4
|
Remove redundant dependency requirement for TPU (#59977)
Signed-off-by: Charles Li <licharles@google.com>
|
2026-10-05 08:45:37 -07:00 |
|
|
stefankoncarevic
|
f2d8fbf459
|
[CI/Build] Run the prefill token scoring test under batch invariance (#60056)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
|
2026-10-05 10:32:33 -05:00 |
|
|
Matthew BonanniandClaude Opus 5.5
|
9e931a0c6c
|
[CI] Add CODEOWNERS for HiSparse (#60060)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-05 15:18:29 +00:00 |
|
|
|
60932a6401
|
[Bugfix][Structured Output] Preserve literal values in Guidance disable_additional_properties (#58709)
Signed-off-by: Abhay Joshi <105213625+abhayjoshi201@users.noreply.github.com>
Co-authored-by: Antigravity <noreply@google.com>
Co-authored-by: Artem Perevedentsev <aperevedents@nvidia.com>
|
2026-10-05 18:12:40 +03:00 |
|
|
Nicolò Lucchesi
|
30d4032363
|
[Model][GLM-5.3-Flash] Support DCP for the kpool sparse indexer (#59211)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-10-05 16:44:14 +02:00 |
|
|
Jee Jee Li
|
f9c9e8ac24
|
[LoRA] Remove tensorizer (#60024)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-10-05 07:01:56 -07:00 |
|
|
Abhay ShuklaandClaude Opus 5.5
|
d3547f9d03
|
[Test] Re-enable Voxtral HF reference test on Transformers v5 (#59771)
Signed-off-by: AbhayShuklaIIT <abhay.shukla@live.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-05 13:43:49 +00:00 |
|
|
cjackal
|
0e468adb43
|
[Model] Extend device-side mm normalization to Kimi K2.5 / K3 (#59278)
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
|
2026-10-05 21:28:13 +08:00 |
|
|
Nicolò LucchesiandLeoyzen
|
ff53f32409
|
[Attention][MLA] Support fp8_ds_mla KV cache for NoPE-512 models on SM90 (#59246)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: Leoyzen <leoyzen@gmail.com>
|
2026-10-05 13:12:00 +00:00 |
|
|
Vadim GimpelsonandClaude
|
d0d6e5f3a2
|
[Bugfix] Fix Mamba page size AssertionError with spec decoding on GraniteMoeHybrid, FalconH1 and Zamba2 (#59975)
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-10-05 12:49:47 +00:00 |
|
|
roikoren755andmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
51eeb0c58f
|
[Bugfix] Load stacked expert weights for non-gated MoE (#59031)
Signed-off-by: Roi Koren <roik@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-05 15:26:55 +03:00 |
|
|
Stefano CastagnettaandThien Tran
|
4ff028d77e
|
[Bugfix][Qwen4Exp] Honor --kv-cache-dtype-skip-layers in QSA attention (#60023)
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-10-05 12:13:30 +00:00 |
|
|
Stefano CastagnettaandThien Tran
|
55b80221ed
|
[Perf][Qwen4Exp] Keep the HC up projection on the skinny GEMM path (#60027)
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-10-05 20:09:36 +08:00 |
|
|
Juan Pérez de Algaba
|
710ac56e69
|
[Security] Restrict Pillow image formats on untrusted media paths (#60022)
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com>
|
2026-10-05 10:40:15 +00:00 |
|
|
|
edca360f13
|
[Bugfix][Qwen4Exp] Load PLE tables unquantized under Quark checkpoints (#59443)
Signed-off-by: Mikko Tukiainen <Mikko.Tukiainen@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
|
2026-10-05 10:40:02 +00:00 |
|
|
|
c04c79e50d
|
[Performance] Add SM121 TP=2 skinny-GEMM plans (#59632)
Signed-off-by: sudhanshu shukla <sudhanshu112233shukla@users.noreply.github.com>
Co-authored-by: sudhanshu shukla <sudhanshu112233shukla@users.noreply.github.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-10-05 18:27:51 +08:00 |
|
|
Maroon Ayoub
|
b1401e0aa7
|
[Bugfix][NIXL] Count heartbeats as remote engine activity (#59873)
Signed-off-by: Maroon Ayoub <mayoub@redhat.com>
|
2026-10-05 09:36:13 +00:00 |
|
|
|
ae53b06898
|
[Bugfix][GLM-5.3-Flash] Keep batch x heads out of gridDim.z in the GLM-5.3-Flash fused recurrent KDA kernel (#56974)
Signed-off-by: NolenLiang <nliang@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-10-05 09:31:45 +00:00 |
|
|
Ian Eavesandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
b1f229fb75
|
[Model] Declare SupportsEagle3 on Qwen3ASRForConditionalGeneration (#52824)
Signed-off-by: Ian Eaves <ian.k.eaves@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-05 09:23:47 +00:00 |
|
|
Jee Jee Li
|
e3af5bf3ce
|
[LoRA] Code cleanup (#60017)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-10-05 09:15:53 +00:00 |
|
|
aoshen02andClaude Opus 5.5
|
4a30c4cad0
|
[Model][DeepSeek-V4] Make MegaMoE shared-expert finalize independent of linear post-load order (#59927)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-05 08:39:49 +00:00 |
|