 Jiangyun ZhuandOpenAI Codex
|
6632ed559e
|
[Perf][Attention] Avoid CPU-GPU sync in DCP sequence lengths (#58169)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-23 16:28:43 +08:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
96e203b08e
|
[ROCm][Bugfix] Register MRV2 sampler JIT warmups (#58092)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-23 03:17:13 -05:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
26879f3260
|
[ROCm][Compile] Fuse AITER static FP8 attention output (#58099)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-23 03:16:52 -05:00 |
|
|
aoshen02andYongye Zhu
|
973a3be780
|
[Refactor][Quantization] Make FP8 and MLA weight transforms reusable pure functions (#57732)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
|
2026-09-23 01:16:20 -07:00 |
|
|
Nicolò LucchesiandYifan Qiao
|
9488318c6a
|
[Mooncake] Address review nits from #56855 (#57174)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: Yifan Qiao <17067717+ivanium@users.noreply.github.com>
|
2026-09-23 10:15:45 +02:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
153242a314
|
[ROCm][CI] Add MI355 dense NVFP4 and MoRI kernel mirrors (#58281)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-23 03:06:15 -05:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
a9f07d0bc5
|
[ROCm][CI] Mirror the three TurboQuant evaluation groups on MI355 (#58282)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-23 02:37:23 -05:00 |
|
|
|
9127170b88
|
[Quantization] Select per-token NVFP4 MoE backends explicitly (#57176)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Signed-off-by: S1ro1 <matej.sirovatka@gmail.com>
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-23 07:30:58 +00:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
0f2a15c927
|
[Tests] Select V2 for diffusion scheduler unit tests (#58272)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-23 02:04:22 -05:00 |
|
|
00CC
|
eb2e91d3ba
|
[ROCm][Perf] Use wvSplitK for single-output GEMMs (#53283)
Signed-off-by: tangzzycc <3081129260@qq.com>
|
2026-09-23 06:38:17 +00:00 |
|
|
Ting SUN
|
b33c8a657d
|
[Bugfix][Frontend] Keep length finish_reason for max_tokens-truncated streaming tool calls (#46303)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
|
2026-09-23 14:31:10 +08:00 |
|
|
Jee Jee Li
|
de6674b002
|
[MoE] Use GateLinear for all MoE models (#58234)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-09-23 05:40:13 +00:00 |
|
|
xiangdong
|
e975732152
|
[XPU][CI] Deselect tests/v1/spec_decode/test_mtp.py::test_glm_mtp_defers_lm_head (#58237)
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
|
2026-09-23 05:20:51 +00:00 |
|
|
|
88aa0d287d
|
[Spec decode] Support variable-length decode for Kimi-K3 adaptive ver (#52988)
Signed-off-by: Albert Cheng <albecheng@nvidia.com>
Signed-off-by: Albert Cheng (Engrg-Hardware 1) <albecheng@login-bia01.bia.clusters.nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
|
2026-09-22 20:43:32 -07:00 |
|
|
Wentao Ye
|
355d789f0d
|
[Compilation] Fix QuTLASS compilation with PyTorch 2.13 (#58173)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-09-22 20:43:28 -07:00 |
|
|
Michał GanczarenkoandClaude
|
73c59d365b
|
[XPU] Wire up SYCL apply_rotary_emb kernel in ApplyRotaryEmb (#55721)
Signed-off-by: Michal Ganczarenko <michal.ganczarenko@intel.com>
Signed-off-by: Michał Ganczarenko <michal.ganczarenko@intel.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-09-22 20:43:24 -07:00 |
|
|
|
94f4170df3
|
[Bugfix] Set worker runtime threads before profiling and compilation (#55891)
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-09-22 21:12:20 -05:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
e581e14002
|
[ROCm][CI] Stage G gating (#50922)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-22 19:04:54 -07:00 |
|
|
|
8d16ca6cc2
|
[CI][Bugfix] Update IPC test caller for #57312's _apply_entries signature (#58107)
Signed-off-by: kimi-no-na-wa <kimi-no-na-wa@users.noreply.github.com>
Co-authored-by: kimi-no-na-wa <kimi-no-na-wa@users.noreply.github.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
|
2026-09-22 18:50:06 -07:00 |
|
|
Andreas Karatzas
|
0eb42dbbfc
|
[ROCm][Compile] Support BF16 AsyncTP fusion (#58098)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-22 20:36:38 -05:00 |
|
|
Fangzhou Ai
|
f9dce295c9
|
[ROCm][DSv4][Perf] Fuse the inverse RoPE into the sparse decode reduce (#57451)
Signed-off-by: Fangzhou Ai <fangzhou.ai@amd.com>
|
2026-09-23 01:23:55 +00:00 |
|
|
Tianyu GuoandCyrus Leung
|
3ee2906f47
|
[EPD] Support metadata-only audio inputs (#57887)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-09-23 09:03:50 +08:00 |
|
|
|
826e300cde
|
[Bugfix] Skip VllmConfig re-validation for with_hf_config submodel views (#58212)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Kimi Code <noreply@moonshot.ai>
Co-authored-by: Roger Wang <rogerw@inferact.ai>
|
2026-09-23 00:50:17 +00:00 |
|
|
|
d110c2f19c
|
[ROCm] Use silu_and_mul_with_clamp's torch._C op (#52052)
Signed-off-by: Tres Popp <tres.popp@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-22 18:30:14 -05:00 |
|
|
|
1c0eee919d
|
[ROCm][Model][Bugfix] Enable GLM-5.2-MXFP4 on the deepseek_v32 path and fix sparse attention correctness (#51915)
Signed-off-by: Jack Hu <Jack.Hu@amd.com>
Signed-off-by: Jack Hu <jack.hu@amd.com>
Signed-off-by: Douglas Lehr <Doug.Lehr@amd.com>
Co-authored-by: James E T Smith <jamesETsmith@users.noreply.github.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
Co-authored-by: Douglas Lehr <Doug.Lehr@amd.com>
|
2026-09-22 18:08:51 -05:00 |
|
|
stefankoncarevicandAndreas Karatzas
|
9646f53064
|
[Bugfix][ROCm] Use the platform FP8 range in the concat MLA q test (#58153)
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-22 18:05:33 -05:00 |
|
|
rasmith
|
111d7d7be2
|
[ROCm][Build][The Rock] Bump Triton version to 3.8.x tip-of-tree with source build in The Rock image (#58006)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
|
2026-09-22 18:05:13 -05:00 |
|
|
Michael Lapshin
|
d421a2e8fc
|
[Perf] Remove CPU-GPU sync in heterogeneous vocabulary speculative decoding (#57396)
|
2026-09-22 18:34:19 -04:00 |
|
|
Thang NguyenandClaude Opus 5.5
|
4edb55169f
|
[CI] Shard (H200 MIG 18GB) Spec Decode Draft Model across whole-directory replicas (#58193)
Signed-off-by: Thang Nguyen <thangnguyenvn647@gmail.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-09-22 14:50:18 -07:00 |
|
|
Thang NguyenandKimi
|
4ec0b95c44
|
[CI] Split LM Eval TurboQuant KV Cache into per-config jobs (#57113)
Signed-off-by: Thang Nguyen <thangnguyenvn647@gmail.com>
Co-authored-by: Kimi <noreply@moonshot.ai>
|
2026-09-22 14:49:06 -07:00 |
|
|
Misha Goin
|
5c3b61e9c4
|
[Core] Disable JIT warmup in eager mode (#58197)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-09-22 17:35:23 -04:00 |
|
|
Misha Goin
|
01e15bc94c
|
[Bugfix] Backport Inductor custom-op pattern matching fix (#58189)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-09-22 14:26:49 -07:00 |
|
|
Andrey Talman
|
ecdd11d0e0
|
[CI] Build the torch-nightly image on Ubuntu 24.04 (#58204)
|
2026-09-22 14:15:57 -07:00 |
|
|
Misha Goin
|
25965ee583
|
[Kernel] Remove AllSpark INT8 W8A16 GEMM backend (#58001)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-09-22 14:07:34 -07:00 |
|
|
|
1b3b88ec2b
|
[Core] structured generation mode for DiffusionGemma model (Jev-like) (#57250)
Signed-off-by: Matt Mastracci <matthew@mastracci.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Razorback16 <razorback16@protonmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Razorback16 <razorback16@protonmail.com>
|
2026-09-22 20:51:17 +00:00 |
|
|
Wentao Ye
|
fae5cbfc8b
|
[Refactor] Remove dead code multiple places (#58002)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-09-22 16:36:03 -04:00 |
|
|
lucamotz
|
276db94fb2
|
[Bugfix][Model][Spec Decode] Defer disposable GLM MTP head (#55442)
Signed-off-by: Luca Motz <luca.motz@icloud.com>
|
2026-09-22 20:08:27 +00:00 |
|
|
hclandmgoin
|
71a2392845
|
[Bugfix][V1] Read ModelState max_model_len from model config (#58149)
Signed-off-by: Chenglun Hu <chenglunhu@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
|
2026-09-22 19:45:04 +00:00 |
|
|
Divakar VermaandAndreas Karatzas
|
d1f63f2af9
|
[ROCm][CI] Add GELU activation for AiterExperts in the modular-kernel coverage (#58030)
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-22 14:39:13 -05:00 |
|
|
pengyihangandmgoin
|
415e11c6f1
|
[Bugfix][V1] Honor enable_jit_warmup for V2 kernel warmup (#55146)
Co-authored-by: mgoin <mgoin64@gmail.com>
|
2026-09-22 15:34:31 -04:00 |
|
|
Taneem Ibrahim
|
bc162b3f92
|
[MRV2] Release weight offloader on shutdown (#57834)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-09-22 15:01:20 -04:00 |
|
|
Guanxin LiandFlora Feng
|
f944491db9
|
[Bugfix] batch_invariant: keep non-AllReduce collectives enabled on NCCL >= 2.31 (#58179)
Signed-off-by: Guanxin Li <38149783+guanxingithub@users.noreply.github.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-09-22 14:44:00 -04:00 |
|
|
siyuandIsotr0py
|
c024cfdb02
|
[Fast Start] Support data parallelism in the weight cache daemon (#57386)
Signed-off-by: liusy58 <mg21330037@smail.nju.edu.cn>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-22 18:19:40 +00:00 |
|
|
|
ca831d1c55
|
[ROCm][DSv4.1][Perf] Fuse the inverse RoPE into the sparse decode reduce (#57435)
Signed-off-by: Fangzhou Ai <fangzhou.ai@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-22 18:05:11 +00:00 |
|
|
stefankoncarevicandAndreas Karatzas
|
72675c4706
|
[Bugfix][ROCm] Dispatch the QuantFP8 CUDA fallback on the class (#58136)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-22 17:49:11 +00:00 |
|
|
Gilles TurpinandWentao Ye
|
74370a0e30
|
[Bugfix] hadacore_transform: respect inplace parameter to fix garbage outputs with QuIP transforms (#43462)
Signed-off-by: Gilles Turpin <turpingilles15@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-09-22 12:48:20 -04:00 |
|
|
|
a6131b0e65
|
[Bugfix][Engram] Fall back when /dev/shm is absent before sharing tables (#57914)
Signed-off-by: Juntian Liu <juntianl@inferact.ai>
Signed-off-by: Juntian Liu <Juntianl777@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-23 00:19:09 +08:00 |
|
|
|
066ee91197
|
[Bugfix][Attention] Avoid NaN in the Triton softcap for large attention logits (#56579)
Signed-off-by: Kushal Dabbe <72650064+kushaldabbe@users.noreply.github.com>
Co-authored-by: opencode <noreply@opencode.ai>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-09-22 12:11:05 -04:00 |
|
|
Tony Lin
|
c42f5285ec
|
[Bugfix] prioritize architecture capability before DeepGEMM availability check (#58073)
Signed-off-by: Tony Lin <tony.lin@intel.com>
|
2026-09-22 11:38:04 -04:00 |
|
|
aoshen02
|
feb87b1934
|
[Bugfix] Narrow AuxOutput KV restrictions to known PD connectors (#58150)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
|
2026-09-22 23:09:39 +08:00 |
|