 frankieandTrae Agent
|
9cc7793e32
|
[Bugfix] Gracefully handle unsupported reasoning_effort in chat templates (#54022)
Signed-off-by: frankie <wangyongsheng686@gmail.com>
Co-authored-by: Trae Agent <noreply@trae.ai>
|
2026-09-06 21:11:35 -07:00 |
|
|
vhagorandIsotr0py
|
3dc7a68ce4
|
[Perf] Extend Qwen Triton warmup to avoid first-request latency spikes (#54797)
Signed-off-by: Juqi Li <2223621784@qq.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-07 11:46:00 +08:00 |
|
|
Wei Zhao
|
c3ec0d29f5
|
[Bugfix] Fix cuda profiler missing bug (#55237)
|
2026-09-07 03:15:57 +00:00 |
|
|
yulunandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
1f778486fc
|
[Bugfix][Offloader] Preserve prefetch static-buffer slot ownership (#54975)
Signed-off-by: Big2Wheel <1404207590@qq.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-07 10:58:44 +08:00 |
|
|
|
de69e821b7
|
[ROCm][Perf][DeepSeek V4] Fuse native FP8 shared expert with MXFP4 routed experts (#53161)
Signed-off-by: fai <fangzhouai@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Cursor Agent <agent@cursor.com>
|
2026-09-06 19:42:21 -07:00 |
|
|
Wenhua Cheng
|
294fbb4f59
|
add 2/3/5/6/7 CUDA support in AutoRound format (#52890)
Signed-off-by: Wenhua Cheng <wenhua.cheng@intel.com>
|
2026-09-07 09:59:19 +08:00 |
|
|
Jürgen Schmied
|
4df80187b5
|
[Kernel] SM 12.x blockwise FP8: swizzle the CTA raster when the weight exceeds the L2 (#55180)
|
2026-09-06 17:36:59 -07:00 |
|
|
Kevin H. LuuandCodex
|
6865e67f0b
|
[Bugfix] Defer adaptive verification until after kernel warmup (#55455)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-06 11:31:40 -07:00 |
|
|
Kevin H. LuuandCodex
|
722d169339
|
[CI] Align extraction test with canonical auxiliary layer order (#55457)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-06 11:22:14 -07:00 |
|
|
zhouyouandCursor Grok 4.6
|
52358e6e19
|
[Frontend] Expose multimodal metadata for disaggregated prefill (#54659)
Signed-off-by: zhouyou9505 <zhouyou9505@gmail.com>
Co-authored-by: Cursor Grok 4.6 <noreply@cursor.com>
|
2026-09-06 14:46:52 +00:00 |
|
|
Almog TavorandOr Ozeri
|
dc02934a07
|
[Bugfix][KV Offload] Stop offloading the final sampled token's KV slot (#54288)
Signed-off-by: almogtavor <almogtavor@gmail.com>
Signed-off-by: Almog Tavor <70065337+almogtavor@users.noreply.github.com>
Co-authored-by: Or Ozeri <or@ozery.com>
|
2026-09-06 15:22:19 +03:00 |
|
|
|
569adb5a97
|
[Bugfix][KV Offload] Fix SWA store reachability during chunked prefill (#54362)
Signed-off-by: Will Hampson <whamp@ggl.slmail.me>
Co-authored-by: Will Hampson <whamp@ggl.slmail.me>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-09-06 13:50:39 +03:00 |
|
|
Zupeng WangandCodex
|
dd0760165c
|
[Bugfix] Fall back to T1 when ARC cannot reclaim enough entries from T2 (#55461)
Signed-off-by: Wang Zupeng <zupenwang@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-06 13:28:19 +03:00 |
|
|
|
9afb878a55
|
[Bugfix][KV Offload] Skip cleaned-up async lookup batches (#55075)
Signed-off-by: Alex <jihui.huang@daocloud.io>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-09-06 13:27:46 +03:00 |
|
|
Ziming HuangandOpenAI Codex
|
144e79c810
|
[Kimi K3] Support internal prefix checkpoints with partial prefix caching and spec-decoding (#53614)
Signed-off-by: Ziming Huang <zelda.huanghuang@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-06 13:18:15 +08:00 |
|
|
Clinton ThomasandLucas Bourtoule
|
1970f3ed4b
|
Validate scale-out multimodal data before engine handoff (#51898)
Signed-off-by: Clinton Thomas <1033162+KernelClint@users.noreply.github.com>
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com>
|
2026-09-06 04:58:04 +00:00 |
|
|
zhao, zhenhui
|
1c344ed41e
|
[CPU] [Feat] Add native AMX-FP8 attention impl for Diamond Rapids (#49410)
Signed-off-by: zhejiangxiaomai <zhenhui.zhao@intel.com>
|
2026-09-06 11:06:56 +08:00 |
|
|
aoshen02
|
039ea82660
|
[Core] Sync DP state on the first step of a wave (#52957)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
|
2026-09-06 02:16:58 +00:00 |
|
|
lucamotzandOpenAI Codex
|
f4eccdadef
|
[Bugfix][Multimodal] Bound renderer warmup to the prefill token budget (#55448)
Signed-off-by: Luca Motz <luca.motz@icloud.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-05 16:43:28 +00:00 |
|
|
Harry Huang
|
28e605fb33
|
[Bugfix][Qwen4Exp] fix state index strides in fused PLE conv (#55375)
Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
|
2026-09-05 14:02:20 +00:00 |
|
|
Adababyandshaolila
|
2902ca17e3
|
[Bugfix] complete VLLMValidationError migration in chat_utils.py (#50254)
Signed-off-by: shaolila <shaolila@buaa.edu.cn>
Co-authored-by: shaolila <shaolila@buaa.edu.cn>
|
2026-09-05 17:56:12 +08:00 |
|
|
|
e473e9036f
|
[Docs][Models] Use the official FunASR Nano vLLM checkpoint (#54944)
Signed-off-by: LauraGPT <18321252+LauraGPT@users.noreply.github.com>
Co-authored-by: LauraGPT <18321252+LauraGPT@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-05 00:29:49 -07:00 |
|
|
|
e962733e08
|
[Security] Validate cache salts before they reach LMCache (#51444)
Signed-off-by: Clinton Thomas <1033162+KernelClint@users.noreply.github.com>
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-09-05 03:56:06 +00:00 |
|
|
|
d87a440f88
|
[Core][MRV2] Support eagle3 spec decode with pipeline parallel (#50514)
Signed-off-by: Yongqin Wang <yongqinwang@roblox.com>
Co-authored-by: Cursor <noreply@cursor.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-09-05 11:45:34 +08:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
ea5f41edd7
|
[CI][ROCm] Restore Wikitext coverage for Qwen OCP-MX (#55410)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-05 10:50:54 +08:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
a7f9be9612
|
[CI][ROCm] Raise AMD job and server readiness timeouts (#55308)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-05 10:50:51 +08:00 |
|
|
Wei ZhaoandOpenAI Codex
|
16328c7a77
|
[Perf] Kimi K3 nvfp4 Align in_proj weights by 128 to avoid elementwise copy (#55242)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-05 10:46:47 +08:00 |
|
|
|
385ba6b5b0
|
[Bugfix][Quantization] Register Quark per-block FP8 scales as weight_scale (#54770)
Signed-off-by: jimmy-adams <41593649+jimmy-adams@users.noreply.github.com>
Co-authored-by: fxmarty-amd <felmarty@amd.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-09-05 10:44:24 +08:00 |
|
|
|
6cbb3c154e
|
[Perf][GDN] Build cudagraph-capture metadata without a device sync (#55404)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Roger Wang <rogerw@inferact.ai>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
|
2026-09-04 17:40:17 -07:00 |
|
|
Nick Hill
|
8277c42e4c
|
[Perf] Ensure async h2d copies are pinned in more places (#55202)
|
2026-09-04 17:17:01 -07:00 |
|
|
|
eb74fbb3e7
|
[Bugfix][NIXL] Don't assert when a failed transfer is cleaned up twice (#54518)
Signed-off-by: Yizheng Jiao <jyizheng@gmail.com>
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-09-04 23:20:32 +00:00 |
|
|
|
685074cd61
|
[Bugfix][V2] Warm up kernels before capturing CUDA graphs (#55341)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-09-04 22:44:18 +00:00 |
|
|
Misha Goin
|
8f269a93bb
|
Revert "[CI] Remove deleted nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 and its arch aliases" (#55392)
|
2026-09-04 14:45:24 -07:00 |
|
|
|
3f41d102c5
|
[1/2][Model Runner V2] DBO support, eager mode (#50945)
Signed-off-by: specture724 <specture724@gmail.com>
Signed-off-by: Anjie Hou <149605198+specture724@users.noreply.github.com>
Co-authored-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
|
2026-09-04 14:17:39 -07:00 |
|
|
Sun
|
c81ace1859
|
[Perf] Read VidCom2 frame budgets once (#55331)
Signed-off-by: levius <2114377220@qq.com>
|
2026-09-04 20:11:42 +00:00 |
|
|
Stefano Castagnetta
|
2524051385
|
[Bugfix][Spec Decode] Honour the draft's attention_backend on Model Runner V2 (#54826)
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
|
2026-09-04 12:23:19 -07:00 |
|
|
|
5690b02c03
|
[Quantization] Support online quantization with partially pre-quantized checkpoints (#51392)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
|
2026-09-04 11:46:06 -07:00 |
|
|
Summer Yang
|
8cd95f7de7
|
[Bugfix][MLA] Restore DSpark cache-group capability under optimized Python (#55234)
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
|
2026-09-04 10:24:31 -07:00 |
|
|
Thomas OrtnerandHarry Mellor
|
8ad2076c4a
|
[Transformers backend] Find attention with a fuser and attach vLLM's layer to it (#54941)
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-04 16:26:01 +00:00 |
|
|
|
6a039f465e
|
[feat] add torchcodec as audio loader and implement selective audio backend (#51826)
Signed-off-by: JaredforReal <w13431838023@gmail.com>
Co-authored-by: saltman155 <saltman155@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-04 16:16:10 +00:00 |
|
|
|
f19431e5c8
|
[Bugfix][MoE] Allow TRTLLM FP8 block-scale MoE with SwiGLU clamp (#55069)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen524@gmail.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-04 08:34:21 -07:00 |
|
|
summer
|
a85d0738da
|
[Bugfix] Fix double BOS in LLM.chat() for multimodal models (#55288)
Signed-off-by: summer <128961079+zhang-keliang@users.noreply.github.com>
|
2026-09-04 14:23:15 +00:00 |
|
|
|
a69e75b9b6
|
Fast Start (#54921)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: liusy58 <liusy58@smail.nju.edu.cn>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-04 06:32:06 -07:00 |
|
|
Qiming Zhang
|
07ee97e023
|
[Test] Split test_sampling_mask_preserves_top_k_boundary_ties to remove Triton-kernel-specific assumption Description (#55315)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
|
2026-09-04 14:16:50 +01:00 |
|
|
Thien TranandKimi
|
31a8a26662
|
[Qwen3.8-Flash-Next] Improve QSA sparse GQA for prefill and short-ctx decode (#54873)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Kimi <noreply@moonshot.cn>
|
2026-09-04 06:08:02 -07:00 |
|
|
Li, Jiang
|
8340fe1bb9
|
[CI/Build] Fix flaky failures in CPU CI image building (#55317)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
|
2026-09-04 20:27:02 +08:00 |
|
|
Juan Pérez de AlgabaandIsotr0py
|
8b6de0eb9a
|
[Security] Cap GLMGA video sampling to prevent request-driven resource exhaustion (#54935)
Signed-off-by: jperezde <jperezde@redhat.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-04 12:02:41 +00:00 |
|
|
Canlin Guo
|
fd4a151262
|
[Kernel] Reuse Qwen4Exp HC combine-norm for MTP input (#54687)
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com>
Signed-off-by: Canlin <canlinguosdu@gmail.com>
|
2026-09-04 02:57:56 -07:00 |
|
|
Tony LinandKevin H. Luu
|
9cd956c7e6
|
[CI/Test] Add expert parallelism coverage to external LB tests (#53497)
Signed-off-by: Tony Lin <tony.lin@intel.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
|
2026-09-04 15:56:59 +08:00 |
|
|
Thien Tran
|
a5c9179e73
|
[Qwen3.8-Flash-Next] Compact indexer logits workspace to improve prefill efficiency (#54915)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-09-04 00:43:20 -07:00 |
|