 Harry Huang
|
28e605fb33
|
[Bugfix][Qwen4Exp] fix state index strides in fused PLE conv (#55375)
Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
|
2026-09-05 14:02:20 +00:00 |
|
|
lucamotzandLuca Motz
|
bc96d76aa9
|
[Kernel] Fall back from persistent top-k on low-shared-memory GPUs (#54110)
Signed-off-by: Luca Motz <321921718+lucamotz@users.noreply.github.com>
Signed-off-by: Luca Motz <luca.motz@icloud.com>
Co-authored-by: Luca Motz <321921718+lucamotz@users.noreply.github.com>
|
2026-09-05 08:58:37 -04:00 |
|
|
aoshen02andaoshen02
|
7fbd44cbe0
|
[Bugfix][DSv4] Seed the -1 sentinel in the prefill sparse index workspace (#55299)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
|
2026-09-05 18:31:04 +08:00 |
|
|
Adababyandshaolila
|
2902ca17e3
|
[Bugfix] complete VLLMValidationError migration in chat_utils.py (#50254)
Signed-off-by: shaolila <shaolila@buaa.edu.cn>
Co-authored-by: shaolila <shaolila@buaa.edu.cn>
|
2026-09-05 17:56:12 +08:00 |
|
|
|
e473e9036f
|
[Docs][Models] Use the official FunASR Nano vLLM checkpoint (#54944)
Signed-off-by: LauraGPT <18321252+LauraGPT@users.noreply.github.com>
Co-authored-by: LauraGPT <18321252+LauraGPT@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-05 00:29:49 -07:00 |
|
|
waizuichougou
|
32601ef7a1
|
[Perf][Multimodal] Avoid duplicate text embedding in Qwen2.5-Omni (#55415)
Signed-off-by: waizuichougou <2082431897@qq.com>
|
2026-09-05 06:39:32 +00:00 |
|
|
|
8369affa54
|
[Feat] Add EPLB support for GLM-5.3-Flash (#55119)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Signed-off-by: Jared Wen <jaredwen@inferact.ai>
Co-authored-by: Jared Wen <jaredwen@inferact.ai>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-05 05:28:33 +00:00 |
|
|
|
e962733e08
|
[Security] Validate cache salts before they reach LMCache (#51444)
Signed-off-by: Clinton Thomas <1033162+KernelClint@users.noreply.github.com>
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-09-05 03:56:06 +00:00 |
|
|
GroupieSteven
|
4ee2595512
|
[Attention] Sync FA with upstream (#54819)
Signed-off-by: Chuyue Wang <stevenwang0805@outlook.com>
|
2026-09-04 23:48:32 -04:00 |
|
|
|
d87a440f88
|
[Core][MRV2] Support eagle3 spec decode with pipeline parallel (#50514)
Signed-off-by: Yongqin Wang <yongqinwang@roblox.com>
Co-authored-by: Cursor <noreply@cursor.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-09-05 11:45:34 +08:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
d4ef5e53fc
|
[CI][ROCm] Disable Transformers nightly groups (#55409)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-05 10:51:01 +08:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
ea5f41edd7
|
[CI][ROCm] Restore Wikitext coverage for Qwen OCP-MX (#55410)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-05 10:50:54 +08:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
a7f9be9612
|
[CI][ROCm] Raise AMD job and server readiness timeouts (#55308)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-05 10:50:51 +08:00 |
|
|
Wei ZhaoandOpenAI Codex
|
16328c7a77
|
[Perf] Kimi K3 nvfp4 Align in_proj weights by 128 to avoid elementwise copy (#55242)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-05 10:46:47 +08:00 |
|
|
|
385ba6b5b0
|
[Bugfix][Quantization] Register Quark per-block FP8 scales as weight_scale (#54770)
Signed-off-by: jimmy-adams <41593649+jimmy-adams@users.noreply.github.com>
Co-authored-by: fxmarty-amd <felmarty@amd.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-09-05 10:44:24 +08:00 |
|
|
|
6cbb3c154e
|
[Perf][GDN] Build cudagraph-capture metadata without a device sync (#55404)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Roger Wang <rogerw@inferact.ai>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
|
2026-09-04 17:40:17 -07:00 |
|
|
Nick Hill
|
8277c42e4c
|
[Perf] Ensure async h2d copies are pinned in more places (#55202)
|
2026-09-04 17:17:01 -07:00 |
|
|
Nathan Sala
|
874df9373d
|
[Bugfix] Preserve Mamba state for padded prompt tails (#55178)
Signed-off-by: Nathan Sala <natouda@gmail.com>
Signed-off-by: Nathan Sala <33957625+natsala13@users.noreply.github.com>
|
2026-09-04 23:44:28 +00:00 |
|
|
|
eb74fbb3e7
|
[Bugfix][NIXL] Don't assert when a failed transfer is cleaned up twice (#54518)
Signed-off-by: Yizheng Jiao <jyizheng@gmail.com>
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-09-04 23:20:32 +00:00 |
|
|
|
685074cd61
|
[Bugfix][V2] Warm up kernels before capturing CUDA graphs (#55341)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-09-04 22:44:18 +00:00 |
|
|
Misha Goin
|
8f269a93bb
|
Revert "[CI] Remove deleted nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 and its arch aliases" (#55392)
|
2026-09-04 14:45:24 -07:00 |
|
|
|
3f41d102c5
|
[1/2][Model Runner V2] DBO support, eager mode (#50945)
Signed-off-by: specture724 <specture724@gmail.com>
Signed-off-by: Anjie Hou <149605198+specture724@users.noreply.github.com>
Co-authored-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
|
2026-09-04 14:17:39 -07:00 |
|
|
Taneem IbrahimandHarry Mellor
|
784cac7c42
|
[Mypy] Fix mypy typing for P models (#54169)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-04 20:47:11 +00:00 |
|
|
Zihan Zhang
|
5093e4844a
|
[Bugfix][Spec Decode] Drop FlashAttention's AOT schedule for a sliding-window DFlash drafter (#54374)
|
2026-09-04 16:42:01 -04:00 |
|
|
Sun
|
c81ace1859
|
[Perf] Read VidCom2 frame budgets once (#55331)
Signed-off-by: levius <2114377220@qq.com>
|
2026-09-04 20:11:42 +00:00 |
|
|
Taneem Ibrahim
|
3284af6bf1
|
[Bugfix] Reject 0 or non-positive max concurrency (#54887)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-09-04 15:59:29 -04:00 |
|
|
Stefano Castagnetta
|
2524051385
|
[Bugfix][Spec Decode] Honour the draft's attention_backend on Model Runner V2 (#54826)
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
|
2026-09-04 12:23:19 -07:00 |
|
|
|
5690b02c03
|
[Quantization] Support online quantization with partially pre-quantized checkpoints (#51392)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
|
2026-09-04 11:46:06 -07:00 |
|
|
Andrey Talman
|
a11dfcff89
|
[CI] Surface why the CRCR nightly report cannot read its Buildkite secret (#54860)
Signed-off-by: Andrey Talman <atalman@fb.com>
|
2026-09-04 11:10:30 -07:00 |
|
|
Jared WenandKimi
|
701a744490
|
[CI] Raise AMD Spec Decode Eagle 1 job timeout to 35min (#55136)
Signed-off-by: JaredforReal <w13431838023@gmail.com>
Co-authored-by: Kimi <noreply@moonshot.cn>
|
2026-09-04 17:31:54 +00:00 |
|
|
Summer Yang
|
8cd95f7de7
|
[Bugfix][MLA] Restore DSpark cache-group capability under optimized Python (#55234)
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
|
2026-09-04 10:24:31 -07:00 |
|
|
yzyyzyhhhandyaozhiyuan.666
|
1ff5edb023
|
[Bug-fix] Fix MoE fused sum row offsets (#50220)
Signed-off-by: yaozhiyuan.666 <yaozhiyuan.666@bytedance.com>
Co-authored-by: yaozhiyuan.666 <yaozhiyuan.666@bytedance.com>
|
2026-09-04 09:39:02 -07:00 |
|
|
Connor Carpenter
|
761c5861e3
|
[Rust Frontend][gRPC] Preserve multimodal metadata for remote-prefill decode (#54814)
|
2026-09-05 02:37:53 +10:00 |
|
|
Thomas OrtnerandHarry Mellor
|
8ad2076c4a
|
[Transformers backend] Find attention with a fuser and attach vLLM's layer to it (#54941)
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-04 16:26:01 +00:00 |
|
|
Rohan PotdarandClaude Opus 4.8
|
99a1ab8e4c
|
[ROCm][CI] Bump ROCk release image build timeout to 3h (#55354)
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-09-04 16:16:54 +00:00 |
|
|
|
6a039f465e
|
[feat] add torchcodec as audio loader and implement selective audio backend (#51826)
Signed-off-by: JaredforReal <w13431838023@gmail.com>
Co-authored-by: saltman155 <saltman155@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-04 16:16:10 +00:00 |
|
|
erdholionandIlir
|
131e0285f6
|
[Frontend] Warn when removed guided-decoding fields are present in a request (#54285)
Signed-off-by: Ilir <ljeci.ilir@gmail.com>
Co-authored-by: Ilir <ljeci.ilir@gmail.com>
|
2026-09-04 16:15:40 +00:00 |
|
|
Harry Mellor
|
5e729d84eb
|
[CI] Only run GitHub Actions on the main repo (#55349)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-05 00:09:49 +08:00 |
|
|
|
f19431e5c8
|
[Bugfix][MoE] Allow TRTLLM FP8 block-scale MoE with SwiGLU clamp (#55069)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen524@gmail.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-04 08:34:21 -07:00 |
|
|
summer
|
a85d0738da
|
[Bugfix] Fix double BOS in LLM.chat() for multimodal models (#55288)
Signed-off-by: summer <128961079+zhang-keliang@users.noreply.github.com>
|
2026-09-04 14:23:15 +00:00 |
|
|
|
a69e75b9b6
|
Fast Start (#54921)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: liusy58 <liusy58@smail.nju.edu.cn>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-04 06:32:06 -07:00 |
|
|
Qiming Zhang
|
07ee97e023
|
[Test] Split test_sampling_mask_preserves_top_k_boundary_ties to remove Triton-kernel-specific assumption Description (#55315)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
|
2026-09-04 14:16:50 +01:00 |
|
|
Thien TranandKimi
|
31a8a26662
|
[Qwen3.8-Flash-Next] Improve QSA sparse GQA for prefill and short-ctx decode (#54873)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Kimi <noreply@moonshot.cn>
|
2026-09-04 06:08:02 -07:00 |
|
|
Li, Jiang
|
8340fe1bb9
|
[CI/Build] Fix flaky failures in CPU CI image building (#55317)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
|
2026-09-04 20:27:02 +08:00 |
|
|
Juan Pérez de AlgabaandIsotr0py
|
8b6de0eb9a
|
[Security] Cap GLMGA video sampling to prevent request-driven resource exhaustion (#54935)
Signed-off-by: jperezde <jperezde@redhat.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-04 12:02:41 +00:00 |
|
|
Taneem Ibrahim
|
c615b1fd67
|
[Mypy] Fix mypy typing for L models (#54177)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-09-04 07:50:43 -04:00 |
|
|
Rita Brugarolas
|
3ff4f02dfe
|
[AMD][kimik3][ROCm][Perf] Fuse MLA q/kv RMSNorm in AMD Kimi-K3 MLA wrapper (#52494)
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com>
|
2026-09-04 10:14:51 +00:00 |
|
|
Canlin Guo
|
fd4a151262
|
[Kernel] Reuse Qwen4Exp HC combine-norm for MTP input (#54687)
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com>
Signed-off-by: Canlin <canlinguosdu@gmail.com>
|
2026-09-04 02:57:56 -07:00 |
|
|
Tony LinandKevin H. Luu
|
9cd956c7e6
|
[CI/Test] Add expert parallelism coverage to external LB tests (#53497)
Signed-off-by: Tony Lin <tony.lin@intel.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
|
2026-09-04 15:56:59 +08:00 |
|
|
Tony Lin
|
605ca45b91
|
[XPU] Fix device assignment for DP external LB (#53037)
Signed-off-by: Tony Lin <tony.lin@intel.com>
|
2026-09-04 15:51:25 +08:00 |
|