 Chang GuoandCursor Agent
|
541128bdeb
|
[KV Offload] Enable single-copy MLA layout for CPUOffloadingSpec (#50301)
Signed-off-by: Change72 <changg@nvidia.com>
Co-authored-by: Cursor Agent <cursor-agent@cursor.com>
|
2026-07-31 06:20:47 +03:00 |
|
|
Xiaochang WuandKunshang Ji
|
1d8be5cb44
|
[XPU] [BugFix] Add deepseek_v4_fp8 to xpu supported_quantization list (#50434)
Signed-off-by: Wu, Xiaochang <xiaochang.wu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-07-31 11:12:04 +08:00 |
|
|
Ma JianandKunshang Ji
|
ef0d084b4b
|
[XPU] Fix FP8 block scale layout for MLA compatibility (#50349)
Signed-off-by: Ma Jian <jian1.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-07-31 11:05:35 +08:00 |
|
|
|
6724051c57
|
[CI/Build][AMD] Install triton_kernels via CMake (#50328)
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: depthfirst-app[bot] <184448029+depthfirst-app[bot]@users.noreply.github.com>
Co-authored-by: root <root@smci355-ccs-aus-m11-05.cs-aus.dcgpu>
|
2026-07-30 22:05:19 -05:00 |
|
|
vanshbhatia-amd
|
4689c7dd61
|
[ROCm] Add tuned selective_state_update float16 config for AMD Instinct MI325X (#50006)
Signed-off-by: vanshbhatia-amd <vansh.bhatia@amd.com>
|
2026-07-31 02:43:53 +00:00 |
|
|
music-dinoandAndreas Karatzas
|
5d5f22ed7a
|
[ROCm][CI] Use larger atol value for INT3 in test_quick_all_reduce.py (#50450)
Signed-off-by: Dino Music <Dino.Music@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-30 21:41:44 -05:00 |
|
|
MattandAndreas Karatzas
|
d91f7af7d0
|
[Hardware][AMD][Kernel][CI][Bugfix] Fix ROCm DeepEP FP8 max (#50467)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-30 21:37:36 -05:00 |
|
|
Kevin H. LuuandOpenAI Codex
|
60399d48eb
|
[CI] Retry Buildkite API rate limits (#50481)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-07-30 19:09:44 -07:00 |
|
|
Bugen Zhao
|
ab98034d4c
|
[Frontend][Bugfix] Use default tool call IDs for Kimi K3 for conversation-level uniqueness (#50420)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-31 10:02:17 +08:00 |
|
|
|
f1899b2ffd
|
[Bugfix][ROCm] AITER MLA: size MTP verification decode metadata for real qlen/dtype (#45227)
Signed-off-by: Edwin Lim <edwin.lim@mangoboost.io>
Signed-off-by: Chaemin Lim <chaemin.lim@mangoboost.io>
Signed-off-by: QinPR <1905873179@qq.com>
Co-authored-by: Edwin Lim <edwin.lim@mangoboost.io>
Co-authored-by: limeward <32970461+edwinlim0919@users.noreply.github.com>
Co-authored-by: QinPR <1905873179@qq.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-30 20:50:34 -05:00 |
|
|
+1
|
4f1da84eb5
|
Enable gfx1250 ROCm architecture (#46516)
Signed-off-by: Douglas Lehr <Doug.Lehr@amd.com>
Signed-off-by: jpvillam <juan.villamizar@amd.com>
Signed-off-by: Daniel <danichan@amd.com>
Signed-off-by: Jaden Mathias <jaden.mathias@amd.com>
Signed-off-by: jpvillam <jpvillam@amd.com>
Signed-off-by: Juan Villamizar <100237675+jpvillam-amd@users.noreply.github.com>
Signed-off-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
Signed-off-by: Jaden Mathias <Jaden.Mathias@amd.com>
Co-authored-by: Douglas Lehr <Doug.Lehr@amd.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Daniel <danichan@amd.com>
Co-authored-by: Jaden Mathias <jaden.mathias@amd.com>
Co-authored-by: jpvillam <jpvillam@amd.com>
Co-authored-by: root <root@ctheliosr-1b114-f01-2.mnb.dcgpu>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
Co-authored-by: dllehr <douglehr@amd.com>
Co-authored-by: Daniel Chan <Daniel.Chan@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-31 01:41:12 +00:00 |
|
|
Andreas Karatzas
|
553fcb82d5
|
[CI] Retry Hugging Face processor loading (#49908)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-31 08:48:08 +08:00 |
|
|
Samuel LaferriereandClaude
|
d6938b7408
|
[Bugfix][Rust Frontend] Select earliest-completing stop string (#50200)
Signed-off-by: Samuel Laferriere <9342524+samlaf@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-31 00:33:19 +00:00 |
|
|
Rohan PotdarandAndreas Karatzas
|
3333d7cb63
|
[ROCm]: bump AITER to 0.1.19 (#49361)
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-30 19:15:19 -05:00 |
|
|
Wentao Ye
|
0bff0ce5d3
|
[Kimi K3 Bug] Fix deepgemm support for kimi k3 (#50458)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-07-30 20:10:16 -04:00 |
|
|
Nicolò Lucchesi
|
8700f86a70
|
[CI] Fix tests/entrypoints/multimodal/openai/chat_completion/test_audio.py::test_chat_streaming_audio (#50451)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-07-30 16:18:53 -07:00 |
|
|
Giancarlo Delfin
|
dec13a33b7
|
[Model Runner V2][Spec Decode] Add multi-layer MTP speculator (#48892)
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
|
2026-07-30 15:54:15 -07:00 |
|
|
jcotant-inferactandClaude Opus 5
|
7fe5312332
|
[CI] Retire the v1 PR label rule, add mrv2 (#50475)
Signed-off-by: Joe Cotant <joe@inferact.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-07-30 15:25:28 -07:00 |
|
|
Ryan ClarkandClaude Fable 5
|
68fb303a41
|
[Bugfix] Preserve Marlin runtime tensor storage across weight reload (#48438)
Signed-off-by: Ryan Clark <ryanclark2k@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-30 14:50:03 -07:00 |
|
|
Bugen ZhaoandOpenAI Codex
|
e9096fcb12
|
[Rust Frontend] Improve startup failure and readiness logs (#50406)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-07-30 14:18:17 -07:00 |
|
|
Shangdi YuandOpenAI Codex
|
45b60e3914
|
[Kernel][Helion] Disable unsafe B200 RMS reduction warp specialization (#50345)
Signed-off-by: Shangdi Yu <shangdiy@meta.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-07-30 20:37:52 +00:00 |
|
|
Michael Goin
|
0eec856cc3
|
Add Humming indexed-MoE regression test (#50468)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-07-30 16:26:24 -04:00 |
|
|
Netanel HaberandOpenAI Codex
|
70bd10930b
|
[Quantization] Honor --linear-backend for ModelOpt W4A16 (#50273)
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-07-30 13:19:56 -07:00 |
|
|
Richard ZouandCodex
|
c27b080d26
|
[compile] Fix fake kernel return dtype (#50444)
Signed-off-by: Richard Zou <zou3519@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-07-30 19:50:02 +00:00 |
|
|
Andreas Karatzas
|
3f90c7e9e6
|
[ROCm] Pass pointers to FlyDSL MoE kernels (#50378)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-30 12:49:26 -07:00 |
|
|
Andreas Karatzas
|
bdc98bf506
|
[CI] Initialize fused gated RMSNorm weights (#50377)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-30 15:34:08 -04:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
30e333ca5f
|
[Bugfix] Shut down private Tensorizer engines (#49840)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-07-30 12:33:22 -07:00 |
|
|
Bugen Zhao
|
629a938a92
|
[Frontend] Preserve bare Inkling text in Python and Rust parsers (#50403)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-30 12:25:10 -07:00 |
|
|
|
12a34a6bc7
|
[ROCm][DSV4] B-preshuffle the attention fp8 projections (#46720)
Signed-off-by: Mehmet Cagri Kaymak <mehmet.kaymak@amd.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-30 13:59:52 -05:00 |
|
|
Kevin H. LuuandMichael Goin
|
5f8f72866c
|
[Build] Fix CUDA release wheel builds (#50243)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
|
2026-07-30 11:48:09 -07:00 |
|
|
Netanel HaberandOpenAI Codex
|
61cacd272f
|
[Bugfix][MoE] Write Humming results to the supplied output buffer (#50338)
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-07-30 11:34:10 -07:00 |
|
|
Wentao Ye
|
837eae6458
|
[DSv4 Perf] Remove redundant full kernel for dsv4, 1.88x kernel performance improvement (#50298)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-07-30 11:39:07 -04:00 |
|
|
Wentao Ye
|
904fae8be1
|
[DSv4 Perf] Fix redundant memory allocation and copy for dsv4 pp buffer, 448 MiB GPU memory saved (#50312)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-07-30 11:38:51 -04:00 |
|
|
Kunshang Ji
|
f388dd6592
|
[XPU][CI] skip kimi-k3 test (#50447)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-07-30 08:27:28 -07:00 |
|
|
Andreas Karatzas
|
5b95890742
|
[FlexAttention] Avoid encoder block-mask compile explosion (#50339)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-30 11:24:13 -04:00 |
|
|
Aaron Hao
|
30b4e7f479
|
[rl] Stateful Trainer Send: IPC [2/N] (#48981)
Signed-off-by: haoaaron <ahao@anyscale.com>
|
2026-07-30 21:59:08 +08:00 |
|
|
BadrBasowid
|
59e831c09a
|
[Compilation]Fuse Transformers Residual Add + RMSNorm (#48757)
Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
|
2026-07-30 13:46:36 +00:00 |
|
|
Julien Denize
|
1a20d23dab
|
[PARSER][Mistral] unified engine-based parser for reasoning and tool calls (#48947)
|
2026-07-30 15:38:00 +02:00 |
|
|
|
e2efe79695
|
[ROCm]Migrating Deepseek V3.2 to vllm/models/deepseek_v32/ (#47207)
Signed-off-by: sroberts-amd <sroberts@amd.com>
Signed-off-by: Stacy Roberts <sroberts@amd.com>
Co-authored-by: Elvir Crncevic <elvircrn@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-30 08:37:43 -05:00 |
|
|
Martin HickeyandHarry Mellor
|
38a267cdd5
|
[MyPy][1/N] Fix mypy errors in some tests/ directories and enforce follow-imports=silent (#49570)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-30 05:02:51 -07:00 |
|
|
Juan Pérez de Algaba
|
89d97d9a16
|
docs(security): document Ray cluster trust model and env var propagation (#50397)
Signed-off-by: jperezde <jperezde@redhat.com>
|
2026-07-30 11:52:55 +00:00 |
|
|
Li, JiangandClaude
|
072a472782
|
[CPU] Bump up CPU kernels to latest version (#50387)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-30 19:18:43 +08:00 |
|
|
+13
|
aeeb36b1f1
|
[New model] Kimi K3 (#50000)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Ziming Huang <zelda.huanghuang@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <mozf@inferact.ai>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Summer Yang <girasoleyang@gmail.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: Bowen Wang <abmfy@icloud.com>
Co-authored-by: gnovack <novackgm@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: xiaozhoupy <peiyuanzhou1994@gmail.com>
Co-authored-by: Roy Wang <yasong.wang@inferact.ai>
Co-authored-by: Jeff (Junze) Ma <93145857+majunze2001@users.noreply.github.com>
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>
|
2026-07-30 03:49:58 -07:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
0c64be8873
|
[Test][ROCm] Account for gfx950 FP8 RMSNorm rounding (#49839)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-07-30 18:46:37 +08:00 |
|
|
Andreas Karatzas
|
61c1d098e5
|
[CI] Stabilize speculator memory teardown (#50284)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-07-30 18:42:55 +08:00 |
|
|
Andreas Karatzas
|
165ed33327
|
[CI][ROCm] Stabilize LLM GC teardown check (#50340)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-07-30 18:42:03 +08:00 |
|
|
Kevin H. LuuandOpenAI Codex
|
48a077e4cf
|
[CI] Improve comment-triggered authorization and retries (#50414)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-07-30 02:48:36 -07:00 |
|
|
Andreas Karatzas
|
e04a30a77c
|
[Frontend] Lazily initialize chat media connectors (#49914)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-30 14:56:37 +08:00 |
|
|
Kevin H. LuuandOpenAI Codex
|
445d3aac0a
|
[CI] Retry failed steps on new PR commits (#50318)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-07-29 23:54:51 -07:00 |
|
|
Fadi Arafeh
|
8122a10536
|
[DOC][CPU] remove tcmalloc warning from CPU docs (#50308)
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
|
2026-07-30 06:30:21 +00:00 |
|