iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
19,234 Commits 3 Branches 0 Tags
94100b5915d449aed0685cc5c6fc8949fcf5fe40
Commit Graph
19234 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Nick HillandClaude Opus 4.8 94100b5915 [CI] Wire untethered test files into CI jobs (#49340) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-28 14:02:31 +00:00
Harry Mellor 62d8db7c05 [Bugfix] Add missing vllm/models/kimi_k3/__init__.py (#50131) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-28 13:47:04 +00:00
Nick HillandClaude Fable 5 601fa9a74e [KV Connector] Support NIXL heterogeneous P/D block sizes for hybrid models (#49612) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-28 06:45:02 -07:00
liangel-02mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Matthew BonanniMichael Goin
 		9b9fc4039c add epilogue hook to flex attention (#45841) 
Signed-off-by: Angel Li <liangel@meta.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
 2026-07-28 06:26:55 -07:00
Nicolò Lucchesi 98e91a9600 [PD][NixlPush] Skip extra add_remote_agent step in D->P handshake (#49345) 
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
 2026-07-28 14:57:12 +02:00
Xin HeandKunshang Ji 948107acf7 [Bugfix] Enhance extra_config handling for layer name suffix matching (#48589) 
Signed-off-by: Xin He <xin3.he@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-07-28 20:37:55 +08:00
Itay Alroy 35efdf6b34 [Elastic EP] Async preparation (#47288) 
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
 2026-07-28 05:19:13 -07:00
Kevin H. LuuandOpenAI Codex d2bfc6fe20 [Build] Fix DeepEP CUDA driver stub linking (#50103) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-07-28 12:09:19 +00:00
Reid 912d6b619d [Rust Frontend] Align sampling validation with Python (#47494) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2026-07-28 12:02:00 +00:00
Reid bf9f23003c [Rust Frontend] Fix finish reason for named tool choices (#49496) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2026-07-28 10:53:18 +00:00
Jiangyun ZhuOpenAI Codexmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		25ace8fe5d [CI] Increase Qwen3.5 MTP GSM8K generation length (#49881) 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-28 18:04:36 +08:00
Chris LeonardandShengqi Chen 247470f23a [CI] Add PyTorch stable ABI audit check (#48164) 
Signed-off-by: Chris Leonard <chleonar@redhat.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
 2026-07-28 02:37:01 -07:00
Liangliang Maandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 88402a41c4 [Test] Skip ROCm AITER MLA prefill tests on non-ROCm platforms (#49945) 
Signed-off-by: Liangliang-Ma <liangliang.ma@intel.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-28 16:26:49 +08:00
Bugen ZhaoandOpenAI Codex 5ed3faa43d [Rust Frontend] Add ordinary-text tokenizer encoding (#49992) 
Co-authored-by: OpenAI Codex <noreply@openai.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-28 15:46:51 +08:00
Thien Tran 61ac368021 [Kimi-K3] Add AttnRes kernels (#50090) 
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
 2026-07-28 00:22:09 -07:00
Andreas KaratzasandOpenAI Codex 99b57a4823 [CI][ROCm] Soft fail LoRA mirror (#50086) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-07-28 00:18:04 -07:00
aoshen02aoshen02vx120Claude Opus 5Roger Wang
 		b09688a6e7 [Bugfix][Spec Decode] Preserve draft buffers across level-2 sleep (#49774) 
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Signed-off-by: vx120 <893600387@qq.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: vx120 <893600387@qq.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-07-28 00:16:21 -07:00
ChaunceyandAndreas Karatzas 03a2d03367 [Bugfix] Respect cgroup memory limits on all platforms (#49966) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-28 14:38:20 +08:00
Shuolei Wang 9069a57139 [Core][Frontend] Add weight version tagging for RL rollouts (#49040) 
Signed-off-by: Shuolei Wang <shuoleiwang123@gmail.com>
Signed-off-by: Shuolei Wang <948904026@qq.com>
 2026-07-28 14:35:29 +08:00
Li, Jiang 90245f4190 [Bugfix] Fix multi-modal support on CPU MRV2 (#50073) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2026-07-28 06:09:48 +00:00
afriedri f472ab0a4c Remove triton per group quant [ROCm] [Bugfix] (#49621) 
Signed-off-by: Andy Friedrich <afriedri@amd.com>
 2026-07-28 05:53:46 +00:00
Ayushman Singh 74587939b1 [Build] Fix CUDA arch detection producing kernel-less builds on SM121 (#49904) 2026-07-27 22:01:56 -07:00
Nick Hill d223c900d8 [Bugfix] Only pad transformers backend value when it is narrower (#50060) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
 2026-07-27 23:36:45 -05:00
MINJUN GILandOpenAI Codex 52c3c4a42f [Bugfix][KV Offload][OBJ] Preserve job completion during cleanup (#49947) 
Signed-off-by: MINJUN GIL <alswnsrlf12@naver.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-07-28 07:10:52 +03:00
Chang GuoGPT-5.6 SolOr Ozeri
 		a8f296083f [KV Offload] Make compact secondary identity TP-independent (#49858) 
Signed-off-by: Change72 <changg@nvidia.com>
Co-authored-by: GPT-5.6 Sol <noreply@openai.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
 2026-07-28 07:10:20 +03:00
Colin ZandAndreas Karatzas fbb1ef6803 [Bugfix] Fix DeepseekV4FP8 Quark MXFP4 crash on list-valued weight (#49634) 
Signed-off-by: Colin Zeng <Colin.Zeng@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-27 22:32:42 -05:00
fxmartyFelix MartyAndreas Karatzas
 		33fe71a4d3 [AMD] Revert Mxfp4MoeBackend.TRITON_UNFUSED fallback (#46491) 
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-27 22:31:23 -05:00
Varun Sundar RabindranathandVarun Sundar Rabindranath d18ed2304a [KV-offload][FS] : Batch store/load_block in C (#49152) 
Signed-off-by: <>
Co-authored-by: Varun Sundar Rabindranath <varun-sundar-rabindranath@h100-01.nemg-001.lab.rdu2.dc.redhat.com>
 2026-07-28 11:21:53 +08:00
nvbfalk 60915c972c [Feature] Add VidCom2 video token pruning (#47750) 
Signed-off-by: Benedikt Falk <bfalk@nvidia.com>
 2026-07-28 03:20:17 +00:00
fxmarty-amdandAndreas Karatzas 7aea73d83d [ROCm][Quark][6/N] Use MXFP4 linear kernel abstraction for aiter backend (#49348) 
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-27 21:35:57 -05:00
Yan Ma 73af7a362a [XPU] Add online fp8 quantization test (#44513) 
Signed-off-by: Yan Ma <yan.ma@intel.com>
 2026-07-28 10:34:33 +08:00
Andreas Karatzas e68bfc2828 [CI][ROCm] Soft-fail Python-only installation mirror (#50041) 
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
 2026-07-27 19:22:53 -07:00
frida-andersson 02b6ecf07c [ROCm][DSv3.2] Eliminate per-decode FillFunctor launches in sparse-MLA hot loop (#44527) 
Signed-off-by: Frida Andersson <fanderss@amd.com>
 2026-07-28 10:12:20 +08:00
avininjamay8avininjamay8avininjamay8
 		1206891822 [ROCm][KVConnector][MoRI-IO] Fix WRITE-mode remote-TP rank collapse (#46332 follow-up) (#47764) 
Signed-off-by: avininjamay8 <avininjamay8@users.noreply.github.com>
Signed-off-by: avininjamay8 <Avinash.Paul@amd.com>
Co-authored-by: avininjamay8 <avininjamay8@users.noreply.github.com>
Co-authored-by: avininjamay8 <avpaul@amd.com>
 2026-07-27 20:26:24 -05:00
Woosuk Kwon 60b3d39cd3 [Docs] Remove experimental warning for EP (#50057) 
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
 2026-07-27 17:06:28 -07:00
Lucas Wilkinson 60417b4b74 [Core][PCP] Select MRV2 when PCP is enabled (#50034) 
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
 2026-07-27 17:03:26 -07:00
Giancarlo Delfin 272abd5f48 [Tests][Spec Decode] Add gemma4 MTP acceptance rates test (#47920) 
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
 2026-07-27 16:15:54 -07:00
Netanel Haber 1e34a13539 Fix Humming non-gated MoE (#49096) 2026-07-27 22:56:44 +00:00
Miłosz GrunwaldandHarry Mellor ebcef33766 Fix MQA with tensor parallelism on transformers modeling backend (#49987) 
Signed-off-by: microslaw <milosz.grunwald@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-27 22:51:17 +00:00
Colin ZTJianfanxingran
 		28158b2fc3 [ROCm] [BugFix] Fix Quark GLM-5.2 Checkpoint inference: indexer wk per-channel FP8 dequant + missing sparse-MLA metadata fields (#48886) 
Signed-off-by: Colin Zeng <Colin.Zeng@amd.com>
Signed-off-by: ColinZ22 <Colin.Zeng@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: fanxingran <xingran.fan@amd.com>
 2026-07-27 22:38:22 +00:00
fxmarty-amd 53f6dd5c6f [CI][ROCm] Fix test_ocp_mx_wikitext_correctness reference value (#49690) 
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
 2026-07-27 21:47:07 +00:00
Andreas Karatzas 99115fcdcd [CI] Initialize DeepEP FP8 test weights (#49912) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-28 05:29:08 +08:00
amd-sourjyaamd-sourjyaCursorAndreas Karatzas
 		1053e248f0 [ROCm][Quantization][5/N] Refactor quark_moe w8a8-int8 w/ oracle (#46765) 
Signed-off-by: amd-sourjya <amd-sourjya@users.noreply.github.com>
Co-authored-by: amd-sourjya <amd-sourjya@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-27 16:01:34 -05:00
Wentao Ye b5bcb3ce88 [Refactor] Remove dead code in multiple files (#49745) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-07-27 15:58:26 -04:00
Wentao Ye b2f9e4caa4 [DSv4 Perf] Adaptive topk width, 1.0% E2E throughput improvement (#50004) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-07-27 15:56:52 -04:00
Andrea TassiDr Andrea TassiClaude Opus 4.8
 		831d3848f1 [Core] Fail fast when /dev/shm is too small for the shm ring buffer (#48879) 
Signed-off-by: Dr Andrea Tassi <andrea@verticular.uk>
Co-authored-by: Dr Andrea Tassi <andrea@verticular.uk>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-27 19:48:35 +00:00
Rishi PuriandClaude Opus 4.8 fd10e8946d [Test] Regression test for hybrid-Mamba eagle cache-peek in Mooncake connector (#43559) (#48361) 
Signed-off-by: Rishi Puri <riship@nvidia.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-27 19:03:58 +00:00
oops-oomoops-oomClaude
 		ed13deb376 [Bugfix][CPU] Fall back to torch for unaligned swigluoai on NEON/vec MoE (#49985) 
Signed-off-by: oops-oom <73481342@qq.com>
Co-authored-by: oops-oom <73481342@qq.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-07-27 18:35:57 +00:00
Harry MellorandClaude Opus 5 99de48e98f Fix MLA padding and grouped topk routing in the Transformers modelling backend (#49982) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-07-27 18:32:32 +00:00
Matthew Bonanniandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> bf2b45b5d6 [Attention] Integrate FlashAttention 4 SM100 headdim 256 support (#42669) 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-07-27 18:25:50 +00:00