iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
21,022 Commits 3 Branches 0 Tags
5af4cc33ec0837ded8a18b368ec58a9fd4e4d5cd
Commit Graph
21022 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Taneem Ibrahim 5af4cc33ec [Bugfix] Fix OpenPangu multimodal embedding merge (#55941) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-08 23:53:59 +00:00
Stefano CastagnettaNick Hillmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		9c2d21046b [Bugfix][Spec Decode] Honour the draft's moe_backend on Model Runner V2 (#54788) 
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-09-08 16:50:07 -07:00
Jim BanClaudeHarry Mellor
 		c0d8d5413e [Transformers] Generalize merged-column linear fusion (#55301) 
Signed-off-by: BANANASJIM <bananasjim1@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-09-08 23:49:37 +00:00
sychen52mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Isotr0py
 		60ad959b6f Fix block FP8 MTP in ModelOpt mixed checkpoints (#55513) 
Signed-off-by: Shiyang Chen <shiychen@nvidia.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
 2026-09-08 22:47:21 +00:00
Chaitanya Sri Krishna Lolla 28a2ccee78 [ROCm][DI][CI] Enable WideEP Intranode tests (#53195) 
Signed-off-by: lcskrishna <lollachaitanya@gmail.com>
 2026-09-08 17:06:36 -05:00
Kevin H. Luu 05e52f6336 [CI] Fix ARM64 test dependency builds with GCC 15 (#55877) 
Signed-off-by: khluu <khluu000@gmail.com>
 2026-09-08 14:27:13 -07:00
cjackalmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Flora Feng
 		bf339618d1 [Misc] Bump openai to >=2.25.0 to support namespace tools types (#49104) 
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
 2026-09-08 14:11:12 -07:00
Wentao Ye bfb443a6b6 [Kimi Bug] Fix kda ima Triton Error [CUDA]: an illegal memory access was encountered (#55924) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-09-08 14:07:54 -07:00
Flora FengandWentao Ye 0a742da274 [Perf] Eliminate full-history reasoning scans for structured outputs (#55223) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2026-09-08 14:07:22 -07:00
Flora FengandWentao Ye 29f46ac475 [Perf] Eliminate full-history reasoning scans for structured outputs (#55223) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2026-09-08 14:07:16 -07:00
djramicandKevin H. Luu 73f61d12aa [CI][ROCm] Increase timeouts for AMD MI300 jobs (#55919) 
Signed-off-by: Djordje Ramic <djoramic@amd.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
 2026-09-08 14:06:05 -07:00
Andreas KaratzasandOpenAI Codex db3814a4f2 [Attention] Require explicit DCP support from attention implementations (#55780) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-09-08 14:04:27 -07:00
Andreas Karatzas cb22234687 [CI] Reuse ColQwen3 models across pooling tests (#55889) 
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
 2026-09-08 14:03:54 -07:00
bnellnmLucas WilkinsonOpenAI Codex
 		d29c88f162 [Core] Let SWA layers take the primary block size to avoid inflating the KV block LCM (#53007) 
Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-09-08 16:44:43 -04:00
Kevin H. LuuKimi CodeCodex
 		808353f477 [CI] Split long misc test groups by command (#52346) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-08 13:44:14 -07:00
Andreas Karatzas 18615ad1ee [Bugfix] Handle null RoPE parameters for NoPE layers (#55949) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-09-08 20:20:05 +00:00
Matthew BonanniOpenAI CodexOpenAI Codex
 		e0aaef85f3 [2/N][KV Connector][NIXL] Support per-region transfer geometry (#53780) 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
 2026-09-08 16:01:12 -04:00
Roderick Wuandmgoin 2c9d68f80b [Quant][Kernel] Remove GPTQ Group/Dynamic Activation Ordering (#54809) 
Signed-off-by: Roderick-Wu <roderickwu2003@gmail.com>
Signed-off-by: Roderick Wu <roderickwu2003@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
 2026-09-08 12:45:12 -07:00
shikamd123 1a522b6949 [ROCm] [Docker] Upgrade default AINIC repo to ship libionic 54.0-187-1 (#54112) 
Signed-off-by: Shiksha Patel <shiksha.patel@amd.com>
 2026-09-08 19:21:18 +00:00
sychen52andCyrus Leung 1b2c591cd0 [Bugfix] speedup nvfp4 kv for FMHA (#55031) 
Signed-off-by: Shiyang Chen <shiychen@nvidia.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-09-08 17:25:42 +00:00
Raya Elena Solanoandmgoin bcca76e7db [Test] Dequantize NVFP4 KV cache scales in the layout the kernel writes (#55908) 
Signed-off-by: Raya Elena Solano <raya.solano@mbinf.de>
Co-authored-by: mgoin <mgoin64@gmail.com>
 2026-09-08 17:13:39 +00:00
Jiangyun ZhukhluujiahaoKimi Code
 		8ebc5b0a18 [Bugfix] Fix NVFP4 fused SiLU+mul scale allocation and global scale direction (#55643) 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: khluu <khluu000@gmail.com>
Co-authored-by: jiahao <jxia77@terpmail.umd.edu>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
 2026-09-08 08:26:07 -07:00
Wentao Ye 6b15bea080 [Refactor] Remove utils dead code (#53941) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-09-08 11:22:09 -04:00
Qiu Chunshuo 7c2f1ff495 [Core] Scope PCP-DP validation to GPU manager (#54523) 
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
 2026-09-08 08:18:01 -07:00
Canlin GuoandOpenAI Codex 8e1f97e709 [Qwen3.8-Flash-Next] Tune FP8 TP2/TP4 Triton MoE on B200 (#55890) 
Signed-off-by: Canlin <canlinguosdu@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
 2026-09-08 22:45:18 +08:00
linitra24 b105d8284f [LoRA] Clarify target module matching logic (#55865) 
Signed-off-by: linitra24 <renshuang.zhou@daocloud.io>
 2026-09-08 07:30:15 -07:00
Wentao Ye 07950d4734 [Kimi Bug] Fix kimi k3 startup cuda graph issue with recoverSSM (#55774) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-09-08 10:29:53 -04:00
Roberto L. CastroandCodex 6ddbab03de [4/N][warmup][DSv4] Migrate common attention kernels (#50176) 
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Co-authored-by: Codex <codex@openai.com>
 2026-09-08 10:25:48 -04:00
Sherif WalyandNicolò Lucchesi f998862d46 [Bugfix] Fix Kimi K3 loading with interleaved weight streams (#53379) 
Signed-off-by: Sherif Waly <sherif.waly@mistral.ai>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@mistral.ai>
 2026-09-08 16:08:51 +02:00
Mohit SinglaandCodex 613ab20f7f [Model] Enable torch.compile for Sarvam MLA (#55817) 
Signed-off-by: mohit-sarvam <mohit@sarvam.ai>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-08 22:01:30 +08:00
akshaverwzhao18Claude Opus 5roikoren755
 		263c4ff95f [Bugfix][Spec Decode] Cache the Mamba state at the block-grid position of EAGLE resume (#53945) 
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: Adam Shaver <ashaver@nvidia.com>
Signed-off-by: akshaver <168006157+akshaver@users.noreply.github.com>
Co-authored-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: roikoren755 <26850796+roikoren755@users.noreply.github.com>
 2026-09-08 09:59:58 -04:00
Thomas ParnellClaudeHarry Mellor
 		414057a3d3 [Bugfix] Apply attention sinks in the Transformers backend (#52156) 
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-09-08 13:54:07 +00:00
SunCodexIsotr0py
 		472d8c9125 [Perf] Fuse DeepEncoder relative bias in Triton attention (#55629) 
Signed-off-by: levius <2114377220@qq.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
 2026-09-08 13:22:04 +00:00
Andy LoandOpenAI Codex 5ebce2391e [Bugfix][KV Offload] Respect prefix-cache bypass in SimpleCPUOffload (#54998) 
Signed-off-by: Andy Lo <andy@mistral.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-09-08 13:14:19 +00:00
Stefano Castagnetta f6326f53bd [Perf][GDN] Enable the FlashInfer GDN prefill kernel on SM12x (#55715) 
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
 2026-09-08 12:26:03 +00:00
Shanshan Shen 25047604fe [ROCm][Perf] Remove AITER paged-MQA outputs guard for DeepSeek-V4 (#55808) 
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
 2026-09-08 06:58:26 -05:00
Kevin H. Luu 34b9899c8f [CI] Increase ColQwen3 pooling test memory budget on H200 MIG (#55878) 
Signed-off-by: khluu <khluu000@gmail.com>
 2026-09-08 11:39:01 +00:00
Stefano Castagnetta 13cf9e05c1 [Perf][Quant][NVFP4] Prefer W4A4 linear kernels over weight-only ones on SM120/121 (#55170) 
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
 2026-09-08 15:06:45 +04:00
jimmy-adams e41a17e606 [ROCm][Quantization] Support AMD Quark per-block FP8 for fused MoE layers (#52263) 
Signed-off-by: huji <huidong.ji@amd.com>
Signed-off-by: jimmy-adams <41593649+jimmy-adams@users.noreply.github.com>
 2026-09-08 10:30:26 +00:00
Kevin H. LuuandCodex 5db652225f [Bugfix] Validate extension integers before engine serialization (#55606) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-08 16:30:06 +08:00
Kevin H. LuuandCodex 96eccb8f49 [CI] Restore clean GPU state before OAI Triton MoE tests (#55453) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-08 01:15:21 -07:00
Taoyu ZhuandShanshan Shen ce6c241ddc [ROCm][Perf][M3] Fused allreduce+GemmaRMSNorm fast path (#54787) 
Signed-off-by: Taoyu Zhu <zhutaoyu97@gmail.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
 2026-09-08 07:21:49 +00:00
ahmed xijiaat 81dabe2e5d [Bugfix][KV Offload] Validate SWA coverage at unaligned cache-hit boundaries (#55712) 
Signed-off-by: xijiade.aihemaiti <3146335281@qq.com>
 2026-09-08 10:15:48 +03:00
Adababyandshaolila 5133e1d285 [Frontend] Migrate input-validation errors to VLLMValidationError (harmony/mistral/chat_utils/params) (#55735) 
Signed-off-by: shaolila <shaolila@buaa.edu.cn>
Co-authored-by: shaolila <shaolila@buaa.edu.cn>
 2026-09-08 06:45:40 +00:00
aoshen02 755541443f [Bugfix][ROCm] Mask paged attention V cache padding (#53856) 
Signed-off-by: aoshen02 <aoshen@inferact.ai>
 2026-09-08 14:39:23 +08:00
Subhash Polisetti 782f36cd0c [Bugfix][InternVL] Stop the video parser consuming image_embeds (#55779) 
Signed-off-by: subhash polisetti <subhashr161347@gmail.com>
 2026-09-08 05:19:41 +00:00
Dev OskiiCursorCyrus Leung
 		6c73b08dec [Bugfix] reject string file on translation like transcription (#55618) 
Signed-off-by: oskii <oscarchambersweb@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-09-08 05:02:53 +00:00
weihan 9ea8f3ffc3 [Bugfix] Honor STEP token pooling in DispatchPooler.for_seq_cls (#55307) 
Signed-off-by: weihan <130119942+krsish@users.noreply.github.com>
 2026-09-08 04:13:09 +00:00
mingg26Kimi Codemergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		7fa2c63796 [Bugfix] Autotune FlashInfer deferred MoE decode kernels before CUDA graph capture (#55377) 
Signed-off-by: ming <ming@inferact.ai>
Co-authored-by: Kimi Code <kimi-code@moonshot.cn>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-09-08 04:02:23 +00:00
He LiuandKimi eb6b619ab2 [Bugfix][KV Offload] Register mixed page sizes in one cache group (#54756) 
Signed-off-by: heliubj18 <chengfeng@ppio.com>
Co-authored-by: Kimi <noreply@moonshot.cn>
 2026-09-07 20:50:15 -07:00