iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
22,280 Commits 3 Branches 0 Tags
d7c55116acabbecc6c588eec2467005d5fe6eb30
Commit Graph
8607 Commits
Author SHA1 Message Date
VenkyandClaude Opus 5.5 d7c55116ac [CI] Fix MiniMax-M3 PP aux-state test mock after #58648 (#59508) 
Signed-off-by: venkywonka <23023424+venkywonka@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
 2026-09-30 17:34:52 -07:00
Kevin H. LuuandClaude Opus 5.5 8bc31bd210 [CI] Deflake the multi-API-server metrics test and Mooncake PD ports (#59507) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-30 17:22:58 -07:00
jackLei 21c08ac458 [CI] Deflake shutdown wait-timeout test by synchronizing on request admission (#58125) 
Signed-off-by: jackLei0901 <42642542+jackLei0901@users.noreply.github.com>
 2026-10-01 00:10:03 +00:00
Andrii SkliarandAndrii Skliar deb148e730 [Mamba] Add FlashInfer ReplaySSM support for MTP (#52928) 
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>
 2026-09-30 21:41:17 +00:00
kliuaeandNick Hill 7e583e615c [Bugfix][Core] Fix mamba prefill checkpoint block reservation and prompt-end eviction in align mode (#59175) 
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
 2026-09-30 21:26:54 +00:00
VenkyandClaude Opus 5.5 42f0c17ea7 [Bugfix][PP][Spec Decode] MiniMax-M3 EAGLE3 aux-state relay at PP > 1 and per-stage FlashInfer autotune (#57197) 
Signed-off-by: venkywonka <23023424+venkywonka@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
 2026-10-01 01:14:24 +04:00
Matthew BonanniClaude Opus 5.5mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		3eb6cec22a [Bugfix][HiSparse] Adopt GPU prefix copies after the hit's allocation (#59282) 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-09-30 15:43:09 -04:00
VenkyClaude Opus 5.5Zijing LiuKyle Liang
 		84f738f187 [Perf][MiniMax-M3] Triton indexer: decode grid retune + SM12.0 split-K (#56151) 
Signed-off-by: venkywonka <23023424+venkywonka@users.noreply.github.com>
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: Zijing Liu <liuzijing2014@gmail.com>
Co-authored-by: Kyle Liang <199154931+kyleliang-nv@users.noreply.github.com>
 2026-09-30 23:33:23 +04:00
djramicandAndreas Karatzas b56b54bc54 [ROCm][CI] Relax simple-nemotron-h-8b GSM8K threshold on ROCm (#59477) 
Signed-off-by: Djordje Ramic <djoramic@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-09-30 19:27:21 +00:00
Matthew BonanniandClaude Opus 5.5 a21a3f2ec7 [CI] Add supports_multimodal_inputs to test_executor_replace's mock config (#59476) 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-30 19:04:47 +00:00
Raphaël RiallandSimon VeitnerLucas Wilkinson
 		0f8b398158 [watermarking] add context deduplication support to speculative decoding (#56807) 
Signed-off-by: Raphael Rialland <raphael.rialland@mistral.ai>
Signed-off-by: Simon Veitner <sveitner@redhat.com>
Co-authored-by: Simon Veitner <sveitner@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
 2026-09-30 12:22:10 -04:00
Yoni GozlanYoni GozlanCursormergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		73a5831127 [Frontend] Port chat_parsing core from Transformers (#58602) 
Signed-off-by: Yoni Gozlan <yonigozlan@users.noreply.github.com>
Co-authored-by: Yoni Gozlan <yonigozlan@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-10-01 00:21:02 +08:00
Yueh-Ting (eop) ChenandMatthew Bonanni ff1b87cca2 [Bugfix][HiSparse] Preserve host prefix publication after request completion (#59007) 
Signed-off-by: Yueh-Ting Chen <yueh.ting.chen@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
 2026-09-30 16:14:51 +00:00
Juan Pérez de AlgabaandCursor cff08b461e [Security] Fix chat template resource-exhaustion DoS (GHSA-4hhp-h66f-… (#50300) 
Signed-off-by: jperezde <jperezde@redhat.com>
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-09-30 08:32:00 -07:00
Harry MellorandClaude Opus 5.5 fc2c801ad9 Disable mypy arg-type and assignment checks in tests (#59428) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-30 15:18:50 +00:00
Yida WengandGrok 17e9295dd5 [BugFix][Multimodal] Pick worst-case DeepSeek-V4 VL dummy image size (#59271) (#59373) 
Signed-off-by: Yida Weng <84164537+YidaWeng@users.noreply.github.com>
Co-authored-by: Grok <grok@x.ai>
 2026-09-30 15:09:11 +00:00
Sergey Shlyapnikov 4e1182a3a6 [ROCm][MoE] Pad the AITER MoE intermediate size at allocation time, and round the expert-group count to a kernel that exists (#55368) 
Signed-off-by: Sergei Shliapnikov <sergei.shliapnikov@amd.com>
 2026-09-30 23:08:21 +08:00
Simon Danielssonandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 2df122e65e [ROCm][Perf][GLM-5.3-Flash] "Fit kpool top-k indices to AITER" with a single Triton kernel (#58008) 
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-09-30 09:45:00 -05:00
Qiu ChunshuoandLucas Wilkinson 98b45c1a94 [Feat] Support PP with PCP in GPU Model Runner V2 (#59139) 
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
 2026-09-30 10:21:56 -04:00
Giulio De PasqualeandIsotr0py 2e52a558f0 [Bugfix][Core] Schedule encoder-only prompts larger than one step (#59029) 
Signed-off-by: Giulio De Pasquale <git@depasquale.giugl.io>
Co-authored-by: Isotr0py <2037008807@qq.com>
 2026-09-30 22:04:28 +08:00
Chaojun ZhangandKunshang Ji 02a3c6dfc5 [Test] Skip IPC weight-transfer test on XPU platforms (#59379) 
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-09-30 21:50:40 +08:00
Cyrus Leung 677e3f5d50 [CI/Build] Fix pre-commit (#59426) 2026-09-30 13:45:28 +00:00
Varun Sundar Rabindranath 5463fe4962 [KV-Offloading][TP] : Expand replicated_layout detection to multi-group MLA (#57652) 2026-09-30 09:11:03 -04:00
Jakub ZakrzewskiNicolò Lucchesimergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		effdea9a53 [MM][Mistral] Add compile support for Pixtral vision encoders (#57168) 
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@mistral.ai>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-09-30 20:27:12 +08:00
almayneandLi, Jiang <jiang1.li@intel.com> 93dd80f636 [CPU] Conv1d optimised kernel for aarch64 (#54093) 
Signed-off-by: Anna Mayne <anna.mayne@arm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2026-09-30 20:23:42 +08:00
Clinton ThomasLucas BourtouleCyrus Leung
 		3d5625cc3c [Security] Authenticate shared-memory multimodal cache handles (#59357) 
Signed-off-by: Clinton Thomas <1033162+KernelClint@users.noreply.github.com>
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-09-30 05:16:26 -07:00
Rukhaiya2004andLi, Jiang <jiang1.li@intel.com> 72e7874fa6 [Hardware][Power] Enable W4A16 (AWQ & GPTQ) quantization on POWER10 using VSX (#59149) 
Signed-off-by: Rukhaiya <bibirukhaiya123@gmail.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2026-09-30 19:44:48 +08:00
Jakub ZakrzewskiandCodex 5a4351ab09 [MM] Keep device input normalization fused when encoder compilation is enabled (#59195) 
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Co-authored-by: Codex <codex@openai.com>
 2026-09-30 11:08:24 +00:00
TaimysCodexLuyi XiaoTaimysHarry MellorClaude Opus 5.5
 		5225f1bacb [MyPy][3/N] Fix MyPy errors in test groups (part 3) (#55939) 
Signed-off-by: Taimys <ffy2281693949@gmail.com>
Signed-off-by: Luyi Xiao <81631911+luyixiao95@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Luyi Xiao <81631911+luyixiao95@users.noreply.github.com>
Co-authored-by: Taimys <ffy2281693949@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-30 11:06:07 +00:00
apex-mochen c4fa6f36a7 [Tests][Multimodal] Cover scoped processor kwargs precedence (#59399) 
Signed-off-by: apex-mochen <2756823972@qq.com>
 2026-09-30 10:54:32 +00:00
Matej Sirovatkaaoshen02OpenAI Codexaoshen02
 		0103a9b96f [Quantization] Add per-token NVFP4 CuTe-DSL MoE backend (#50030) 
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Signed-off-by: S1ro1 <matej.sirovatka@gmail.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
 2026-09-30 10:42:03 +00:00
Mathew Oddenandopencode+glm-5.3+vllm 91dab0eb7f [ROCm][Perf] Allocate the pinned PLE prefetch buffer lazily (#58797) 
Signed-off-by: Mathew Odden <modden@redhat.com>
Co-authored-by: opencode+glm-5.3+vllm <opencode+glm-5.3+vllm@example.com>
 2026-09-30 17:43:16 +08:00
yhcheong (vllmellm) 16d4ac4ba3 [ROCm][MoE] Support MiMo-V2.6 MXFP4 on gfx942 (#58262) 
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
 2026-09-30 17:23:00 +08:00
aoshen02andClaude Opus 5.5 749192ff41 [CI] Skip the IPC weight-checker test on non-CUDA platforms (#59398) 
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-30 09:20:32 +00:00
Ronaldaoshen02Claude Opus 5.5aoshen02
 		713ec07655 [Frontend][RL] Track HTTP weight operation outcomes and concurrency (#55781) 
Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
 2026-09-30 09:19:43 +00:00
Simon Danielsson 3627a6a124 [ROCm][Perf][GLM-5.3-Flash] Stride-aware decode KDA (#57979) 
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
 2026-09-30 08:16:29 +00:00
Alexandra Sidorova b81984879a [K2 Horizon] fold partial-RoPE permutation into q/k (and norm) weights (#55335) 
Signed-off-by: Alexandra Sidorova <asidorov@amd.com>
 2026-09-30 16:03:37 +08:00
cjackal 0a30bc3f9a [Model] Extend device-side mm normalization to GLM4V/GLM5Next (#55389) 
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
 2026-09-30 15:44:46 +08:00
Rehan KhanandLi, Jiang <jiang1.li@intel.com> 583637f126 [CPU][Perf] Add vectorized Sampler Kernel (#53913) 
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2026-09-30 15:16:28 +08:00
Fangzhou AiandCursor Agent 77e8b02c8d [ROCm][Perf] Add opt-in a4w4 (FP4 activation) MoE for DeepSeek V4.1 on AITER (#58819) 
Signed-off-by: fai <fangzhouai@gmail.com>
Signed-off-by: Fangzhou Ai <31551580+Fangzhou-Ai@users.noreply.github.com>
Co-authored-by: Cursor Agent (Claude Sonnet 5) <cursoragent@cursor.com>
 2026-09-30 15:07:44 +08:00
Ronaldaoshen02Claude Opus 5.5
 		e5f3d08d72 [Frontend][RL] Align sleep-mode API responses and operation metrics (#52864) 
Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-29 23:16:38 -07:00
Andreas Karatzas 866fa130fa [Core] Bound UniProc EngineCore startup threads to available CPUs (#58946) 
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
 2026-09-29 23:02:55 -07:00
Harshal AdhavCursorLi, Jiang <jiang1.li@intel.com>
 		5faf81a429 [CPU][Whisper] Support W4A16 quantized Whisper on the CPU WNA16 kernel (#58268) 
Signed-off-by: Harshal Adhav <harshal.adhav@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2026-09-30 13:52:53 +08:00
Ting SUNandFlora Feng fcf4750466 [Bugfix][Frontend] Constrain forced named tool choice with empty parameters to a JSON object (#45290) 
Signed-off-by: Ting Sun <suntcrick@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
 2026-09-30 05:44:35 +00:00
Ting SUNandFlora Feng 329e6eee3f [Bugfix][Frontend] Report named Anthropic tool calls as tool_use (#47598) 
Signed-off-by: Ting Sun <suntcrick@gmail.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
 2026-09-30 05:32:38 +00:00
Shijie Lyu ac68c30872 [Bugfix][Frontend] Ignore reused prompt token ids for media in /v1/responses (#59173) 
Signed-off-by: Shijie Lyu <lshjhf@gmail.com>
 2026-09-30 05:21:09 +00:00
Wentao Yeandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 834ad456d3 [Refactor] Remove dead tests code (#58916) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-09-30 04:39:03 +00:00
Lucas WilkinsonMatthew BonanniClaude Opus 5.5
 		90e13fc757 [Bugfix][HiSparse] Never allocate GPU pages without host backing (#59036) 
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-30 04:13:29 +00:00
Mia Ojeda e006d761a5 [Bugfix][CPU][DiffusionGemma] Support narrower canvas w/ sync scheduling (#59107) 
Signed-off-by: ojeda-e <estefania.b.ojeda@gmail.com>
 2026-09-29 23:28:50 -04:00
Louie Tsai 1b77cc3d67 [Benchmark] Add sweep warmup and failure recovery (#57305) 
Signed-off-by: louie-tsai <louie.tsai@intel.com>
 2026-09-30 11:16:41 +08:00