iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
20,327 Commits 3 Branches 0 Tags
f94666b60d4c58ec0807d22c837cfae322a1dde9
Commit Graph
20327 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
DaeHyun Sung f94666b60d [Bugfix][XPU] Skip oneCCL warm-up all_reduce when world_size == 1 (#52389) 
Signed-off-by: DaeHyun Sung <dhsung@lablup.com>
 2026-08-23 21:31:33 -07:00
ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟andJee Jee Li 702e1d7186 [LoRA] feat: Support LoRA for DeepSeek V4 (#53361) 
Signed-off-by: Hollow Man <hollowman@opensuse.org>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-08-24 03:57:57 +00:00
ThunGuoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> e8888b2d68 [Model] Add FP8 quantization support for ModernBERT (#53101) 
Signed-off-by: thunguo <tew@apache.org>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-08-24 03:04:19 +00:00
Clinton ThomasandLucas Bourtoule 2ec6f0d71e Reject oversized media before fully downloading it (#51896) 
Signed-off-by: Clinton Thomas <1033162+KernelClint@users.noreply.github.com>
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com>
 2026-08-24 01:15:09 +00:00
Dieter Schwarzmann 585bb07c70 feat: add SSE keep-alive comments for idle streaming responses (#51034) 
Signed-off-by: fuzzifikation <40043768+fuzzifikation@users.noreply.github.com>
 2026-08-23 18:13:02 -07:00
danisereb a7195188a4 Add MTP support for Nemotron VL models (#53121) 
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
 2026-08-24 00:59:56 +00:00
FrankandCodex cd329413e2 [Misc] Use VLLMValidationError in Cohere request validation (#52467) 
Signed-off-by: frank-suwen <suwenw2@outlook.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-08-24 00:52:27 +00:00
范裕达 185cada36b [Model] Fix KV cache layout and optimize Dots3 NOTE Omni encoders (#53460) 
Signed-off-by: KurodaKanbei <mistergalahad@gmail.com>
 2026-08-23 10:02:35 -07:00
Aaron Hao 6cd9713463 [RL] P2P RDT weight sync (#43375) 2026-08-23 09:42:22 -07:00
Jensen ChenandClaude Opus 5 39eba6ac36 [Misc] Use VLLMValidationError in offline inference input validation (#53432) 
Signed-off-by: Jensen Chen <a1043904820@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-08-23 08:43:51 -07:00
Wyett b26039b09f Add routed expert loading for gpt-oss (#52209) 
Signed-off-by: Wyett <wyettzeng@gmail.com>
Signed-off-by: wyett <wyettzeng@gmail.com>
 2026-08-23 17:59:08 +08:00
Kevin H. LuuandOpenAI Codex e25c586b90 [CI/Build] Pin Cython below 3.3 for arm64 tilelang sdist (#53358) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-08-23 01:09:27 -07:00
Cyrus LeungandQwen Code ebcd606467 [MM] Simplify prompt updates: replace PromptSeq with list[int] (#53372) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Qwen Code <noreply@alibaba-inc.com>
 2026-08-23 14:50:32 +08:00
anmolgupt a3561ef8e4 [Bugfix][Model] Mistral3: fix image placeholder grid for processor size overrides (#52874) 
Signed-off-by: Anmol Gupta <14880251+anmolgupt@users.noreply.github.com>
 2026-08-22 21:34:38 -07:00
Andreas Karatzas d569e71bd0 [CI][AMD] Honor single-node Docker workload timeout (#52547) 
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
 2026-08-23 11:37:55 +08:00
Biswa Panda 9dba2c9b37 [Rust Frontend][RL]: report engine world size over gRPC (#53204) 
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
 2026-08-23 02:31:23 +00:00
Andreas Karatzas 30b34171b1 [ROCm][CI] Restore attention coverage after KV-cache layout refactor (#53351) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-08-22 20:00:25 -05:00
Brian WoodsClaude Opus 5mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		bbe8b23e1a [Deprecation] Remove dead use_prefill_decode_attention flag (#52557) 
Signed-off-by: Brian Woods <me@brian.biz>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-08-22 22:38:10 +00:00
Zhou248 2f55ef254c [Model] Add Qwen3-Omni DSpark support (#52560) 
Signed-off-by: Zhou248 <630563665@qq.com>
 2026-08-22 15:35:22 -07:00
Taneem Ibrahim a014e35f38 [Pooling] Fix Rust pooling endpoint for benchmark (#53352) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-08-22 15:45:09 -04:00
Wentao Ye 811d12ee26 [Mypy Fix] Mypy fix for "vllm/model_executor/models/[eE][fF]" (#53381) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-08-22 15:41:27 -04:00
Shuolei Wangandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 236f78cc5c [Core][RL] Support sparse checkpoint updates through native weight loaders (#50723) 
Signed-off-by: Shuolei Wang <shuoleiwang123@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-08-22 17:39:58 +00:00
Wentao YeZiming HuangOpenAI Codex
 		9eb9d9d395 [Perf] Support internal prefill checkpoints for Mamba prefix caching, 9%~25% TTFT improvement (#52789) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Ziming Huang <zelda.huanghuang@gmail.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Ziming Huang <zelda.huanghuang@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-08-22 10:32:40 -07:00
Cyrus Leung 020829f66b [MM] Remove renderer_applies_updates flag (#53385) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-08-23 01:25:55 +08:00
Rohan Potdar 610bfc58e9 [ROCm] Ship rocprofiler-sdk 1.3.2 in Dockerfile.rocm_base to fix torch.profiler traces (#53182) 
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
 2026-08-22 12:16:25 -05:00
JensTonoken3mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		da329cc303 [Bugfix] Fix speculative decoding for short_conv (LFM2) models (#50272) 
Signed-off-by: jens.luecke <jens.luecke@liquid.ai>
Co-authored-by: Tonoken3 <sakamakismile@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-08-22 13:34:22 +00:00
Taneem Ibrahimandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 704f12aa1e [Pooling] Report input throughput for batched requests (#53213) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-08-22 09:01:40 -04:00
Kevin H. LuuandOpenAI Codex 10704541aa [CI][ARM64] Restore known-good CUDA 13 builder image (#53374) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-08-22 03:50:33 -07:00
Cyrus Leung 040700aaa6 [MM] Address comments on #53275 (#53364) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-08-22 10:27:59 +00:00
Cyrus Leung 0b19ebcacd [MM] Simplify _apply_hf_processor_main (#53275) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-08-22 01:49:37 -07:00
Tianyu Guo 7ca49fbe4b [Refactor][Model Runner V2][Multimodal] Move the encoder-only path out of the shared runner (#53176) 
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
 2026-08-22 05:11:44 +00:00
Yongye ZhuandOpenAI Codex e9d1398d9e [Bugfix][Kimi K3] Enable deferred MoE finalization before weight loading (#53327) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-08-22 11:23:32 +08:00
ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 b2db227a7c [Bugfix][R3] Unwrap UniformTypeKVCacheSpecs when selecting the routed-experts KV group (#53240) 
Signed-off-by: Hollow Man <hollowman@opensuse.org>
 2026-08-21 19:13:53 -07:00
stefankoncarevic 7f4a1b7e24 [Bugfix][ROCM] Fix the MXFP8 block scale exponent (#53110) 
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
 2026-08-22 01:26:19 +00:00
Lucas Wilkinson 8bdc70ec7b [6/N][KV-Cache Layout Refactor] Standardize KV cache layout (#51718) 
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
 2026-08-21 17:47:49 -07:00
Misha Goin 9ff7041b55 [Bugfix][Spec Decode] Use group geometry for FlashAttention metadata (#53002) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2026-08-21 17:07:19 -07:00
Misha Goin a34f2ab70a [Test] Add focused hybrid MTP prefix-cache regressions (#53189) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2026-08-21 17:05:39 -07:00
Maroon Ayoub a556f3fccb Forward Anthropic vllm_xargs to sampling params (#53308) 
Signed-off-by: Maroon Ayoub <mayoub@redhat.com>
 2026-08-21 15:23:21 -07:00
andrewbcohere f94dcde5c5 Fix Cohere ChatV2 citation and tool handling issues (#52175) 
Signed-off-by: Andrew Berneshawi <andrewberneshawi@cohere.com>
 2026-08-21 15:23:17 -07:00
stefankoncarevic f37d5868b9 [CI/Build][ROCm] Run the TileLang HIP symbol checks in their own interpreter (#53117) 
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
 2026-08-21 16:17:42 -05:00
Kevin H. LuuandAndreas Karatzas e3f6026503 Revert "Remove native Hunyuan V1 and VL implementations" (#53296) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-08-21 13:39:58 -07:00
Kevin H. LuuandAndreas Karatzas 592e06f2ae Revert "[ROCm][Perf] Kimi-K3 Fused kernels for KDA prefill" (#53294) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-08-21 13:34:13 -07:00
Lucas WilkinsonandOpenAI Codex 0a3a4f7f35 [Bugfix][KV Connector][NIXL] Support PCP producers (#52779) 
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-08-21 16:22:01 -04:00
Andreas KaratzasItay EtelisOpenAI Codex
 		3e47a9a824 [CI] Fix MultiConnector accuracy test lifecycle (#53023) 
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Itay Etelis <92247226+Etelis@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-08-21 13:19:19 -07:00
Divakar Verma 29b7c2f7d4 [ROCm][CI] aiter kernel ops - enable rope test (#52854) 
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
 2026-08-21 15:17:34 -05:00
Andreas Karatzas a0af854f5d [ROCm][CI] Stabilize MI355 FlyDSL MoE accuracy test (#53024) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-08-21 13:17:18 -07:00
Divakar Verma b5f7fcc79d [ROCm][CI] Add float16 dtype and unsupported head size tests for paged attention (#53177) 
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
 2026-08-21 15:16:45 -05:00
Andreas Karatzas 88eb946cb1 [ROCm][CI] Stabilize MI355 FusedMoE test group (#53025) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-08-21 13:15:25 -07:00
Kevin H. Luu c0ff33404b Revert compile-cache device index regression on CPU (#53304) 2026-08-21 16:08:13 -04:00
djramic f15ea66b30 [ROCm][Test] Use platform FP8 dtype in ModelOpt FP8_PB_WO test (#53268) 
Signed-off-by: Djordje Ramic <djoramic@amd.com>
 2026-08-21 15:06:19 -05:00