iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
21,910 Commits 3 Branches 0 Tags
bd4cb3fe4efd1e19ceec1f31fcd4bfe599b0c3ac
Commit Graph
21910 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Miłosz Grunwald bd4cb3fe4e [BUGFIX] fix ovis2_5 multimodal tokens (#52623) 
Signed-off-by: Milosz Grunwald <milosz.grunwald@intel.com>
 2026-09-25 07:18:54 +08:00
snadampalandNicolò Lucchesi 6a86bf626e [PD][PushConnector] Record last activity of remotes on the D side (#52245) 
Signed-off-by: Sunita Nadampalli <nadampal@amazon.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@mistral.ai>
 2026-09-24 23:15:32 +00:00
Andrey Talman f5b40fcdfe [CI] Report to CRCR after all jobs finish, gated on the build's long pole (#58628) 2026-09-24 16:02:30 -07:00
Fanli LinandKunshang Ji 7edb27f68e [XPU][CI] enable prompt embeds tests on XPU (#58283) 
Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
Signed-off-by: Fanli Lin <fanli.lin@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-09-25 06:56:59 +08:00
Jellow e6c07ea576 [Bugfix][KV Cache] Fix incremental multimodal block hashing (#51694) 
Signed-off-by: Jellow <49915976+CZT0@users.noreply.github.com>
Signed-off-by: Jellow <dvdx@foxmail.com>
 2026-09-24 15:38:03 -07:00
Nick Hill 36f94d5fe8 [Bugfix][Outlines] Fix EOS termination and unconstrained masks after rejected drafts (#58612) 2026-09-24 21:55:56 +00:00
Juntian LiuandClaude Opus 5.5 04730e8270 [DFlash] Capture the context K/V precompute in the draft CUDA graph (#57632) 
Signed-off-by: Juntian Liu <Juntianl777@gmail.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
 2026-09-24 21:38:04 +00:00
stefankoncarevicandAndreas Karatzas e33de821c0 [ROCm][CI] skip the ROCm MRV1 default where MRV1 cannot serve the config (#58535) 
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-09-24 15:36:36 -05:00
Aaron KangandMisha Goin 0908116dd9 [Bugfix] Pass quant_config to DiffusionGemma's ParallelLMHead (#48521) 
Signed-off-by: Aaron Kang <aaron.h.kang@icloud.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
 2026-09-24 13:17:02 -07:00
Matt MastracciClaude Fable 5.1Lucas Wilkinsonmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Misha Goin
 		ab3de6edf2 [Perf] DiffusionGemma: constrained reads over the request's logprob_token_ids (#58216) 
Signed-off-by: Matt Mastracci <matthew@mastracci.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
 2026-09-24 13:15:08 -07:00
Vincent CavéShiksha PatelDouglas LehrAndreas Karatzas
 		92e9c6bf13 [ROCm] Fix misrouting race-condition in multi-decode P/D disagg with mori-io (#51681) 
Signed-off-by: Vincent Cave <vincent.cave@amd.com>
Signed-off-by: Shiksha Patel <shikpate@amd.com>
Co-authored-by: Shiksha Patel <shikpate@amd.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-09-24 19:52:43 +00:00
fxmarty-amdmgoinmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		90a9515006 [Cleanup] Remove online quantization support in fp8.py in favor of online shorthands (#53585) 
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-09-24 12:48:14 -07:00
Misha Goin 58aa2f1ef1 [Refactor] Move auxiliary files out of the repository root (#58572) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2026-09-24 12:38:56 -07:00
Misha Goin cd06e81c41 [Bugfix][Quantization] Add Humming to the W4A8 (INT4xFP8) MoE oracle (#58427) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2026-09-24 12:37:33 -07:00
Xun Sun e773247f8a [Fast Start] Wait for weight cache daemon readiness (#58370) 2026-09-24 19:18:04 +00:00
Nick HillandKimi Code e30559b58f [Core] Skip JIT monitor when JIT warmup is disabled (#58590) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
 2026-09-24 12:08:16 -07:00
Nick HillandKimi 074d57fce1 [Bugfix] Keep JIT warmup under enforce-eager when fault tolerance is on (#58593) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Kimi <noreply@moonshot.cn>
 2026-09-24 12:07:32 -07:00
nightcitybladenightcitybladeCyrus Leung
 		5b3f280a6d [Bugfix] Count unsplit Idefics3 image patches (#48760) 
Signed-off-by: nightcityblade <nightcityblade@gmail.com>
Co-authored-by: nightcityblade <nightcityblade@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-09-24 11:36:26 -07:00
Thomas OrtnerandHarry Mellor 8b84e15066 [transformer] RMSNorm matching for alternative rsqrt (#54461) 
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-09-24 16:33:06 +00:00
Nick Hill 09fe178dba Revert "[DSpark] Support pipeline-parallel targets in aggregated serving (#56956)" (#58484) 2026-09-24 08:48:36 -07:00
Harry MellorandClaude Opus 5.5 d636456b1f [Frontend] Remove the slow tokenizer mode (#58545) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
 2026-09-24 08:48:28 -07:00
LucainClaude Opus 5Harry Mellormergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		344fcc252a [Bugfix] Resolve the Hub revision once per repo (#56092) 
Signed-off-by: Wauplin <lucainp@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-09-24 08:48:24 -07:00
hclClaude Opus 4.8Harry Mellor
 		a7d203efe5 fix(config): apply presence_penalty/frequency_penalty from override-generation-config (#50769) 
Signed-off-by: Chenglun Hu <chenglunhu@gmail.com>
Signed-off-by: hclsys <chenglunhu@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-09-24 08:48:18 -07:00
Yueh-Ting (eop) Chen 26f49e336a [Perf][Attention] Bound FlashInfer prefill dequantization scratch (#57918) 
Signed-off-by: Yueh-Ting Chen <yueh.ting.chen@gmail.com>
 2026-09-24 10:42:08 -04:00
Wentao Ye 3c42385d7d [Refactor] Remove dead or duplicate tests (#58446) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-09-24 10:29:56 -04:00
Harry MellorandClaude Opus 5.5 d881812500 [Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
 2026-09-24 14:14:10 +00:00
Linze Shi 484c211fe8 [Bugfix][Pooling] Fix JinaVL label configuration and restore multimodal tests (#57347) 
Signed-off-by: Linze-Shi <linzeshi0@gmail.com>
 2026-09-24 13:51:25 +00:00
Harry MellorandClaude Opus 5.5 cccf7e1376 Remove .gemini/ and CLAUDE.md (#58541) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
 2026-09-24 12:57:23 +00:00
Fangzhou AiandClaude Opus 5.5 721d0e5c11 [ROCm][DSv4.1][Perf] Emit MXFP8 from the sparse decode reduce and run wo_a as a grouped FP8 GEMM (#58456) 
Signed-off-by: fai <fangzhouai@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-24 11:58:14 +00:00
liuzhenwei dcfc17e0b1 [XPU] enable XPU GRAPH by default (#51600) 
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
 2026-09-24 19:17:25 +08:00
Zijing Liu f5a78f2ad7 [Multimodal] Reuse the supplied tokenizer in the MiniMax-M3 VL processor (#58460) 
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
 2026-09-24 10:47:50 +00:00
SHREY GAJJAR 5747d4500a [Perf][Frontend] Offload streaming derender detokenization (#57528) 
Signed-off-by: Shrey Gajjar <shreygajjar007@gmail.com>
 2026-09-24 10:39:21 +00:00
Ganesh RCursorLi, Jiang <jiang1.li@intel.com>
 		f34a0e0797 [CPU] Gate the AVX10.2 paths on compiler support (#58133) 
Signed-off-by: R <Ganesh.R@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2026-09-24 18:07:53 +08:00
Ziyang Ma cfd5c20286 [XPU][UT] Align HF and vLLM inputs for Qwen2 embedding test by preventing Sentence Transformers from applying chat template (#58117) 
Signed-off-by: RyanMa29 <ziyang.ma@intel.com>
 2026-09-24 10:07:37 +00:00
ReidBugen ZhaoClaude Opus 5.5
 		e430f7421f [Bugfix][Rust Frontend] Prevent MM timing from enabling debug tracing (#58378) 
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: reidliu41 <reid201711@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-24 09:22:23 +00:00
Taneem Ibrahim bbd7c24d6e [MRV2] Validate MRV2 entrypoint logits processors (#57728) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-24 09:07:26 +00:00
Priyansh JainCursorAndreas Karatzas
 		5963795ec7 [Attention][CPU] Run Zen CPU encoder attention on zentorch SDPA (#54508) 
Signed-off-by: priyansh jain <priyansh.jain2@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-09-24 02:05:44 -07:00
Yejing LaiandKunshang Ji 14f98cbe5d [Bugfix][XPU] store the pointer raw bit pattern instead of its numeric value (#54514) 
Signed-off-by: Lai, Yejing <yejing.lai@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-09-24 02:05:26 -07:00
stefankoncarevicAndreas KaratzasAndreas Karatzas
 		c0c35ddd8e [Bugfix][CI] Fix the flaky sharded-sampling tests, and the engine teardown need (#58342) 
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-09-24 02:05:11 -07:00
Andreas KaratzasandOpenAI Codex 23110a0c9e [Bugfix] Capture prefill kernels for mixed FULL graphs (#58275) 
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-09-24 02:05:07 -07:00
jackLeiandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> bbc4ddeca9 [Bugfix][V1] Reject encoder-cache hits with mismatched embedding counts (#57696) 
Signed-off-by: jackLei0901 <42642542+jackLei0901@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-09-24 08:40:47 +00:00
Li, Jiang b44895cf93 [CPU] Use pre-built triton (#58140) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2026-09-24 16:12:34 +08:00
Talor Abramovich 28282ffe34 [Feature][Frontend] Request JSON body debug logging on --enable-log-requests flag (#58163) 
Signed-off-by: talora <talora@nvidia.com>
 2026-09-24 08:08:40 +00:00
Thien TranandOpenAI Codex 00b7847c80 [Perf] Use Conv3dLayer for MiniMax M3 patch embedding (#58512) 
Signed-off-by: OpenAI Codex <codex@openai.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-09-24 00:41:36 -07:00
GuorongYegrYe99Cursor Agent
 		1291bdb85e [EPD][Model Loader] Skip language-model checkpoint shards for --mm-encoder-only (#58086) 
Signed-off-by: grYe99 <guorongye99@gmail.com>
Co-authored-by: grYe99 <guorongye99@gmail.com>
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
 2026-09-24 00:41:15 -07:00
Andreas KaratzasandOpenAI Codex c3f5270270 [ROCm][CI] Add the MI355 TurboQuant t3nc mirror (#58432) 
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
 2026-09-24 02:16:09 -05:00
Tianmu LiOpenAI CodexLi, Jiang <jiang1.li@intel.com>
 		67ddac3ea8 [CPU][GDN] Support NIXL DS convolution-state layout (#53300) 
Signed-off-by: Li, Tianmu <tianmu.li@intel.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2026-09-24 14:55:20 +08:00
Andreas KaratzasandCodex 153f2ba1b9 [Compile][CI] Honor Triton cache overrides and add AMD timeout headroom (#58474) 
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-24 01:27:07 -05:00
Bugen ZhaoClaude Opus 5.5mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		e028554a1f [Rust Frontend] Support --sse-keep-alive-interval (#58306) 
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-24 06:19:14 +00:00
Biswa PandaandCodex cf78797cb7 [Rust Frontend] Pass vision preprocessing context for Nemotron-H (#57634) 
Pass the remaining engine context-length budget to model-owned vision processors through VisionPreprocessingContext. Preserve Nemotron batched engine fields and recognize llm_config as a text_config alias.

Use the merged upstream llm-multimodal revision f0985ef65967615db2c79279aa07818499301bfd.

Co-authored-by: Codex <noreply@openai.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-24 14:08:26 +08:00