iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
7,591 Commits 3 Branches 0 Tags
ffbcc9e757c9feafa6d72c05fca2fa9eafffecdd
Commit Graph
711 Commits
Author SHA1 Message Date
Chauncey 8f2720def9 [Frontend] Support Tool Calling with both tool_choice='required' and $defs. (#20629) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-07-10 13:56:35 +08:00
Chauncey 2155e95ef1 [Bugfix] Fix the issue where reasoning_content is None when Thinkng is enabled and tool_choice is set to 'required'. (#20662) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-07-09 07:39:58 +00:00
kourosh hakhamaneshi baed180aa0 [tech debt] Revisit lora request model checker (#20636) 
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
 2025-07-09 09:42:41 +08:00
Reid 8369b7c2a9 [Misc] improve error msg (#20604) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2025-07-07 21:45:18 -07:00
rongfu.leng 8e807cdfa4 [Misc] feat output content in stream response (#19608) 
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
 2025-07-07 20:45:10 +00:00
Antonanddrobyshev.anton e601efcb10 [Misc] Add fully interleaved support for multimodal 'string' content format (#14047) 
Signed-off-by: drobyshev.anton <drobyshev.anton@wb.ru>
Co-authored-by: drobyshev.anton <drobyshev.anton@wb.ru>
 2025-07-07 19:43:08 +00:00
ztang2370 a37d75bbec [Front-end] microbatch tokenization (#19334) 
Signed-off-by: zt2370 <ztang2370@gmail.com>
 2025-07-07 17:54:10 +01:00
wang.yuqi 110df74332 [Model][Last/4] Automatic conversion of CrossEncoding model (#19675) 
Signed-off-by: wang.yuqi <noooop@126.com>
 2025-07-07 14:46:04 +00:00
Abirdcfly 448acad31e [Misc] remove unused jinaai_serving_reranking (#18878) 
Signed-off-by: Abirdcfly <fp544037857@gmail.com>
 2025-07-07 09:14:12 +00:00
Woosuk Kwon 462b269280 Implement OpenAI Responses API [1/N] (#20504) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-07-06 18:32:13 -07:00
Cyrus Leung c18b3b8e8b [Bugfix] Add use_cross_encoder flag to use correct activation in ClassifierPooler (#20527) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-06 14:01:48 -07:00
Reid 43813e6361 [Misc] call the pre-defined func (#20518) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2025-07-06 10:25:29 +00:00
Flora Feng fe1e924811 [Frontend] Support image object in llm.chat (#19635) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
 2025-07-06 06:47:13 +00:00
Reid 8d763cb891 [Misc] remove unused import (#20517) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2025-07-05 19:17:06 -07:00
Reid 7e90870491 [Misc] Add security warning for development mode endpoints (#20508) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2025-07-04 20:52:13 -07:00
Jee Jee Li 1caca5a589 [Misc] Add SPDX-FileCopyrightText (#20428) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-07-04 07:40:42 +00:00
Gabriel Marinho a4113b035c [Platform] Add custom default max tokens (#18557) 
Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
 2025-07-04 10:50:17 +08:00
Reid 619b9f5c7e [Frontend] fix duplicate output for bench subcmd (#20446) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2025-07-03 08:02:06 -07:00
Reid 9854dc9040 [Frontend] improve vllm bench <bench_type> --help display (#20430) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2025-07-03 14:22:16 +00:00
wang.yuqi 6f1229f91d [Model][2/N] Automatic conversion of CrossEncoding model (#19978) 
Signed-off-by: wang.yuqi <noooop@126.com>
 2025-07-03 13:59:23 +00:00
Cyrus Leung b024a42e93 [Core] Move multimodal placeholder from chat utils to model definition (#20355) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-03 08:18:30 +00:00
qscqesze 363528de27 [Feature] Support MiniMax-M1 function calls features (#20297) 
Signed-off-by: QscQ <qscqesze@gmail.com>
Signed-off-by: qingjun <qingjun@minimaxi.com>
 2025-07-03 06:48:27 +00:00
Nick Hill 059d4cdb49 [BugFix] Fix DP headless mode arg validation (#20398) 
Signed-off-by: Nick Hill <nhill@redhat.com>
 2025-07-02 17:15:32 -07:00
Nick Hill 657f2f301a [DP] Support external DP Load Balancer mode (#19790) 
Signed-off-by: Nick Hill <nhill@redhat.com>
 2025-07-02 10:21:52 -07:00
Kwai-Keye 8452946c06 [Model][VLM] Support Keye-VL-8B-Preview (#20126) 
Signed-off-by: Kwai-Keye <Keye@kuaishou.com>
 2025-07-01 23:35:04 -07:00
Chenheli Hua 2e7cbf2d7d [Frontend] Support configurable mm placeholder strings & flexible video sampling policies via CLI flags. (#20105) 
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
 2025-07-01 23:34:03 -07:00
Lifans 9ec1e3065a [Misc][Doc] Add missing comment for LLM (#20285) 
Signed-off-by: Lifan Shen <lifans@meta.com>
 2025-07-01 19:04:24 -07:00
Shintarou Okada 3d19d47d91 [Frontend] Expand tools even if tool_choice="none" (#17177) 
Signed-off-by: okada shintarou <okada@preferred.jp>
 2025-07-01 12:47:38 -04:00
Nicolò Lucchesi 314af8617c [Docs] Update transcriptions API to use openai client with stream=True (#20271) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-07-01 15:47:13 +00:00
Yuxuan ZhangandIsotr0py ed70f3c64f Add GLM4.1V model (Draft) (#19331) 
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-07-01 12:48:26 +00:00
fyuan1316 e28533a16f [Bugfix] Fix include prompt in stream response when echo=true (#15233) 
Signed-off-by: Yuan Fang <yuanfang@alauda.io>
 2025-07-01 01:30:14 +00:00
Kyle Sayers d8cf819a9a [Core] [Bugfix] [Multimodal] Fix multimodal profiling and generation for SFT/PTQed models (#20058) 
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
 2025-06-30 17:26:49 +00:00
Nicolò Lucchesi daceac57c7 [Frontend] Generalize v1/audio/transcriptions endpoint (#20179) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-06-28 08:15:26 -07:00
Ilya Lavrenov aa0dc77ef5 [Perf] Improved perf for resolve_chat_template_content_format (#20065) 
Signed-off-by: Ilya Lavrenov <ilya.lavrenov@cerebras.net>
 2025-06-27 09:16:41 +00:00
Yazan Sharaya 6e244ae091 [Perf][Frontend] eliminate api_key and x_request_id headers middleware overhead (#19946) 
Signed-off-by: Yazan-Sharaya <yazan.sharaya.yes@gmail.com>
 2025-06-27 00:44:14 -04:00
Michael Goin 754b00edb3 [Bugfix] Fix Mistral tool-parser regex for nested JSON (#20093) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-06-26 01:01:17 +00:00
Nicolò LucchesiandRoger Wang e795d723ed [Frontend] Add /v1/audio/translations OpenAI API endpoint (#19615) 
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
 2025-06-25 17:54:14 +00:00
Max Wittig f59fc60fb3 [Feat][CLI] enforce-include-usage (#19695) 
Signed-off-by: Max Wittig <max.wittig@siemens.com>
 2025-06-25 01:43:04 -04:00
Nick Hill 8619e7158c [BugFix] Fix multi-node offline data parallel (#19937) 
Signed-off-by: Nick Hill <nhill@redhat.com>
 2025-06-24 12:45:20 -07:00
Aaron Pham c4cf260677 [Perf][CLI] Improve overall startup time (#19941) 2025-06-22 23:11:22 +00:00
Ye (Charlotte) Qi 2c11a29f0b [Misc] Simplify vllm bench cli subcommand implementation (#19948) 2025-06-22 12:34:48 -04:00
Rabin Adhikari 8ca81bb069 Fix: Check the type of params to be a Sequence not list. (#19910) 
Signed-off-by: Rabin Adhikari <rabin.adk1@gmail.com>
 2025-06-20 23:03:17 +00:00
Thomas Parnell 7771d1de88 [Fix] import regex instead of re (#19875) 
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
 2025-06-20 11:16:48 +00:00
xzbdmw ea10dd9d9e [Frontend] early return chat format resolution when specified (#19735) 2025-06-19 18:49:59 +00:00
Alex Brooks ead2110297 [Core][Bugfix] Fix Online MM Beam Search (#19688) 
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
 2025-06-19 17:18:07 +00:00
NekoMimiUnagiand22quinn 466166dcfd [Frontend] Add optional token-level progress bar to LLM.beam_search (#19301) 
Signed-off-by: Ruosen Li <rxl190028@utdallas.edu>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Ubuntu <ubuntu@ip-172-31-71-179.ec2.internal>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
 2025-06-19 03:21:41 -04:00
Zuxin 1d0ae26c85 Add xLAM tool parser support (#17148) 2025-06-19 14:26:41 +08:00
Maximilien de Bayserand22quinn 799397ee4f Support embedding models in V1 (#16188) 
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
 2025-06-18 21:36:33 -07:00
afeldman-nmandNick Hill dfada85eee [Frontend] Expose custom args in OpenAI APIs (#16862) 
Signed-off-by: Andrew Feldman <afeldman@neuralmagic.com>
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
 2025-06-18 17:41:11 -07:00
nguyenhoangthuan99 ede5c4ebdf [Frontend] add chunking audio for > 30s audio (#19597) 
Signed-off-by: nguyenhoangthuan99 <thuanhppro12@gmail.com>
 2025-06-17 11:34:00 +08:00