iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
11,384 Commits 3 Branches 0 Tags
5bdd15527770ef39cc4c3cdca008fb4f9cf8a15f
Commit Graph
129 Commits
Author SHA1 Message Date
Chauncey 5c9ad138d5 [Frontend] supports interleaved thinking (#28531) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-11-13 16:14:13 +08:00
Chenheli Hua 1fb4217a05 [Multimodal] Make MediaConnector extensible. (#27759) 
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
 2025-11-04 18:28:01 +00:00
wangln19wangln19Cyrus Leung
 		446912d1cb fix: allow HuggingFace standard chat template params via **kwargs (#27622) 
Signed-off-by: wangln19 <wanglinian@dev.wanglinian.msh-dev.svc.cluster.local>
Signed-off-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Co-authored-by: wangln19 <wanglinian@dev.wanglinian.msh-dev.svc.cluster.local>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-10-28 21:12:34 +08:00
Russell BryantandDarkLight1337 58fab50d82 [Frontend] Require flag for loading text and image embeds (#27204) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-22 15:52:02 +00:00
Russell BryantandIsotr0py 3ada34f9cb [Frontend] Enforce tokenize=False when applying chat template (#27205) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-10-21 02:57:34 +00:00
Cyrus Leung d31f7844f8 [Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-19 05:20:55 -07:00
Cyrus Leung f6cdc9a02f [Chore] Rename utils submodules (#26920) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-16 03:58:13 +00:00
Cyrus Leung 136a17fe6e [Chore] Separate out vllm.utils.func (#26904) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-15 13:03:58 +00:00
Harry Mellor 8fcaaf6a16 Update Optional[x] -> x | None and Union[x, y] to x | y (#26633) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-12 09:51:31 -07:00
Julien Denize c6187f55f7 Refactor MistralTokenizer (#26358) 
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
 2025-10-09 22:48:58 +00:00
Cyrus Leung 44b9af5bb2 [Benchmark] Enable MM Embedding benchmarks (#26310) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-06 19:51:58 +00:00
Harry Mellor b893d661b1 Fix per file ruff ignores related to simplification (#26259) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-05 20:31:53 +00:00
Harry Mellor 4e256cadc2 Remove all references to yapf as it's no longer used (#26251) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-05 09:18:11 -07:00
Harry Mellor d6953beb91 Convert formatting to use ruff instead of yapf + isort (#26247) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-05 07:06:22 -07:00
Isotr0py a42d2df75f [Frontend] Cache chat template kwargs resolution (#26227) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-10-04 15:32:30 +00:00
Russell BryantandIsotr0py 7977e5027c Add filtering for chat template kwargs (#25794) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-09-27 10:46:49 +00:00
Russell BryantandChenheli Hua 3958b96bf5 Add option to restrict media domains (#25783) 
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Chenheli Hua <huachenheli@outlook.com>
 2025-09-27 01:23:52 +00:00
Cyrus Leung 65a5910ce3 [Optimization] Cache chat template result when processor fails to be loaded (#25341) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-09-21 19:41:02 +08:00
Chaunceyandxin.li f91480b2d4 [Bugfix] fix tool call arguments is empty (#25223) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: xin.li <xin.li@daocloud.io>
 2025-09-20 13:29:54 +08:00
Harry Mellorandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> c4afdb69cc Move MultiModalConfig from config/__init__.py to config/multimodal.py (#24659) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-09-15 17:43:16 +00:00
Chenheli HuaRoger WangRoger Wang
 		7f2ea7074e [Frontend][Multimodal] Allow skipping media data when UUIDs are provided. (#23950) 
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
 2025-09-13 02:16:06 +00:00
Chenheli HuaRoger WangRoger WangCyrus Leung
 		01dfb5e982 [Frontend] User-provided uuids for medias in chat. (RFC #22044) (#23449) 
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-09-08 06:42:20 -07:00
Chenheli Hua f399182e8c Run ruff format on a few files. (#24075) 
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
 2025-09-02 17:55:32 +00:00
Didier Durand d3da2eea54 [Doc]: fix typos in Python scripts (#23828) 
Signed-off-by: Didier Durand <durand.didier@gmail.com>
 2025-08-28 05:37:38 -07:00
Didier Durand 22cf679aad [Doc]: fix various typos in multiple files (#23179) 
Signed-off-by: Didier Durand <durand.didier@gmail.com>
 2025-08-22 10:38:46 -07:00
bigmoyanandwangzhengtao 582bbe6bd7 [Fix] correct tool_id for kimi-k2 when use tool_choice=required (#21259) 
Co-authored-by: wangzhengtao <wangzhengtao@msh.team>
 2025-08-20 12:59:54 -07:00
Chen ZhangandWoosuk Kwon f6278b6243 [gpt-oss] Convert user input to harmony format (#22402) 
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-08-06 20:56:02 -07:00
Cyrus Leung f5d0f4784f [Frontend] Improve error message for too many mm items (#22114) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-08-02 02:20:38 -07:00
Cyrus Leung 9532a6d563 [Deprecation] Remove deprecated args and methods (#21907) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-30 23:46:38 -07:00
Julien Denize 6d8d0a24c0 Add think chunk (#21333) 
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
 2025-07-23 21:51:32 -07:00
Chauncey 34cda778a0 [Frontend] OpenAI Responses API supports input image (#20975) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-07-15 18:59:36 -06:00
Harry Mellor 3482fd7e4e [Doc] Add engine args back in to the docs (#20674) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-10 08:02:40 -07:00
Antonanddrobyshev.anton e601efcb10 [Misc] Add fully interleaved support for multimodal 'string' content format (#14047) 
Signed-off-by: drobyshev.anton <drobyshev.anton@wb.ru>
Co-authored-by: drobyshev.anton <drobyshev.anton@wb.ru>
 2025-07-07 19:43:08 +00:00
Woosuk Kwon 462b269280 Implement OpenAI Responses API [1/N] (#20504) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-07-06 18:32:13 -07:00
Flora Feng fe1e924811 [Frontend] Support image object in llm.chat (#19635) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
 2025-07-06 06:47:13 +00:00
Cyrus Leung b024a42e93 [Core] Move multimodal placeholder from chat utils to model definition (#20355) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-03 08:18:30 +00:00
Kwai-Keye 8452946c06 [Model][VLM] Support Keye-VL-8B-Preview (#20126) 
Signed-off-by: Kwai-Keye <Keye@kuaishou.com>
 2025-07-01 23:35:04 -07:00
Chenheli Hua 2e7cbf2d7d [Frontend] Support configurable mm placeholder strings & flexible video sampling policies via CLI flags. (#20105) 
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
 2025-07-01 23:34:03 -07:00
Yuxuan ZhangandIsotr0py ed70f3c64f Add GLM4.1V model (Draft) (#19331) 
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-07-01 12:48:26 +00:00
Ilya Lavrenov aa0dc77ef5 [Perf] Improved perf for resolve_chat_template_content_format (#20065) 
Signed-off-by: Ilya Lavrenov <ilya.lavrenov@cerebras.net>
 2025-06-27 09:16:41 +00:00
xzbdmw ea10dd9d9e [Frontend] early return chat format resolution when specified (#19735) 2025-06-19 18:49:59 +00:00
Simon Mo 02f0c7b220 [Misc] Add SPDX-FileCopyrightText (#19100) 
Signed-off-by: simon-mo <simon.mo@hey.com>
 2025-06-03 11:20:17 -07:00
Guillaume Calmettes 9a21e331ff [Bugfix]: correctly propagate errors message caught at the chat_templating step to the client (#18769) 
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
 2025-05-28 03:35:43 +00:00
Isotr0pyandCyrus Leung 75f81750f3 [VLM] Initialize video input support for InternVL models (#18499) 
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-05-25 04:51:25 +00:00
fxmarty-amd a5f8c111c2 [Fix] Fix typo in resolve_hf_chat_template (#18259) 
Signed-off-by: Felix Marty <felmarty@amd.com>
 2025-05-16 14:52:41 +00:00
Sebastian Schoennenbeck 2aa5470ac5 [Frontend] Fix chat template content format detection (#18190) 
Signed-off-by: Sebastian Schönnenbeck <sebastian.schoennenbeck@comma-soft.com>
 2025-05-15 09:00:21 -07:00
lkchen 6685890d11 [Fix] Move "model_config" as keyword args in chat_utils.py (#18098) 
Signed-off-by: Linkun <github@lkchen.net>
 2025-05-13 23:27:26 -07:00
Aaron Pham cb528d0585 [Fix] check to make sure processor has chat templates (#18047) 
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
 2025-05-13 03:04:10 -07:00
Maximilien de Bayserandigmainc 05a4324f8e Initialize the delta tool call fields explicitly (#17340) 
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: igmainc <igmainc@icloud.com>
 2025-05-12 13:28:58 +00:00
Isotr0py 021c16c7ca [Model] Broadcast Ovis2 implementation to fit Ovis1.6 (#17861) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-05-11 17:56:30 -07:00