iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
6,768 Commits 3 Branches 0 Tags
6881107948c00a8564bc2fa85308f6fc2f065d64
Commit Graph
52 Commits
Author SHA1 Message Date
youkaichao 1cab43c2d2 [misc] instruct pytorch to use nvml-based cuda check (#15951) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-04-03 01:02:58 +08:00
Lu Fang 29f1d47e73 [MISC] Always import version library first in the vllm package (#12979) 
Signed-off-by: Lu Fang <lufang@fb.com>
 2025-02-09 18:56:40 +08:00
Russell Bryant e489ad7a21 [Misc] Add SPDX-License-Identifier headers to python source files (#12628) 
- **Add SPDX license headers to python source files**
- **Check for SPDX headers using pre-commit**

commit 9d7ef44c3cfb72ca4c32e1c677d99259d10d4745
Author: Russell Bryant <rbryant@redhat.com>
Date:   Fri Jan 31 14:18:24 2025 -0500

    Add SPDX license headers to python source files
    
This commit adds SPDX license headers to python source files as
recommended to
the project by the Linux Foundation. These headers provide a concise way
that is
both human and machine readable for communicating license information
for each
source file. It helps avoid any ambiguity about the license of the code
and can
    also be easily used by tools to help manage license compliance.
    
The Linux Foundation runs license scans against the codebase to help
ensure
    we are in compliance with the licenses of the code we use, including
dependencies. Having these headers in place helps that tool do its job.
    
    More information can be found on the SPDX site:
    
    - https://spdx.dev/learn/handling-license-info/
    
    Signed-off-by: Russell Bryant <rbryant@redhat.com>

commit 5a1cf1cb3b80759131c73f6a9dddebccac039dea
Author: Russell Bryant <rbryant@redhat.com>
Date:   Fri Jan 31 14:36:32 2025 -0500

    Check for SPDX headers using pre-commit
    
    Signed-off-by: Russell Bryant <rbryant@redhat.com>

---------

Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2025-02-02 11:58:18 -08:00
youkaichao c222f47992 [core][bugfix] configure env var during import vllm (#12209) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-01-20 19:35:59 +08:00
youkaichao 92e793d91a [core] LLM.collective_rpc interface and RLHF example (#12084) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-01-16 20:19:52 +08:00
Cyrus Leung eeec9e3390 [Frontend] Separate pooling APIs in offline inference (#11129) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2024-12-13 10:40:07 +00:00
Cyrus Leung d2f058e76c [Misc] Rename embedding classes to pooling (#10801) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2024-12-01 14:36:51 +08:00
Cyrus Leung 3b00b9c26c [Core] renamePromptInputs and inputs (#8876) 2024-09-26 20:35:15 -07:00
Simon Mo 4f1ba0844b Revert "rename PromptInputs and inputs with backward compatibility (#8760) (#8810) 2024-09-25 10:36:26 -07:00
Cyrus Leung 28e1299e60 rename PromptInputs and inputs with backward compatibility (#8760) 2024-09-25 09:36:47 -07:00
Simon Mo 3185fb0cca Revert "[Core] Rename PromptInputs to PromptType, and inputs to prompt" (#8750) 2024-09-24 05:45:20 +00:00
Danieleandyoukaichao ee5f34b1c2 [CI/Build] use setuptools-scm to set __version__ (#4738) 
Co-authored-by: youkaichao <youkaichao@126.com>
 2024-09-23 09:44:26 -07:00
Cyrus Leung 0057894ef7 [Core] Rename PromptInputs and inputs(#8673) 2024-09-20 19:00:54 -07:00
Cyrus LeungandRoger Wang 739b61a348 [Frontend] Refactor prompt processing (#4028) 
Co-authored-by: Roger Wang <ywang@roblox.com>
 2024-07-22 10:13:53 -07:00
Michael Goin 111fc6e7ec [Misc] Add generated git commit hash as vllm.__commit__ (#6386) 2024-07-12 22:52:15 +00:00
Cyrus Leung 03dccc886e [Misc] Add vLLM version getter to utils (#5098) 2024-06-13 11:21:39 -07:00
Simon Mo 114332b88e Bump version to v0.5.0 (#5384) 2024-06-10 15:56:06 -07:00
Simon Mo 87a658c812 Bump version to v0.4.3 (#5046) 2024-05-30 11:13:46 -07:00
Cyrus LeungandRoger Wang 5ae5ed1e60 [Core] Consolidate prompt arguments to LLM engines (#4328) 
Co-authored-by: Roger Wang <ywang@roblox.com>
 2024-05-28 13:29:31 -07:00
Chang Su e254497b66 [Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734) 2024-05-11 11:30:37 -07:00
Simon Mo 8d8357c8ed bump version to v0.4.2 (#4600) 2024-05-04 17:09:49 -07:00
Nick Hill 479d69fad0 [Core] Move ray_utils.py from engine to executor package (#4347) 2024-04-25 06:52:22 +00:00
Simon Mo 221d93ecbf Bump version of 0.4.1 (#4177) 2024-04-19 01:00:22 -07:00
youkaichao 95baec828f [Core] enable out-of-tree model register (#3871) 2024-04-06 17:11:41 -07:00
youkaichao a3c226e7eb [CI/Build] 0.4.0.post1, fix sm 7.0/7.5 binary (#3803) 2024-04-02 12:57:04 -07:00
Simon Mo 430530fc18 bump version to v0.4.0 (#3712) 2024-03-29 12:28:33 -07:00
youkaichao f342153b48 Revert "bump version to v0.4.0" (#3708) 2024-03-28 18:49:42 -07:00
Simon Mo 27a57cad52 bump version to v0.4.0 (#3705) 2024-03-28 18:26:51 -07:00
Zhuohan Li 4c922709b6 Add distributed model executor abstraction (#3191) 2024-03-11 11:03:45 -07:00
Woosuk Kwon 1cb0cc2975 [FIX] Make flash_attn optional (#3269) 2024-03-08 10:52:20 -08:00
Woosuk Kwon 2daf23ab0c Separate attention backends (#3005) 2024-03-07 01:45:50 -08:00
Woosuk Kwon 82091b864a Bump up to v0.3.3 (#3129) 2024-03-01 12:58:06 -08:00
Zhuohan Li 8fbd84bf78 Bump up version to v0.3.2 (#2968) 
This version is for more model support. Add support for Gemma models (#2964) and OLMo models (#2832).
 2024-02-21 11:47:25 -08:00
Woosuk Kwon 5f08050d8d Bump up to v0.3.1 (#2887) 2024-02-16 15:05:18 -08:00
Zhuohan Li 1af090b57d Bump up version to v0.3.0 (#2656) 2024-01-31 00:07:07 -08:00
Woosuk Kwon 2e0b6e7757 Bump up to v0.2.7 (#2337) 2024-01-03 17:35:56 -08:00
Woosuk Kwon 671af2b1c0 Bump up to v0.2.6 (#2157) 2023-12-17 10:34:56 -08:00
Woosuk Kwon 31c1f3255e Bump up to v0.2.5 (#2095) 2023-12-13 23:56:15 -08:00
Woosuk Kwon 4dd4b5c538 Bump up to v0.2.4 (#2034) 2023-12-11 11:49:39 -08:00
Woosuk Kwon 0f90effc66 Bump up to v0.2.3 (#1903) 2023-12-03 12:27:47 -08:00
Woosuk Kwon c5f7740d89 Bump up to v0.2.2 (#1689) 2023-11-18 21:57:07 -08:00
Zhuohan Li 651c614aa4 Bump up the version to v0.2.1 (#1355) 2023-10-16 12:58:57 -07:00
Woosuk Kwon e2fb71ec9f Bump up the version to v0.2.0 (#1212) 2023-09-28 15:30:38 -07:00
Woosuk Kwon 90eb3f43ca Bump up the version to v0.1.7 (#1013) 2023-09-11 00:54:30 -07:00
Zhuohan Li 1117aa1411 Bump up the version to v0.1.6 (#989) 2023-09-08 00:07:46 -07:00
Woosuk Kwon 852ef5b4f5 Bump up the version to v0.1.5 (#944) 2023-09-07 16:15:31 -07:00
Woosuk Kwon 791d79de32 Bump up the version to v0.1.4 (#846) 2023-08-25 12:28:00 +09:00
Zhuohan Li aa84c92ef6 Bump up version to 0.1.3 (#657) 2023-08-02 16:46:53 -07:00
Woosuk Kwon 1c395b4eaa Bump up the version (#300) 2023-07-04 21:41:53 -07:00
Zhuohan Li d6fa1be3a8 [Quality] Add code formatter and linter (#326) 2023-07-03 11:31:55 -07:00