Commit Graph
45 Commits
Author SHA1 Message Date
Cyrus Leung 3b00b9c26c [Core] renamePromptInputs and inputs (#8876) 2024-09-26 20:35:15 -07:00
Simon Mo 4f1ba0844b Revert "rename PromptInputs and inputs with backward compatibility (#8760) (#8810) 2024-09-25 10:36:26 -07:00
Cyrus Leung 28e1299e60 rename PromptInputs and inputs with backward compatibility (#8760) 2024-09-25 09:36:47 -07:00
Simon Mo 3185fb0cca Revert "[Core] Rename PromptInputs to PromptType, and inputs to prompt" (#8750) 2024-09-24 05:45:20 +00:00
Danieleandyoukaichao ee5f34b1c2 [CI/Build] use setuptools-scm to set __version__ (#4738)
Co-authored-by: youkaichao <youkaichao@126.com>
2024-09-23 09:44:26 -07:00
Cyrus Leung 0057894ef7 [Core] Rename PromptInputs and inputs(#8673) 2024-09-20 19:00:54 -07:00
Cyrus LeungandRoger Wang 739b61a348 [Frontend] Refactor prompt processing (#4028)
Co-authored-by: Roger Wang <ywang@roblox.com>
2024-07-22 10:13:53 -07:00
Michael Goin 111fc6e7ec [Misc] Add generated git commit hash as vllm.__commit__ (#6386) 2024-07-12 22:52:15 +00:00
Cyrus Leung 03dccc886e [Misc] Add vLLM version getter to utils (#5098) 2024-06-13 11:21:39 -07:00
Simon Mo 114332b88e Bump version to v0.5.0 (#5384) 2024-06-10 15:56:06 -07:00
Simon Mo 87a658c812 Bump version to v0.4.3 (#5046) 2024-05-30 11:13:46 -07:00
Cyrus LeungandRoger Wang 5ae5ed1e60 [Core] Consolidate prompt arguments to LLM engines (#4328)
Co-authored-by: Roger Wang <ywang@roblox.com>
2024-05-28 13:29:31 -07:00
Chang Su e254497b66 [Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734) 2024-05-11 11:30:37 -07:00
Simon Mo 8d8357c8ed bump version to v0.4.2 (#4600) 2024-05-04 17:09:49 -07:00
Nick Hill 479d69fad0 [Core] Move ray_utils.py from engine to executor package (#4347) 2024-04-25 06:52:22 +00:00
Simon Mo 221d93ecbf Bump version of 0.4.1 (#4177) 2024-04-19 01:00:22 -07:00
youkaichao 95baec828f [Core] enable out-of-tree model register (#3871) 2024-04-06 17:11:41 -07:00
youkaichao a3c226e7eb [CI/Build] 0.4.0.post1, fix sm 7.0/7.5 binary (#3803) 2024-04-02 12:57:04 -07:00
Simon Mo 430530fc18 bump version to v0.4.0 (#3712) 2024-03-29 12:28:33 -07:00
youkaichao f342153b48 Revert "bump version to v0.4.0" (#3708) 2024-03-28 18:49:42 -07:00
Simon Mo 27a57cad52 bump version to v0.4.0 (#3705) 2024-03-28 18:26:51 -07:00
Zhuohan Li 4c922709b6 Add distributed model executor abstraction (#3191) 2024-03-11 11:03:45 -07:00
Woosuk Kwon 1cb0cc2975 [FIX] Make flash_attn optional (#3269) 2024-03-08 10:52:20 -08:00
Woosuk Kwon 2daf23ab0c Separate attention backends (#3005) 2024-03-07 01:45:50 -08:00
Woosuk Kwon 82091b864a Bump up to v0.3.3 (#3129) 2024-03-01 12:58:06 -08:00
Zhuohan Li 8fbd84bf78 Bump up version to v0.3.2 (#2968)
This version is for more model support. Add support for Gemma models (#2964) and OLMo models (#2832).
2024-02-21 11:47:25 -08:00
Woosuk Kwon 5f08050d8d Bump up to v0.3.1 (#2887) 2024-02-16 15:05:18 -08:00
Zhuohan Li 1af090b57d Bump up version to v0.3.0 (#2656) 2024-01-31 00:07:07 -08:00
Woosuk Kwon 2e0b6e7757 Bump up to v0.2.7 (#2337) 2024-01-03 17:35:56 -08:00
Woosuk Kwon 671af2b1c0 Bump up to v0.2.6 (#2157) 2023-12-17 10:34:56 -08:00
Woosuk Kwon 31c1f3255e Bump up to v0.2.5 (#2095) 2023-12-13 23:56:15 -08:00
Woosuk Kwon 4dd4b5c538 Bump up to v0.2.4 (#2034) 2023-12-11 11:49:39 -08:00
Woosuk Kwon 0f90effc66 Bump up to v0.2.3 (#1903) 2023-12-03 12:27:47 -08:00
Woosuk Kwon c5f7740d89 Bump up to v0.2.2 (#1689) 2023-11-18 21:57:07 -08:00
Zhuohan Li 651c614aa4 Bump up the version to v0.2.1 (#1355) 2023-10-16 12:58:57 -07:00
Woosuk Kwon e2fb71ec9f Bump up the version to v0.2.0 (#1212) 2023-09-28 15:30:38 -07:00
Woosuk Kwon 90eb3f43ca Bump up the version to v0.1.7 (#1013) 2023-09-11 00:54:30 -07:00
Zhuohan Li 1117aa1411 Bump up the version to v0.1.6 (#989) 2023-09-08 00:07:46 -07:00
Woosuk Kwon 852ef5b4f5 Bump up the version to v0.1.5 (#944) 2023-09-07 16:15:31 -07:00
Woosuk Kwon 791d79de32 Bump up the version to v0.1.4 (#846) 2023-08-25 12:28:00 +09:00
Zhuohan Li aa84c92ef6 Bump up version to 0.1.3 (#657) 2023-08-02 16:46:53 -07:00
Woosuk Kwon 1c395b4eaa Bump up the version (#300) 2023-07-04 21:41:53 -07:00
Zhuohan Li d6fa1be3a8 [Quality] Add code formatter and linter (#326) 2023-07-03 11:31:55 -07:00
Zhuohan Li 83658c8ace Bump up version to 0.1.1 (#204) 2023-06-22 15:33:32 +08:00
Woosuk Kwon 0b98ba15c7 Change the name to vLLM (#150) 2023-06-17 03:07:40 -07:00