Woosuk Kwon f936657eb6 Provide default max model length (#1224)

2023-09-28 14:44:02 -07:00

..

openai

Provide default max model length (#1224)

2023-09-28 14:44:02 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

clean api code, remove redundant background task. (#1102)

2023-09-21 13:25:05 -07:00

llm.py

Add gpu_memory_utilization and swap_space to LLM (#1090)

2023-09-19 22:16:04 -07:00