Wen Sun bbbf86565f Align max_tokens behavior with openai (#852)

2023-09-23 18:10:13 -07:00

..

openai

Align max_tokens behavior with openai (#852)

2023-09-23 18:10:13 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

clean api code, remove redundant background task. (#1102)

2023-09-21 13:25:05 -07:00

llm.py

Add gpu_memory_utilization and swap_space to LLM (#1090)

2023-09-19 22:16:04 -07:00