Antoni BaumandZhuohan Li 080438477f Start background task in AsyncLLMEngine.generate (#988) ...

Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

2023-09-08 00:03:39 -07:00

..

openai

Start background task in AsyncLLMEngine.generate (#988)

2023-09-08 00:03:39 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

Start background task in AsyncLLMEngine.generate (#988)

2023-09-08 00:03:39 -07:00

llm.py

Sort the outputs before return (#402)

2023-07-08 14:48:18 -07:00