Cyrus Leung f12b20decc [Frontend] Move async logic outside of constructor (#4674)

2024-05-08 22:48:33 -07:00

..

openai

[Frontend] Move async logic outside of constructor (#4674)

2024-05-08 22:48:33 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[Frontend] Add --log-level option to api server (#4377)

2024-04-26 05:36:01 +00:00

llm.py

[Frontend] add tok/s speed metric to llm class when using tqdm (#4400)

2024-05-08 22:02:31 -07:00