Iskren Ivov Chernev d0215a58e7 Ensure metrics are logged regardless of requests (#2347)

2024-01-05 05:24:42 -08:00

..

openai

Ensure metrics are logged regardless of requests (#2347)

2024-01-05 05:24:42 -08:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

Remove unused const TIMEOUT_TO_PREVENT_DEADLOCK (#2321)

2024-01-03 15:49:07 -08:00

llm.py

[Minor] Add more detailed explanation on quantization argument (#2145)

2023-12-17 01:56:16 -08:00