Thomas Parnell 1d7c940d74 Add option to completion API to truncate prompt tokens (#3144)

2024-04-05 10:15:42 -07:00

..

openai

Add option to completion API to truncate prompt tokens (#3144)

2024-04-05 10:15:42 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

Usage Stats Collection (#2852)

2024-03-28 22:16:12 -07:00

llm.py

Usage Stats Collection (#2852)

2024-03-28 22:16:12 -07:00