Toshiki Kataoka 06b2550cbb [Bugfix] Support prompt_logprobs==0 (#5217)

2024-06-03 17:59:30 -07:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[Bugfix] Fix call to init_logger in openai server (#4765)

2024-06-01 17:18:50 +00:00

cli_args.py

[Bugfix] Fix inappropriate content of model_name tag in Prometheus metrics (#3937)

2024-05-04 15:39:34 -07:00

protocol.py

[FRONTEND] OpenAI tools support named functions (#5032)

2024-06-03 18:25:29 -05:00

run_batch.py

[Frontend] Separate OpenAI Batch Runner usage from API Server (#4851)

2024-05-17 00:42:41 +09:00

serving_chat.py

[FRONTEND] OpenAI tools support named functions (#5032)

2024-06-03 18:25:29 -05:00

serving_completion.py

[Bugfix] Support prompt_logprobs==0 (#5217)

2024-06-03 17:59:30 -07:00

serving_embedding.py

[Core] Consolidate prompt arguments to LLM engines (#4328)

2024-05-28 13:29:31 -07:00

serving_engine.py

[Frontend][OpenAI] Support for returning max_model_len on /v1/models response (#4643)

2024-06-02 08:06:13 +00:00