bofeng huang 0150a10630 [Frontend] OpenAI API server: Do not add bos token by default when encoding (#4688)

2024-05-16 18:47:22 -07:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[Bugfix] Bypass authorization API token for preflight requests (#4862)

2024-05-16 09:42:21 -07:00

cli_args.py

[Bugfix] Fix inappropriate content of model_name tag in Prometheus metrics (#3937)

2024-05-04 15:39:34 -07:00

protocol.py

[Frontend] Support OpenAI batch file format (#4794)

2024-05-15 19:13:36 -04:00

run_batch.py

[Frontend] Separate OpenAI Batch Runner usage from API Server (#4851)

2024-05-17 00:42:41 +09:00

serving_chat.py

[Frontend] OpenAI API server: Do not add bos token by default when encoding (#4688)

2024-05-16 18:47:22 -07:00

serving_completion.py

[Frontend] Move async logic outside of constructor (#4674)

2024-05-08 22:48:33 -07:00

serving_embedding.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)

2024-05-11 11:30:37 -07:00

serving_engine.py

[Frontend] OpenAI API server: Do not add bos token by default when encoding (#4688)

2024-05-16 18:47:22 -07:00