Simon Mo 3a7dd7e367 Support Batch Completion in Server (#2529)

2024-01-24 17:11:07 -08:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[Feature] Simple API token authentication and pluggable middlewares (#1106)

2024-01-23 15:13:00 -08:00

protocol.py

Added include_stop_str_in_output and length_penalty parameters to OpenAI API (#2562)

2024-01-24 10:21:56 -08:00

serving_chat.py

migrate pydantic from v1 to v2 (#2531)

2024-01-21 16:05:56 -08:00

serving_completion.py

Support Batch Completion in Server (#2529)

2024-01-24 17:11:07 -08:00

serving_engine.py

refactor complemention api for readability (#2499)

2024-01-18 16:45:14 -08:00