Simon Mo 3a7dd7e367 Support Batch Completion in Server (#2529)

2024-01-24 17:11:07 -08:00

..

openai

Support Batch Completion in Server (#2529)

2024-01-24 17:11:07 -08:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[Experimental] Prefix Caching Support (#1669)

2024-01-17 16:32:10 -08:00

llm.py

[Experimental] Add multi-LoRA support (#1804)

2024-01-23 15:26:37 -08:00