Woosuk Kwon bc0644574c Add gpu_memory_utilization and swap_space to LLM (#1090)

2023-09-19 22:16:04 -07:00

..

openai

Only fail if logit_bias has actual values (#1045)

2023-09-14 17:33:01 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

Start background task in AsyncLLMEngine.generate (#988)

2023-09-08 00:03:39 -07:00

llm.py

Add gpu_memory_utilization and swap_space to LLM (#1090)

2023-09-19 22:16:04 -07:00