Zhuohan Li 1d24ccb96c [Fix] Better error message when there is OOM during cache initialization (#203)

2023-06-22 15:30:06 +08:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

Reduce GPU memory utilization to make sure OOM doesn't happen (#153)

2023-06-18 17:33:50 +08:00

async_llm_engine.py

[Bugfix] Fix a bug in RequestOutput.finished (#202)

2023-06-22 00:17:24 -07:00

llm_engine.py

[Fix] Better error message when there is OOM during cache initialization (#203)

2023-06-22 15:30:06 +08:00

ray_utils.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

tokenizer_utils.py

Use slow tokenizer for open llama models (#168)

2023-06-20 14:19:47 +08:00