Hanzhi Zhou 31bff69151 Make _prepare_sample non-blocking and use pinned memory for input buffers (#2207)

2023-12-19 16:52:46 -08:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

cache_engine.py

[Build] Avoid building too many extensions (#1624)

2023-11-23 16:31:19 -08:00

model_runner.py

Make _prepare_sample non-blocking and use pinned memory for input buffers (#2207)

2023-12-19 16:52:46 -08:00

worker.py

Remove dependency on CuPy (#2152)

2023-12-17 01:49:07 -08:00