3 people 37ca558103 Optimize model execution with CUDA graph (#1926) ...

Co-authored-by: Chen Shen <scv119@gmail.com>
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>

2023-12-16 21:12:08 -08:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

async_llm_engine.py

Fix typing in AsyncLLMEngine & add toml to requirements-dev (#2100)

2023-12-14 00:19:41 -08:00

llm_engine.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

metrics.py

Add Production Metrics in Prometheus format (#1890)

2023-12-02 16:37:44 -08:00

ray_utils.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00