Woosuk Kwon 8041b7305e [BugFix] Raise error when max_model_len is larger than KV cache (#2163)

2023-12-17 17:08:23 -08:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

[Minor] Add more detailed explanation on quantization argument (#2145)

2023-12-17 01:56:16 -08:00

async_llm_engine.py

Fix typing in AsyncLLMEngine & add toml to requirements-dev (#2100)

2023-12-14 00:19:41 -08:00

llm_engine.py

[BugFix] Raise error when max_model_len is larger than KV cache (#2163)

2023-12-17 17:08:23 -08:00

metrics.py

Add Production Metrics in Prometheus format (#1890)

2023-12-02 16:37:44 -08:00

ray_utils.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00