Philipp Moritz ab7e6006d6 Fix https://github.com/vllm-project/vllm/issues/2540 (#2545)

2024-01-22 19:02:38 +01:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

Update Help Text for --gpu-memory-utilization Argument (#2183)

2023-12-18 11:33:24 -08:00

async_llm_engine.py

[Experimental] Prefix Caching Support (#1669)

2024-01-17 16:32:10 -08:00

llm_engine.py

Fix https://github.com/vllm-project/vllm/issues/2540 (#2545)

2024-01-22 19:02:38 +01:00

metrics.py

Add Production Metrics in Prometheus format (#1890)

2023-12-02 16:37:44 -08:00

ray_utils.py

[Speculative decoding 2/9] Multi-step worker for draft model (#2424)

2024-01-21 16:31:47 -08:00