Nadav ShmayovitsandWoosuk Kwon 05921a9a7a Changed scheduler to use deques instead of lists (#2290) ...

Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

2024-01-07 09:48:07 -08:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

Update Help Text for --gpu-memory-utilization Argument (#2183)

2023-12-18 11:33:24 -08:00

async_llm_engine.py

Ensure metrics are logged regardless of requests (#2347)

2024-01-05 05:24:42 -08:00

llm_engine.py

Changed scheduler to use deques instead of lists (#2290)

2024-01-07 09:48:07 -08:00

metrics.py

Add Production Metrics in Prometheus format (#1890)

2023-12-02 16:37:44 -08:00

ray_utils.py

Miner fix of type hint (#2340)

2024-01-03 21:27:56 -08:00