ElizaWszola b35cc93420 Fix auto prefix bug (#3239)

2024-03-07 16:37:28 -08:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

block_manager.py

Fix auto prefix bug (#3239)

2024-03-07 16:37:28 -08:00

evictor.py

Add Automatic Prefix Caching (#2762)

2024-03-02 00:50:01 -08:00

policy.py

Add metrics to RequestOutput (#2876)

2024-02-20 21:55:57 -08:00

scheduler.py

Store eos_token_id in Sequence for easy access (#3166)

2024-03-05 15:35:43 -08:00