Nick Hill 8999ec3c16 Store eos_token_id in Sequence for easy access (#3166)

2024-03-05 15:35:43 -08:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

block_manager.py

[FIX] Fix styles in automatic prefix caching & add a automatic prefix caching benchmark (#3158)

2024-03-03 14:37:18 -08:00

evictor.py

Add Automatic Prefix Caching (#2762)

2024-03-02 00:50:01 -08:00

policy.py

Add metrics to RequestOutput (#2876)

2024-02-20 21:55:57 -08:00

scheduler.py

Store eos_token_id in Sequence for easy access (#3166)

2024-03-05 15:35:43 -08:00