Chen Zhang c6b0a7d3ba [V1] Simplify prefix caching logic by removing num_evictable_computed_blocks (#11310)

2024-12-19 04:17:12 +00:00

..

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

encoder_cache_manager.py

[V1] Support VLMs with fine-grained scheduling (#9871)

2024-11-13 04:53:13 +00:00

kv_cache_manager.py

[V1] Simplify prefix caching logic by removing num_evictable_computed_blocks (#11310)

2024-12-19 04:17:12 +00:00

kv_cache_utils.py

[V1] VLM - enable processor cache by default (#11305)

2024-12-18 18:54:46 -05:00

scheduler.py

[V1] Prefix caching for vision language models (#11187)

2024-12-17 16:37:59 -08:00