3 people d765cf01fe [Core][Multimodal] Track encode cache entries by mm_hash and enable embedding sharing between requests (#22711) ...

Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

2025-08-25 00:41:17 -07:00

..

sched

[Core][Multimodal] Track encode cache entries by mm_hash and enable embedding sharing between requests (#22711)

2025-08-25 00:41:17 -07:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_pool.py

[BugFix] Fix stuck stats/metrics after requests are aborted (#22995)

2025-08-20 13:50:29 +08:00

encoder_cache_manager.py

[Core][Multimodal] Track encode cache entries by mm_hash and enable embedding sharing between requests (#22711)

2025-08-25 00:41:17 -07:00

kv_cache_coordinator.py

[v1] Move block_hashes from KVCacheManager to Request.block_hashes (#19728)

2025-08-15 16:52:52 -07:00

kv_cache_manager.py

[Optimization] Make new_block_ids None if empty (#23262)

2025-08-20 18:25:56 -07:00

kv_cache_utils.py

[v1] Move block_hashes from KVCacheManager to Request.block_hashes (#19728)

2025-08-15 16:52:52 -07:00

single_type_kv_cache_manager.py

[v1] Move block_hashes from KVCacheManager to Request.block_hashes (#19728)

2025-08-15 16:52:52 -07:00