Taksh Kothari 12b005eefa [Bugfix] Don't split a multimodal item that a prefill chunk starts exactly on (#52412) ...

Signed-off-by: Taksh <takshkothari09@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>

2026-10-13 15:32:38 +00:00

..

sched

[Bugfix] Don't split a multimodal item that a prefill chunk starts exactly on (#52412)

2026-10-13 15:32:38 +00:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_pool.py

[Bugfix][Prefix caching] Fix inconsistent hybrid Mamba prefix cache boundaries (#60533)

2026-10-08 18:33:48 +00:00

encoder_cache_manager.py

[Bugfix][V1] Reject encoder-cache hits with mismatched embedding counts (#57696)

2026-09-24 08:40:47 +00:00

kv_cache_coordinator.py

[Attention] Remove cascade attention (#61126)

2026-10-12 10:41:07 -07:00

kv_cache_manager.py

[Attention] Remove cascade attention (#61126)

2026-10-12 10:41:07 -07:00

kv_cache_metrics.py

[Core][Observability] Add KV cache residency metrics (#27793)

2025-12-01 18:27:53 +00:00

kv_cache_planning.py

[Core][Refactor] Move KV cache planning logic to kv_cache_planning.py (#61183)

2026-10-13 03:05:39 +00:00

kv_cache_utils.py

[Core][Refactor] Move KV cache planning logic to kv_cache_planning.py (#61183)

2026-10-13 03:05:39 +00:00

single_type_kv_cache_manager.py

[Core][Mamba] Remove leftovers of mamba_cache_mode="all" (#60043)

2026-10-13 00:58:59 -07:00