Sherif Waly 25385102fe [Bugfix][KV Offload] Honor speculative cacheability in SimpleCPU (#60071) ...

Signed-off-by: Sherif Waly <sherif.waly@mistral.ai>

2026-10-06 14:25:08 +02:00

..

sched

[Bugfix][Core] Drop stale block hashes when a session truncates tokens (#59103)

2026-10-06 02:51:03 +00:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_pool.py

Fix grammar in BlockPool.reset_prefix_cache docstring: "to invalid" → "to invalidate" (#59886)

2026-10-06 10:19:54 +00:00

encoder_cache_manager.py

[Bugfix][V1] Reject encoder-cache hits with mismatched embedding counts (#57696)

2026-09-24 08:40:47 +00:00

kv_cache_coordinator.py

[Bugfix][KV Offload] Honor speculative cacheability in SimpleCPU (#60071)

2026-10-06 14:25:08 +02:00

kv_cache_manager.py

[Bugfix][Core] Exempt exactly the blocks an async KV load writes from zeroing (#59504)

2026-10-03 06:26:12 +00:00

kv_cache_metrics.py

[Core][Observability] Add KV cache residency metrics (#27793)

2025-12-01 18:27:53 +00:00

kv_cache_utils.py

[Bugfix][HiSparse] Size the KV cache from the groups HiSparse allocates (#59450)

2026-10-02 04:11:55 +00:00

single_type_kv_cache_manager.py

[Bugfix][Core] Retire stale Mamba spec blocks in prefill checkpoint steps (#59759)

2026-10-06 11:01:19 +08:00