3 people 7cb9a88f50 [Bugfix][Mooncake] Offload producer partial tails on request finish (#52832) ...

Signed-off-by: Dao Le <Dao007forever@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: OpenAI Codex <noreply@openai.com>

2026-09-01 13:23:35 -07:00

..

sched

[Bugfix][Mooncake] Offload producer partial tails on request finish (#52832)

2026-09-01 13:23:35 -07:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_pool.py

[Bugfix][Mooncake] Save exact Mamba boundary states (#51358)

2026-08-29 02:40:53 +00:00

encoder_cache_manager.py

[Bugfix][V1] Keep an encoder cache entry until its last occurrence is freed (#54284)

2026-08-29 05:08:01 +00:00

kv_cache_coordinator.py

[ROCm][DSpark][DCP] Serve prefix cache hits under DCP for Kimi-K3 (#53598)

2026-08-31 11:18:10 -07:00

kv_cache_manager.py

[Bugfix][Mooncake] Offload producer partial tails on request finish (#52832)

2026-09-01 13:23:35 -07:00

kv_cache_metrics.py

[Core][Observability] Add KV cache residency metrics (#27793)

2025-12-01 18:27:53 +00:00

kv_cache_utils.py

[Feature][Spec] Support disabling trailing prefix-cache block dropping (#53388)

2026-09-01 19:12:36 +08:00

single_type_kv_cache_manager.py

[Bugfix][Mooncake] Offload producer partial tails on request finish (#52832)

2026-09-01 13:23:35 -07:00