Toby Mao b28c3e1568 [BugFix] Retain both replay boundaries so an EAGLE resend of a block-aligned prompt still hits (#54713) ...

Signed-off-by: tobymao <toby.mao@gmail.com>

2026-09-10 16:39:24 +08:00

..

sched

[Core][Model] Unify XD-RoPE into M-RoPE and derive the channel count (#56078)

2026-09-09 09:23:30 -07:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_pool.py

[Kimi K3] Support internal prefix checkpoints with partial prefix caching and spec-decoding (#53614)

2026-09-06 13:18:15 +08:00

encoder_cache_manager.py

[Bugfix][V1] Keep an encoder cache entry until its last occurrence is freed (#54284)

2026-08-29 05:08:01 +00:00

kv_cache_coordinator.py

[BugFix] Retain both replay boundaries so an EAGLE resend of a block-aligned prompt still hits (#54713)

2026-09-10 16:39:24 +08:00

kv_cache_manager.py

[Bugfix][Spec Decode] Cache the Mamba state at the block-grid position of EAGLE resume (#53945)

2026-09-08 09:59:58 -04:00

kv_cache_metrics.py

[Core][Observability] Add KV cache residency metrics (#27793)

2025-12-01 18:27:53 +00:00

kv_cache_utils.py

[Core] Let SWA layers take the primary block size to avoid inflating the KV block LCM (#53007)

2026-09-08 16:44:43 -04:00

single_type_kv_cache_manager.py

[BugFix] Retain both replay boundaries so an EAGLE resend of a block-aligned prompt still hits (#54713)

2026-09-10 16:39:24 +08:00