[Bugfix][Mamba] Restore prompt-tail prefix-cache hits with MTP (#58368)

Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
This commit is contained in:
Netanel Haber
2026-09-24 23:46:42 +00:00
committed by GitHub
co-authored by Claude Opus 5.5 Benjamin Chislett
parent 4f72bd0152
commit d5051abaf1
2 changed files with 23 additions and 1 deletions
+1 -1
View File
@@ -2078,7 +2078,7 @@ class MambaManager(SingleTypeKVCacheManager):
latest_prompt_hash_boundary = (
request.num_prompt_tokens // hash_block_size
) * hash_block_size
if self.use_eagle:
if self.drop_eagle_checkpoint_block:
# Eagle groups match one hash unit past the candidate and drop it,
# so register the tail one unit lower.
latest_prompt_hash_boundary = max(