[BugFix] Stop dummy runs from writing mamba state through stale block-table rows (#49757)

Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Jeff Ma <jeffjma@umich.edu>
Co-authored-by: Jeff Ma <jeffjma@umich.edu>
This commit is contained in:
Nick Hill
2026-07-29 01:09:41 +00:00
committed by GitHub
co-authored by Jeff Ma
parent 56f31af62a
commit 6fbbcf2151
5 changed files with 86 additions and 2 deletions
+4
View File
@@ -1290,6 +1290,10 @@ class GPUModelRunner(LoRAModelRunnerMixin):
slot_mappings,
self.attn_groups,
self.kv_cache_config,
# FULL replay reads capture-time metadata buffers. Re-stage them
# from the zeroed dummy block tables instead of retaining state
# indices from the previous real batch.
for_capture=dummy_run and batch_desc.cg_mode == CUDAGraphMode.FULL,
)
input_ids = input_batch.input_ids