[Spec Decode] Rename AR speculators to StandaloneAR / TargetDependentAR (#60335)

Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
This commit is contained in:
Giancarlo Delfin
2026-10-07 14:01:59 -04:00
committed by GitHub
parent fba462e008
commit 6ee9be6b3c
14 changed files with 42 additions and 36 deletions
+1 -1
View File
@@ -820,7 +820,7 @@ class GPUModelRunner(LoRAModelRunnerMixin):
"skip_attn must only be True for initial memory profiling."
)
# Create a dummy scheduler output. Plain draft-model speculation adds
# Create a dummy scheduler output. Standalone AR speculation adds
# one correction slot per request during prefill. The scheduler
# accounts for these slots, while dummy runs bypass the scheduler.
# Adjust the dummy token count only when the expanded draft batch