[Bugfix][Core] Schedule encoder-only prompts larger than one step (#59029)

Signed-off-by: Giulio De Pasquale <git@depasquale.giugl.io>
Co-authored-by: Isotr0py <2037008807@qq.com>
This commit is contained in:
Giulio De Pasquale
2026-09-30 22:04:28 +08:00
committed by GitHub
co-authored by Isotr0py
parent 02a3c6dfc5
commit 2e52a558f0
3 changed files with 50 additions and 0 deletions
+1
View File
@@ -1115,6 +1115,7 @@ class Scheduler(SchedulerInterface):
if (
not self.scheduler_config.enable_chunked_prefill
and num_new_tokens > request_token_budget
and not self.is_mm_encoder_only
):
# If chunked_prefill is disabled,
# we can stop the scheduling here.