[KV Offload] Add on_schedule_end() hook to separate step lifecycle from event draining (#44206)

Signed-off-by: Ronen Schaffer <ronen.schaffer@ibm.com>
This commit is contained in:
Ronen Schaffer
2026-06-02 13:42:52 +03:00
committed by GitHub
parent 689b0eeb9e
commit 2a2b5ca791
5 changed files with 55 additions and 40 deletions
@@ -897,6 +897,7 @@ class OffloadingConnectorScheduler:
self, scheduler_output: SchedulerOutput
) -> KVConnectorMetadata:
self._update_req_states(scheduler_output)
self.manager.on_schedule_end()
# Flush jobs for preempted requests.
for req_id in scheduler_output.preempted_req_ids or ():