[kv_offload][BugFix] Fix store deferral (#41945)

Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
This commit is contained in:
Martin Hickey
2026-05-12 18:04:44 +03:00
committed by GitHub
parent 5a6a9fc6f6
commit 418ba8ef14
2 changed files with 10 additions and 6 deletions
@@ -459,9 +459,6 @@ class RequestRunner:
self.worker_connector.bind_connector_metadata(kv_connector_metadata)
self.worker_connector.start_load_kv(self._dummy_ctx)
if scheduler_output.total_num_scheduled_tokens > 0:
self.worker_connector.wait_for_save()
if complete_transfers:
self.offloading_spec.complete_transfers()