[Bugfix][V1] Clean up compiled-model bytecode hooks on VllmRunner exit (#45195)

Signed-off-by: Ting Sun <suntcrick@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
This commit is contained in:
Ting SUN
2026-06-16 20:31:17 -07:00
committed by GitHub
co-authored by mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
parent 14b438a98b
commit 7b5d60cc37
4 changed files with 61 additions and 2 deletions
+1
View File
@@ -1294,6 +1294,7 @@ class VllmRunner:
# Ignore shutdown errors as cleanup will still proceed
pass
del self.llm
torch._dynamo.reset()
cleanup_dist_env_and_memory()
self._wait_for_rocm_memory_release(gpu_memory_utilization)