[Core] Release NCCL communicator memory in sleep mode (#51485)

Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
aoshen02
2026-09-01 14:31:16 +08:00
committed by GitHub
co-authored by aoshen02 Claude Fable 5
parent ec32f669bb
commit 4ac452ad98
12 changed files with 182 additions and 6 deletions
+1 -2
View File
@@ -134,8 +134,7 @@ class CuMemBackend(SleepModeBackend):
@classmethod
def preserves_communicators(cls) -> bool:
# Communicator buffers (e.g. NCCL) live outside CuMemAllocator's pool, so
# an allocator-level sleep leaves them intact (no reinit needed on resume).
# Comm identity/topology survive memory suspension; no reinit needed.
return True