[Core] Release NCCL communicator memory in sleep mode (#51485)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com> Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com> Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
co-authored by
aoshen02
Claude Fable 5
parent
ec32f669bb
commit
4ac452ad98
@@ -134,8 +134,7 @@ class CuMemBackend(SleepModeBackend):
|
||||
|
||||
@classmethod
|
||||
def preserves_communicators(cls) -> bool:
|
||||
# Communicator buffers (e.g. NCCL) live outside CuMemAllocator's pool, so
|
||||
# an allocator-level sleep leaves them intact (no reinit needed on resume).
|
||||
# Comm identity/topology survive memory suspension; no reinit needed.
|
||||
return True
|
||||
|
||||
|
||||
|
||||
Reference in New Issue
Block a user