[Elastic EP] Reduce eager-mode reconfiguration downtime (#51885)
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
This commit is contained in:
@@ -973,7 +973,7 @@ class ParallelConfig:
|
||||
|
||||
if self.enable_eplb and self.eplb_config.communicator is None:
|
||||
# Prefer NIXL when available: zero-copy RDMA reads, compatible
|
||||
# with both async EPLB and elastic EP (deferred remote setup).
|
||||
# with both async EPLB and elastic EP.
|
||||
# Fallbacks: pynccl for elastic EP (stateless groups need it),
|
||||
# torch_gloo for static EP. torch_nccl is avoided because NCCL
|
||||
# is incompatible with async EPLB (multi-stream conflicts) and
|
||||
|
||||
Reference in New Issue
Block a user