[Distributed] Support pre-shared ncclUniqueId rendezvous for weight transfer (#53784)

Signed-off-by: Dharak Kharod <dharak.kharod@cohere.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
dharak-cohere
2026-09-01 14:55:57 +08:00
committed by GitHub
co-authored by Cursor
parent fa99a6fea6
commit d0e695a91b
6 changed files with 674 additions and 10 deletions
@@ -51,6 +51,9 @@ class ncclUniqueId(ctypes.Structure):
_fields_ = [("internal", ctypes.c_byte * 128)]
NCCL_UNIQUE_ID_BYTES = ctypes.sizeof(ncclUniqueId)
# Mirror of NCCL's versioned ncclCommProperties_t (nccl_device/core.h,
# v2.31.2-1, 144 bytes). ncclCommQueryProperties fills fields gated by the
# version the caller declares in props.version, not by props.size, so never