[Feature] Add native ModelExpress weight transfer backend (#58399)
Signed-off-by: Hyunjae Woo <hwoo@nvidia.com> Co-authored-by: aoshen02 <aoshen@inferact.ai>
This commit is contained in:
@@ -250,6 +250,13 @@ WeightTransferEngineFactory.register_engine(
|
||||
)
|
||||
|
||||
|
||||
WeightTransferEngineFactory.register_engine(
|
||||
"modelexpress",
|
||||
"vllm.distributed.weight_transfer.modelexpress_engine",
|
||||
"ModelExpressWeightTransferEngine",
|
||||
)
|
||||
|
||||
|
||||
# Trainer-side engines, parallel to the worker registry above.
|
||||
WeightTransferTrainerFactory.register_engine(
|
||||
"nccl",
|
||||
|
||||
Reference in New Issue
Block a user