Signed-off-by: SandishKumarHN <3078999+SandishKumarHN@users.noreply.github.com> Co-authored-by: SandishKumarHN <3078999+SandishKumarHN@users.noreply.github.com>
This commit is contained in:
co-authored by
SandishKumarHN
parent
2b94d1c0ca
commit
977703aa94
@@ -584,10 +584,6 @@ def rearrange_expert_weights_inplace(
|
||||
# have the same shape.
|
||||
weights_buffer = [torch.empty_like(w) for w in first_layer_weights]
|
||||
|
||||
# NOTE(bowen): We need this synchronize to run, but I don't know why.
|
||||
# If you figure out the reason, please let me know -- thank you!
|
||||
torch.accelerator.synchronize()
|
||||
|
||||
old_global_expert_indices_cpu = old_global_expert_indices.cpu().numpy()
|
||||
new_global_expert_indices_cpu = new_global_expert_indices.cpu().numpy()
|
||||
|
||||
|
||||
Reference in New Issue
Block a user