[Model Bash][DeepSeekR1] Remove Shared Expert Clone (#34344)
Signed-off-by: Robert Shaw <robshaw@redhat.com> Co-authored-by: Robert Shaw <robshaw@redhat.com>
This commit is contained in:
co-authored by
Robert Shaw
parent
ee1d25f199
commit
4685a630a2
@@ -175,7 +175,7 @@ class MiniCPMMoE(nn.Module):
|
||||
)
|
||||
|
||||
final_hidden_states = fused_experts(
|
||||
hidden_states, self.ws, self.w2s, topk_weights, topk_ids, inplace=True
|
||||
hidden_states, self.ws, self.w2s, topk_weights, topk_ids, inplace=False
|
||||
)
|
||||
|
||||
if self.tp_size > 1:
|
||||
|
||||
Reference in New Issue
Block a user