[Bugfix] Fix HYV3 shared_mlp prefix for compressed-tensors ignore matching (#48682)
Signed-off-by: Xiaoyi Xu <xu_xiaoyi@hotmail.com>
This commit is contained in:
@@ -167,7 +167,7 @@ class HYV3MoEFused(nn.Module):
|
||||
intermediate_size=config.expert_hidden_dim * config.num_shared_experts,
|
||||
hidden_act=config.hidden_act,
|
||||
quant_config=quant_config,
|
||||
prefix=f"{prefix}",
|
||||
prefix=f"{prefix}.shared_mlp",
|
||||
reduce_results=False,
|
||||
)
|
||||
else:
|
||||
|
||||
Reference in New Issue
Block a user