[MoE Refactor] Rename FusedMoE to FusedMoEFactory (#44941)
Signed-off-by: Bill Nell <bnell@redhat.com> Signed-off-by: bnellnm <49004751+bnellnm@users.noreply.github.com> Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
This commit is contained in:
@@ -108,7 +108,7 @@ def _extract_data_from_fused_moe_module(
|
||||
m_: torch.nn.Module,
|
||||
) -> tuple[torch.Tensor, torch.Tensor, torch.Tensor, torch.Tensor, int]:
|
||||
"""
|
||||
Extract weights, weight scales and num_topk from FusedMoE module.
|
||||
Extract weights, weight scales and num_topk from MoERunner module.
|
||||
"""
|
||||
assert isinstance(m_, MoERunner)
|
||||
m = m_.routed_experts
|
||||
|
||||
Reference in New Issue
Block a user