[Bugfix][Model] Kimi-K3 MegaMoE: pass situ_beta/situ_linear_beta to fp8_fp4_mega_moe (#52445)
Signed-off-by: UranusSeven <109661872+UranusSeven@users.noreply.github.com> Co-authored-by: Claude <noreply@anthropic.com>
This commit is contained in:
@@ -486,8 +486,8 @@ class KimiK3MegaMoEExperts(DeepseekV4MegaMoEExperts):
|
||||
symm_buffer,
|
||||
activation_clamp=activation_clamp,
|
||||
activation=self.activation,
|
||||
activation_beta=self.activation_beta,
|
||||
activation_linear_beta=self.activation_linear_beta,
|
||||
situ_beta=self.activation_beta,
|
||||
situ_linear_beta=self.activation_linear_beta,
|
||||
fast_math=fast_math,
|
||||
)
|
||||
return y
|
||||
|
||||
Reference in New Issue
Block a user