[Bugfix][Humming] Preserve ModelOpt FP8 weight dimensions (#51093)

Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
This commit is contained in:
Netanel Haber
2026-08-05 14:08:55 -07:00
committed by GitHub
parent e76b71f659
commit 482c613423
2 changed files with 25 additions and 0 deletions
@@ -519,6 +519,8 @@ class ModelOptFp8LinearMethod(LinearMethodBase):
layer.weight, layer.weight_scale, layer.logical_widths
)
layer.weight = Parameter(weight.t(), requires_grad=False)
layer.weight.input_dim = 0
layer.weight.output_dim = 1
layer.weight_scale = Parameter(max_w_scale, requires_grad=False)
layer.input_scale = Parameter(layer.input_scale.max(), requires_grad=False)
self.fp8_linear.process_weights_after_loading(layer)