[Bugfix] Fix W4A8_FP8 MoE tp>1 correctness and view() TypeError (#40310)

Signed-off-by: EdalatiAli <aliedalati@cohere.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
This commit is contained in:
EdalatiAli
2026-04-21 21:58:33 -04:00
committed by GitHub
co-authored by gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
parent f90aa44662
commit f946659fff
2 changed files with 5 additions and 1 deletions
@@ -818,7 +818,7 @@ def convert_bf16_scales_to_fp8(
# restore original shape
fp8_scales = fp8_scales.view(orig_shape)
chan_scales = chan_scales.view(orig_shape[:-1], -1)
chan_scales = chan_scales.view(*orig_shape[:-1], -1)
return fp8_scales, chan_scales