[DSV4] Better MXFP8 quantization kernel (#47229)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
This commit is contained in:
@@ -184,6 +184,7 @@ def _mxfp8_e4m3_quantize_impl(
|
||||
x,
|
||||
is_sf_swizzled_layout=is_sf_swizzled_layout,
|
||||
alignment=alignment if alignment > 0 else 32,
|
||||
backend="cute-dsl",
|
||||
)
|
||||
if x_scales.ndim == 1 and x.ndim == 2 and not is_sf_swizzled_layout:
|
||||
x_scales = x_scales.view(x.size(0), -1)
|
||||
|
||||
Reference in New Issue
Block a user