[Bugfix][ROCm] Fix a few int4/int8 quantization errors (#52112)

Signed-off-by: Qiang Li <qiang.li2@amd.com>
This commit is contained in:
qli88
2026-08-18 08:31:51 +00:00
committed by GitHub
parent 5c9ff5366b
commit e8ad2855e7
4 changed files with 69 additions and 7 deletions
@@ -222,7 +222,6 @@ class MoeWNA16Method(FusedMoEMethodBase):
else:
scale = kInt4StaticGroupScale
elif num_bits == 8:
assert group_size == -1
quant_type = INT8_DTYPE
scale = kInt8StaticGroupScale
else: