[Hardware][Power] Enable W4A16 (AWQ & GPTQ) quantization on POWER10 using VSX (#59149)
Signed-off-by: Rukhaiya <bibirukhaiya123@gmail.com> Co-authored-by: Li, Jiang <jiang1.li@intel.com>
This commit is contained in:
co-authored by
Li, Jiang <jiang1.li@intel.com>
parent
863475eb9c
commit
72e7874fa6
@@ -213,5 +213,10 @@ def _get_isa_hint(dtype: torch.dtype) -> str:
|
||||
return "amx"
|
||||
elif current_platform.get_cpu_architecture() == CpuArchEnum.RISCV:
|
||||
return "rvv"
|
||||
elif (
|
||||
dtype == torch.bfloat16
|
||||
and current_platform.get_cpu_architecture() == CpuArchEnum.POWERPC
|
||||
):
|
||||
return "vsx"
|
||||
else:
|
||||
return "vec"
|
||||
|
||||
Reference in New Issue
Block a user