Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC (Intel Neural Compressor) (#12010)

Signed-off-by: Nir David <ndavid@habana.ai>
Signed-off-by: Uri Livne <ulivne@habana.ai>
Co-authored-by: Uri Livne <ulivne@habana.ai>
This commit is contained in:
Nir David
2025-07-16 15:33:41 -04:00
committed by GitHub
co-authored by Uri Livne
parent ac2bf41e53
commit 01513a334a
11 changed files with 168 additions and 25 deletions
+1
View File
@@ -179,6 +179,7 @@ STR_DTYPE_TO_TORCH_DTYPE = {
"fp8_e4m3": torch.uint8,
"fp8_e5m2": torch.uint8,
"int8": torch.int8,
"fp8_inc": torch.float8_e4m3fn,
}
TORCH_DTYPE_TO_NUMPY_DTYPE = {