[Quantization][Deprecation] Remove BitBlas (#32683)

Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
This commit is contained in:
Robert Shaw
2026-01-28 11:06:22 +00:00
committed by GitHub
co-authored by Robert Shaw
parent ecb4f82209
commit 247d1a32ea
15 changed files with 2 additions and 2030 deletions
@@ -98,7 +98,7 @@ class GPTQConfig(QuantizationConfig):
if self.weight_bits == 4:
logger.warning_once(
"Currently, the 4-bit gptq_gemm kernel for GPTQ is buggy. "
"Please switch to gptq_marlin or gptq_bitblas."
"Please switch to gptq_marlin."
)
self.modules_in_block_to_quantize = modules_in_block_to_quantize or []