[CompressedTensors] FP4 Qutlass Integration (#43229)

Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
Signed-off-by: Brian Dellabetta <bdellabe@redhat.com>
Signed-off-by: Brian Dellabetta <brian-dellabetta@users.noreply.github.com>
Co-authored-by: Brian Dellabetta <bdellabe@redhat.com>
Co-authored-by: Brian Dellabetta <brian-dellabetta@users.noreply.github.com>
Co-authored-by: Dipika Sikka <dipikasikka1@gmail.com>
This commit is contained in:
Kyle Sayers
2026-07-28 20:34:20 -06:00
committed by GitHub
co-authored by Brian Dellabetta Brian Dellabetta Dipika Sikka
parent 7398a30d79
commit 30c2718eaa
7 changed files with 169 additions and 34 deletions
+1
View File
@@ -50,6 +50,7 @@ WEIGHT_LOADER_V2_SUPPORTED = [
"UnquantizedLinearMethod",
"CompressedTensorsLinearMethod",
"CompressedTensorsLinearTransformMethod",
"QutlassNvFP4LinearMethod",
"AutoAWQMarlinLinearMethod",
"AutoAWQLinearMethod",
"AutoGPTQLinearMethod",