[CompressedTensors] FP4 Qutlass Integration (#43229)
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com> Signed-off-by: Brian Dellabetta <bdellabe@redhat.com> Signed-off-by: Brian Dellabetta <brian-dellabetta@users.noreply.github.com> Co-authored-by: Brian Dellabetta <bdellabe@redhat.com> Co-authored-by: Brian Dellabetta <brian-dellabetta@users.noreply.github.com> Co-authored-by: Dipika Sikka <dipikasikka1@gmail.com>
This commit is contained in:
co-authored by
Brian Dellabetta
Brian Dellabetta
Dipika Sikka
parent
7398a30d79
commit
30c2718eaa
@@ -50,6 +50,7 @@ WEIGHT_LOADER_V2_SUPPORTED = [
|
||||
"UnquantizedLinearMethod",
|
||||
"CompressedTensorsLinearMethod",
|
||||
"CompressedTensorsLinearTransformMethod",
|
||||
"QutlassNvFP4LinearMethod",
|
||||
"AutoAWQMarlinLinearMethod",
|
||||
"AutoAWQLinearMethod",
|
||||
"AutoGPTQLinearMethod",
|
||||
|
||||
Reference in New Issue
Block a user