Michael Goin 53b018edcb [Bugfix] Get available quantization methods from quantization registry (#4098)

2024-04-18 00:21:55 -07:00

..

__init__.py

[Bugfix] Get available quantization methods from quantization registry (#4098)

2024-04-18 00:21:55 -07:00

awq.py

[Core] Set linear_weights directly on the layer (#3977)

2024-04-11 16:35:51 -04:00

base_config.py

Add AWQ support for all models (#1714)

2023-11-18 17:56:47 -08:00

gptq.py

[Core] Set linear_weights directly on the layer (#3977)

2024-04-11 16:35:51 -04:00

marlin.py

[Core] Set linear_weights directly on the layer (#3977)

2024-04-11 16:35:51 -04:00

schema.py

Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (#3290)

2024-04-03 14:15:55 -07:00

squeezellm.py

[Core] Set linear_weights directly on the layer (#3977)

2024-04-11 16:35:51 -04:00