CHU Tianxiang 01a5d18a53 Add Support for 2/3/8-bit GPTQ Quantization Models (#2330)

2024-02-28 21:52:23 -08:00

..

__init__.py

Add GPTQ support (#916)

2023-12-15 03:04:22 -08:00

awq.py

Refactor 2 awq gemm kernels into m16nXk32 (#2723)

2024-02-12 11:02:17 -08:00

base_config.py

Add AWQ support for all models (#1714)

2023-11-18 17:56:47 -08:00

gptq.py

Add Support for 2/3/8-bit GPTQ Quantization Models (#2330)

2024-02-28 21:52:23 -08:00

squeezellm.py

Remove hardcoded device="cuda" to support more devices (#2503)

2024-02-01 15:46:39 -08:00