Robert Shaw 79a268c4ab [BUG] fixed fp8 conflict with aqlm (#4307) ...

Fixes fp8 iterface which broke in AQLM merge.

2024-04-23 18:26:33 -07:00

..

__init__.py

AQLM CUDA support (#3287)

2024-04-23 13:59:33 -04:00

aqlm.py

AQLM CUDA support (#3287)

2024-04-23 13:59:33 -04:00

awq.py

AQLM CUDA support (#3287)

2024-04-23 13:59:33 -04:00

base_config.py

Add AWQ support for all models (#1714)

2023-11-18 17:56:47 -08:00

fp8.py

[BUG] fixed fp8 conflict with aqlm (#4307)

2024-04-23 18:26:33 -07:00

gptq.py

AQLM CUDA support (#3287)

2024-04-23 13:59:33 -04:00

marlin.py

AQLM CUDA support (#3287)

2024-04-23 13:59:33 -04:00

schema.py

Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (#3290)

2024-04-03 14:15:55 -07:00

squeezellm.py

AQLM CUDA support (#3287)

2024-04-23 13:59:33 -04:00