Michael Goin 9e0b558a09 [Misc] Support FP8 kv cache scales from compressed-tensors (#6528)

2024-07-23 04:11:50 +00:00

..

compressed_tensors

[Misc] Support FP8 kv cache scales from compressed-tensors (#6528)

2024-07-23 04:11:50 +00:00

utils

[Kernel][Core] Add AWQ support to the Marlin kernel (#6612)

2024-07-21 19:41:42 -04:00

__init__.py

[Kernel][Core] Add AWQ support to the Marlin kernel (#6612)

2024-07-21 19:41:42 -04:00

aqlm.py

[ Misc ] fbgemm checkpoints (#6559)

2024-07-20 09:36:57 -07:00

awq_marlin.py

[Kernel][Core] Add AWQ support to the Marlin kernel (#6612)

2024-07-21 19:41:42 -04:00

awq.py

[ Misc ] fbgemm checkpoints (#6559)

2024-07-20 09:36:57 -07:00

base_config.py

[ Misc ] fbgemm checkpoints (#6559)

2024-07-20 09:36:57 -07:00

bitsandbytes.py

[ Misc ] fbgemm checkpoints (#6559)

2024-07-20 09:36:57 -07:00

deepspeedfp.py

[ Misc ] fbgemm checkpoints (#6559)

2024-07-20 09:36:57 -07:00

fbgemm_fp8.py

[Bugfix] Fix null modules_to_not_convert in FBGEMM Fp8 quantization (#6665)

2024-07-22 19:25:05 -07:00

fp8.py

[Misc] Support FP8 kv cache scales from compressed-tensors (#6528)

2024-07-23 04:11:50 +00:00

gptq_marlin_24.py

[ Misc ] fbgemm checkpoints (#6559)

2024-07-20 09:36:57 -07:00

gptq_marlin.py

[Kernel][Core] Add AWQ support to the Marlin kernel (#6612)

2024-07-21 19:41:42 -04:00

gptq.py

[ Misc ] fbgemm checkpoints (#6559)

2024-07-20 09:36:57 -07:00

kv_cache.py

[Misc] Support FP8 kv cache scales from compressed-tensors (#6528)

2024-07-23 04:11:50 +00:00

marlin.py

[ Misc ] fbgemm checkpoints (#6559)

2024-07-20 09:36:57 -07:00

schema.py

Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (#3290)

2024-04-03 14:15:55 -07:00

squeezellm.py

[ Misc ] fbgemm checkpoints (#6559)

2024-07-20 09:36:57 -07:00