Lucas Wilkinson e312e52b44 [Kernel] Add Exllama as a backend for compressed-tensors (#9395)

2024-10-17 09:48:26 -04:00

..

__init__.py

[Kernel] Add Exllama as a backend for compressed-tensors (#9395)

2024-10-17 09:48:26 -04:00

exllama.py

[Kernel] Add Exllama as a backend for compressed-tensors (#9395)

2024-10-17 09:48:26 -04:00

machete.py

[Kernel] Add Exllama as a backend for compressed-tensors (#9395)

2024-10-17 09:48:26 -04:00

marlin.py

[Bugfix] fix for deepseek w4a16 (#8906)

2024-09-27 13:12:34 -06:00

MPLinearKernel.py

[Kernel] Add Exllama as a backend for compressed-tensors (#9395)

2024-10-17 09:48:26 -04:00