Charlie Fu e837b624f2 [Feature][Hardware][Amd] Add fp8 Linear Layer for Rocm (#7210)

2024-08-16 10:06:30 -07:00

..

__init__.py

Add marlin unit tests and marlin benchmark script (#4815)

2024-05-16 09:36:49 -04:00

marlin_utils_fp8.py

[ Misc ] fp8-marlin channelwise via compressed-tensors (#6524)

2024-07-25 09:46:04 -07:00

marlin_utils_test_24.py

[Misc] Disambiguate quantized types via a new ScalarType (#6396)

2024-08-02 13:51:58 -07:00

marlin_utils_test_qqq.py

Support W4A8 quantization for vllm (#5218)

2024-07-31 07:55:21 -06:00

marlin_utils_test.py

[Misc] Disambiguate quantized types via a new ScalarType (#6396)

2024-08-02 13:51:58 -07:00

marlin_utils.py

[Bugfix] Fix gptq failure on T4s (#7264)

2024-08-07 20:05:37 +00:00

quant_utils.py

[Misc] Disambiguate quantized types via a new ScalarType (#6396)

2024-08-02 13:51:58 -07:00

w8a8_utils.py

[Feature][Hardware][Amd] Add fp8 Linear Layer for Rocm (#7210)

2024-08-16 10:06:30 -07:00