3 people b3195bc9e4 [AMD][ROCm]Quantization methods on ROCm; Fix _scaled_mm call (#8380) ...

Co-authored-by: Alexei-V-Ivanov-AMD <156011006+Alexei-V-Ivanov-AMD@users.noreply.github.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

2024-09-18 10:41:08 -07:00

..

__init__.py

Add marlin unit tests and marlin benchmark script (#4815)

2024-05-16 09:36:49 -04:00

marlin_utils_fp8.py

[CI/Build] Avoid CUDA initialization (#8534)

2024-09-18 10:38:11 +00:00

marlin_utils_test_24.py

[Misc] Disambiguate quantized types via a new ScalarType (#6396)

2024-08-02 13:51:58 -07:00

marlin_utils_test_qqq.py

Support W4A8 quantization for vllm (#5218)

2024-07-31 07:55:21 -06:00

marlin_utils_test.py

[Misc] Fused MoE Marlin support for GPTQ (#8217)

2024-09-09 23:02:52 -04:00

marlin_utils.py

[CI/Build] Avoid CUDA initialization (#8534)

2024-09-18 10:38:11 +00:00

quant_utils.py

[Misc] Fused MoE Marlin support for GPTQ (#8217)

2024-09-09 23:02:52 -04:00

w8a8_utils.py

[AMD][ROCm]Quantization methods on ROCm; Fix _scaled_mm call (#8380)

2024-09-18 10:41:08 -07:00