Michael Goin 4ab3256644 [Bugfix] Fix FP8 torch._scaled_mm fallback for torch>2.5 with CUDA<12.4 (#10095) ...

Signed-off-by: mgoin <michael@neuralmagic.com>

2024-11-07 00:54:13 +00:00

..

__init__.py

[Kernel] (2/N) Machete - Integrate into CompressedTensorsWNA16 and GPTQMarlin (#7701)

2024-09-23 13:46:26 -04:00

layer_utils.py

[Bugfix] Fix torch dynamo fixes caused by replace_parameters (#8748)

2024-09-24 14:33:21 -04:00

machete_utils.py

[Kernel] (2/N) Machete - Integrate into CompressedTensorsWNA16 and GPTQMarlin (#7701)

2024-09-23 13:46:26 -04:00

marlin_utils_fp8.py

[CI/Build] Avoid CUDA initialization (#8534)

2024-09-18 10:38:11 +00:00

marlin_utils_test_24.py

[Misc] Disambiguate quantized types via a new ScalarType (#6396)

2024-08-02 13:51:58 -07:00

marlin_utils_test_qqq.py

Support W4A8 quantization for vllm (#5218)

2024-07-31 07:55:21 -06:00

marlin_utils_test.py

[Misc] Fused MoE Marlin support for GPTQ (#8217)

2024-09-09 23:02:52 -04:00

marlin_utils.py

[Kernel] Zero point support in fused MarlinMoE kernel + AWQ Fused MoE (#8973)

2024-10-04 12:34:44 -06:00

quant_utils.py

[Kernel] Add Exllama as a backend for compressed-tensors (#9395)

2024-10-17 09:48:26 -04:00

w8a8_utils.py

[Bugfix] Fix FP8 torch._scaled_mm fallback for torch>2.5 with CUDA<12.4 (#10095)

2024-11-07 00:54:13 +00:00