rasmith 127c07480e [Kernel][Triton] Add Triton implementation for scaled_mm_triton to support fp8 and int8 SmoothQuant, symmetric case (#9857) ...

Signed-off-by: Randall Smith <Randall.Smith@amd.com>

2024-11-08 19:59:22 -05:00

..

compressed_tensors

[Kernel][Triton] Add Triton implementation for scaled_mm_triton to support fp8 and int8 SmoothQuant, symmetric case (#9857)

2024-11-08 19:59:22 -05:00

kernels

[Kernel] Add Exllama as a backend for compressed-tensors (#9395)

2024-10-17 09:48:26 -04:00

utils

[Bugfix] Fix FP8 torch._scaled_mm fallback for torch>2.5 with CUDA<12.4 (#10095)

2024-11-07 00:54:13 +00:00

__init__.py

[Hardware][CPU] Support AWQ for CPU backend (#7515)

2024-10-09 10:28:08 -06:00

aqlm.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

awq_marlin.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

awq_triton.py

[Kernel][Triton][AMD] Remove tl.atomic_add from awq_gemm_kernel, 2-5x speedup MI300, minor improvement for MI250 (#8646)

2024-09-21 09:20:54 +00:00

awq.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

base_config.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

bitsandbytes.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

deepspeedfp.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

experts_int8.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

fbgemm_fp8.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

fp8.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

gguf.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

gptq_marlin_24.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

gptq_marlin.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

gptq.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

ipex_quant.py

[Hardware][CPU] Update torch 2.5 (#9911)

2024-11-07 04:43:08 +00:00

kv_cache.py

[Bugfix] Fix kv_cache_dtype=fp8 without scales for FP8 checkpoints (#6761)

2024-07-25 09:46:15 -07:00

marlin.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

modelopt.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

neuron_quant.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

qqq.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

schema.py

Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (#3290)

2024-04-03 14:15:55 -07:00

tpu_int8.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00