youkaichao 388ee3de66 [torch.compile] limit inductor threads and lazy import quant (#10482) ...

Signed-off-by: youkaichao <youkaichao@gmail.com>

2024-11-20 18:36:33 -08:00

..

compressed_tensors

[bugfix] Fix static asymmetric quantization case (#10334)

2024-11-15 09:35:11 +08:00

kernels

[Kernel] Initial Machete W4A8 support + Refactors (#9855)

2024-11-18 12:59:29 -07:00

utils

[Model][Quantization] HQQ support through Marlin kernel expansion (#9766)

2024-11-19 13:31:12 -08:00

__init__.py

[torch.compile] limit inductor threads and lazy import quant (#10482)

2024-11-20 18:36:33 -08:00

aqlm.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

awq_marlin.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

awq_triton.py

[Kernel] Explicitly specify other value in tl.load calls (#9014)

2024-11-18 11:39:40 -08:00

awq.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

base_config.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

bitsandbytes.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

deepspeedfp.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

experts_int8.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

fbgemm_fp8.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

fp8.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

gguf.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

gptq_marlin_24.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

gptq_marlin.py

[Hardware][XPU] AWQ/GPTQ support for xpu backend (#10107)

2024-11-18 11:18:05 -07:00

gptq.py

[Hardware][XPU] AWQ/GPTQ support for xpu backend (#10107)

2024-11-18 11:18:05 -07:00

hqq_marlin.py

[Model][Quantization] HQQ support through Marlin kernel expansion (#9766)

2024-11-19 13:31:12 -08:00

ipex_quant.py

[Hardware][XPU] AWQ/GPTQ support for xpu backend (#10107)

2024-11-18 11:18:05 -07:00

kv_cache.py

[Bugfix] Fix kv_cache_dtype=fp8 without scales for FP8 checkpoints (#6761)

2024-07-25 09:46:15 -07:00

marlin.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

modelopt.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

neuron_quant.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

qqq.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

schema.py

Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (#3290)

2024-04-03 14:15:55 -07:00

tpu_int8.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00