rainkertanddangshunya 0df25101d6 [Bugfix] Fix gptq_marlin for deepseek-v3 (#13750) ...

Signed-off-by: dangshunya <dangshunya@baichuan-inc.com>
Co-authored-by: dangshunya <dangshunya@baichuan-inc.com>

2025-03-05 12:25:53 +08:00

..

compressed_tensors

[Model] Support Grok1 (#13795)

2025-02-26 01:07:12 +00:00

kernels

[Misc][Kernel]: Add GPTQAllSpark Quantization (#12931)

2025-02-28 22:30:59 -08:00

quark

[Bugfix][Quantization] Fix FP8 + EP (#13784)

2025-02-25 10:54:17 +08:00

utils

[Misc][Kernel]: Add GPTQAllSpark Quantization (#12931)

2025-02-28 22:30:59 -08:00

__init__.py

[ROCm] [Feature] [Doc] [Dockerfile] [BugFix] Support Per-Token-Activation Per-Channel-Weight FP8 Quantization Inferencing (#12501)

2025-02-07 08:13:43 -08:00

aqlm.py

[Quant] Add SupportsQuant to phi3 and clip (#13104)

2025-02-15 19:28:33 -08:00

awq_marlin.py

[Model] Support Grok1 (#13795)

2025-02-26 01:07:12 +00:00

awq_triton.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

awq.py

[Quant] Add SupportsQuant to phi3 and clip (#13104)

2025-02-15 19:28:33 -08:00

base_config.py

[Quant] Add SupportsQuant to phi3 and clip (#13104)

2025-02-15 19:28:33 -08:00

bitsandbytes.py

[Quant] Add SupportsQuant to phi3 and clip (#13104)

2025-02-15 19:28:33 -08:00

deepspeedfp.py

[Quant] Add SupportsQuant to phi3 and clip (#13104)

2025-02-15 19:28:33 -08:00

experts_int8.py

[Model] Support Grok1 (#13795)

2025-02-26 01:07:12 +00:00

fbgemm_fp8.py

[Bugfix][CI][V1] Work around V1 + CUDA Graph + torch._scaled_mm fallback issue (#13425)

2025-02-18 00:32:48 +00:00

fp8.py

[BugFix] Make FP8 Linear compatible with torch.compile (#13918)

2025-02-26 13:48:55 -08:00

gguf.py

[Model] Deepseek GGUF support (#13167)

2025-02-27 02:08:35 -08:00

gptq_marlin_24.py

[Quant] Add SupportsQuant to phi3 and clip (#13104)

2025-02-15 19:28:33 -08:00

gptq_marlin.py

[Bugfix] Fix gptq_marlin for deepseek-v3 (#13750)

2025-03-05 12:25:53 +08:00

gptq.py

[Misc] set single whitespace between log sentences (#13771)

2025-02-25 10:26:12 +08:00

hqq_marlin.py

[Quant] Add SupportsQuant to phi3 and clip (#13104)

2025-02-15 19:28:33 -08:00

ipex_quant.py

[Quant] Add SupportsQuant to phi3 and clip (#13104)

2025-02-15 19:28:33 -08:00

kv_cache.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

marlin.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

modelopt.py

[Misc] set single whitespace between log sentences (#13771)

2025-02-25 10:26:12 +08:00

moe_wna16.py

[Bugfix] Fix MoeWNA16Method activation (#14024)

2025-02-28 15:22:42 +00:00

neuron_quant.py

[Misc] set single whitespace between log sentences (#13771)

2025-02-25 10:26:12 +08:00

ptpc_fp8.py

[ROCm] [Feature] [Doc] [Dockerfile] [BugFix] Support Per-Token-Activation Per-Channel-Weight FP8 Quantization Inferencing (#12501)

2025-02-07 08:13:43 -08:00

qqq.py

[Quant] Add SupportsQuant to phi3 and clip (#13104)

2025-02-15 19:28:33 -08:00

schema.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

tpu_int8.py

[Quant] Add SupportsQuant to phi3 and clip (#13104)

2025-02-15 19:28:33 -08:00