czhu-cohere 9909726d2a Enable ZP Support for Machete (#20268) ...

Signed-off-by: czhu-cohere <conway.zhu@cohere.com>

2025-07-01 07:12:20 +00:00

..

compressed_tensors

[Quantization] Add compressed-tensors NVFP4 MoE Support (#19990)

2025-06-29 22:05:40 +00:00

kernels

Enable ZP Support for Machete (#20268)

2025-07-01 07:12:20 +00:00

quark

[Bugfix] fix quark ptpc (#20251)

2025-06-30 22:24:50 +09:00

utils

[Quantization] Add compressed-tensors NVFP4 MoE Support (#19990)

2025-06-29 22:05:40 +00:00

__init__.py

[Feature] A calibration-free RTN-based quantization for accurate and accelerated INT4/INT8 inference (#18768)

2025-07-01 05:44:38 +00:00

aqlm.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

auto_round.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

awq_marlin.py

[Feature] Expert Parallelism Load Balancer (EPLB) (#18343)

2025-06-26 15:30:21 -07:00

awq_triton.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

awq.py

[Quantization] Improve AWQ logic (#19431)

2025-06-12 11:02:11 +00:00

base_config.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

bitblas.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

bitsandbytes.py

[Misc] Slight improvement of the BNB (#19418)

2025-06-10 13:51:49 +00:00

deepgemm.py

[Refactor] Create a function util and cache the results for has_deepgemm, has_deepep, has_pplx (#20187)

2025-06-28 22:06:38 +00:00

deepspeedfp.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

experts_int8.py

[Feature] Expert Parallelism Load Balancer (EPLB) (#18343)

2025-06-26 15:30:21 -07:00

fbgemm_fp8.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

fp8.py

[Refactor] Create a function util and cache the results for has_deepgemm, has_deepep, has_pplx (#20187)

2025-06-28 22:06:38 +00:00

gguf.py

[Feature] Expert Parallelism Load Balancer (EPLB) (#18343)

2025-06-26 15:30:21 -07:00

gptq_bitblas.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

gptq_marlin_24.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

gptq_marlin.py

[Feature] Expert Parallelism Load Balancer (EPLB) (#18343)

2025-06-26 15:30:21 -07:00

gptq.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

hqq_marlin.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

ipex_quant.py

[CPU] Fix torch version in x86 CPU backend (#19258)

2025-06-26 03:34:47 -07:00

kv_cache.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

marlin.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

modelopt.py

[Feature] Expert Parallelism Load Balancer (EPLB) (#18343)

2025-06-26 15:30:21 -07:00

moe_wna16.py

[Feature] Expert Parallelism Load Balancer (EPLB) (#18343)

2025-06-26 15:30:21 -07:00

neuron_quant.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

ptpc_fp8.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

qqq.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

rtn.py

[Feature] A calibration-free RTN-based quantization for accurate and accelerated INT4/INT8 inference (#18768)

2025-07-01 05:44:38 +00:00

schema.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

torchao.py

use .dev for version comparison with pytorch nightly release (#20031)

2025-06-24 21:52:16 +00:00

tpu_int8.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00