Wenhua Cheng 294fbb4f59 add 2/3/5/6/7 CUDA support in AutoRound format (#52890) ...

Signed-off-by: Wenhua Cheng <wenhua.cheng@intel.com>

2026-09-07 09:59:19 +08:00

..

compressed_tensors

[Online quantization] Add targeted online quantization configuration based on user patterns (#51285)

2026-09-02 08:55:15 -04:00

inc

add 2/3/5/6/7 CUDA support in AutoRound format (#52890)

2026-09-07 09:59:19 +08:00

online

[Quantization] Support online quantization with partially pre-quantized checkpoints (#51392)

2026-09-04 11:46:06 -07:00

quark

[Bugfix][Quantization] Register Quark per-block FP8 scales as weight_scale (#54770)

2026-09-05 10:44:24 +08:00

turboquant

[Refactor] Remove dead code (#42889)

2026-05-18 16:41:22 -04:00

utils

[Bugfix][Quantization] Register Quark per-block FP8 scales as weight_scale (#54770)

2026-09-05 10:44:24 +08:00

__init__.py

[Quantization] Support online quantization with partially pre-quantized checkpoints (#51392)

2026-09-04 11:46:06 -07:00

auto_awq.py

[Refactor] Remove dead code for quantization (#52221)

2026-08-16 13:10:16 -04:00

auto_gptq.py

[Refactor] refactor humming linear and moe backends to use explicit layer configs (#49610)

2026-08-07 10:03:19 -07:00

awq_triton.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

base_config.py

[Quantization] Support online quantization with partially pre-quantized checkpoints (#51392)

2026-09-04 11:46:06 -07:00

experts_int8.py

[Quantization] Support online quantization with partially pre-quantized checkpoints (#51392)

2026-09-04 11:46:06 -07:00

fbgemm_fp8.py

[ROCm][FEAT] Integrate aiter gemm w8a8 ptpc (#33773)

2026-04-16 09:55:29 +08:00

fp8.py

[Quantization] Support online quantization with partially pre-quantized checkpoints (#51392)

2026-09-04 11:46:06 -07:00

fp_quant.py

[Refactor] Remove dead code fp quant (#44122)

2026-06-03 14:22:23 -04:00

humming.py

[Refactor] Remove dead code for quantization (#52221)

2026-08-16 13:10:16 -04:00

input_quant_fp8.py

[Bugfix] Initialize DeepGemmQuantScaleFMT oracle lazily; bound QuantFP8 UE8M0 packed path to group_size 128 (#51359)

2026-08-12 14:27:50 -04:00

kv_cache.py

Fast Start (#54921)

2026-09-04 06:32:06 -07:00

modelopt.py

[Perf] Kimi K3 nvfp4 Align in_proj weights by 128 to avoid elementwise copy (#55242)

2026-09-05 10:46:47 +08:00

moe_wna16.py

[Bugfix][ROCm] Fix a few int4/int8 quantization errors (#52112)

2026-08-18 08:31:51 +00:00

mxfp4.py

[K3 Perf] Fuse MXFP4 top-k finalization into latent-tail, ~5% E2E latency reduction (#53152)

2026-08-21 13:29:59 -04:00

qutlass_utils.py

[CompressedTensors] FP4 Qutlass Integration (#43229)

2026-07-28 20:34:20 -06:00

torchao.py

[Refactor] Remove dead code for quantization (#52221)

2026-08-16 13:10:16 -04:00