Shu Wang 376786fac1 Add cutlass support for blackwell fp8 blockwise gemm (#14383) ...

Signed-off-by: Shu Wang <shuw@nvidia.com>

2025-05-08 15:09:55 -07:00

..

compressed_tensors

[Bugfix] Fix triton import with local TritonPlaceholder (#17446)

2025-05-06 17:53:09 +08:00

kernels

[Kernel] some optimizations for dense marlin and moe marlin (#16850)

2025-05-05 09:39:30 -07:00

quark

[Bugfix] Fix quark fp8 format loading on AMD GPUs (#12612)

2025-05-08 02:53:53 -07:00

utils

Add cutlass support for blackwell fp8 blockwise gemm (#14383)

2025-05-08 15:09:55 -07:00

__init__.py

Explicitly explain quant method override ordering and ensure all overrides are ordered (#17256)

2025-04-28 16:55:31 +00:00

aqlm.py

Improve configs - ModelConfig (#17130)

2025-04-30 10:38:22 +08:00

awq_marlin.py

[Kernel] some optimizations for dense marlin and moe marlin (#16850)

2025-05-05 09:39:30 -07:00

awq_triton.py

[Bugfix] Fix triton import with local TritonPlaceholder (#17446)

2025-05-06 17:53:09 +08:00

awq.py

Improve configs - ModelConfig (#17130)

2025-04-30 10:38:22 +08:00

base_config.py

Improve configs - ModelConfig (#17130)

2025-04-30 10:38:22 +08:00

bitblas.py

Improve configs - ModelConfig (#17130)

2025-04-30 10:38:22 +08:00

bitsandbytes.py

Improve configs - ModelConfig (#17130)

2025-04-30 10:38:22 +08:00

deepspeedfp.py

Improve configs - ModelConfig (#17130)

2025-04-30 10:38:22 +08:00

experts_int8.py

Improve configs - ModelConfig (#17130)

2025-04-30 10:38:22 +08:00

fbgemm_fp8.py

Improve configs - ModelConfig (#17130)

2025-04-30 10:38:22 +08:00

fp8.py

[Kernel] some optimizations for dense marlin and moe marlin (#16850)

2025-05-05 09:39:30 -07:00

gguf.py

[Kernel] GGUF MoeVec kernel (#16780)

2025-05-06 23:07:23 -07:00

gptq_bitblas.py

[Bugfix] Disable gptq_bitblas for <SM80 to fix GPTQ on V100/T4 (#17541)

2025-05-01 17:59:35 -07:00

gptq_marlin_24.py

Improve configs - ModelConfig (#17130)

2025-04-30 10:38:22 +08:00

gptq_marlin.py

[Kernel] some optimizations for dense marlin and moe marlin (#16850)

2025-05-05 09:39:30 -07:00

gptq.py

Improve configs - ModelConfig (#17130)

2025-04-30 10:38:22 +08:00

hqq_marlin.py

Improve configs - ModelConfig (#17130)

2025-04-30 10:38:22 +08:00

ipex_quant.py

Improve configs - ModelConfig (#17130)

2025-04-30 10:38:22 +08:00

kv_cache.py

Fix noisy warning for uncalibrated q_scale/p_scale (#17414)

2025-05-08 15:56:59 -04:00

marlin.py

Improve configs - ModelConfig (#17130)

2025-04-30 10:38:22 +08:00

modelopt.py

Improve configs - ModelConfig (#17130)

2025-04-30 10:38:22 +08:00

moe_wna16.py

Improve configs - ModelConfig (#17130)

2025-04-30 10:38:22 +08:00

neuron_quant.py

Improve configs - ModelConfig (#17130)

2025-04-30 10:38:22 +08:00

ptpc_fp8.py

Improve configs - ModelConfig (#17130)

2025-04-30 10:38:22 +08:00

qqq.py

Improve configs - ModelConfig (#17130)

2025-04-30 10:38:22 +08:00

schema.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

torchao.py

Improve configs - ModelConfig (#17130)

2025-04-30 10:38:22 +08:00

tpu_int8.py

Improve configs - ModelConfig (#17130)

2025-04-30 10:38:22 +08:00