Wentao Ye 75d29cf4e1 [Perf] Cuda Kernel for Int8 Per Token Group Quant (#21476) ...

Signed-off-by: yewentao256 <zhyanwentao@126.com>

2025-07-25 17:07:07 -07:00

..

configs

[Misc] Add tuned R1 w8a8 and MoE configs for NVIDIA L20 (#15322)

2025-03-23 01:10:10 -07:00

__init__.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

allspark_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

bitblas_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

fp8_utils.py

[Bug] Fix DeepGemm Init Error (#21554)

2025-07-24 20:07:22 -07:00

gptq_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

int8_utils.py

[Perf] Cuda Kernel for Int8 Per Token Group Quant (#21476)

2025-07-25 17:07:07 -07:00

layer_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

machete_utils.py

Enable group size 64 for Machete (#20290)

2025-07-01 18:05:44 -07:00

marlin_utils_fp4.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

marlin_utils_fp8.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

marlin_utils_test_24.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

marlin_utils_test_qqq.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

marlin_utils_test.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

marlin_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

mxfp4_utils.py

[Feature][Quantization] MXFP4 support for MOE models (#17888)

2025-07-09 13:19:02 -07:00

nvfp4_emulation_utils.py

[Quantization] Add compressed-tensors NVFP4 MoE Support (#19990)

2025-06-29 22:05:40 +00:00

quant_utils.py

[Perf][fp8] Use CustomOp abstraction for fp8 quant for better perf (#19830)

2025-07-11 04:56:28 +00:00

w8a8_utils.py

[Perf][fp8] Use CustomOp abstraction for fp8 quant for better perf (#19830)

2025-07-11 04:56:28 +00:00