Michael Goin f41647ee6b [Kernel] Support W8A8 channel-wise weights and per-token activations in triton fused_moe_kernel (#16366) ...

Signed-off-by: mgoin <mgoin64@gmail.com>

2025-04-11 17:54:08 +00:00

..

configs

[Misc] Add tuned R1 w8a8 and MoE configs for NVIDIA L20 (#15322)

2025-03-23 01:10:10 -07:00

__init__.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

allspark_utils.py

[Misc][Kernel]: Add GPTQAllSpark Quantization (#12931)

2025-02-28 22:30:59 -08:00

fp8_utils.py

[Attention] MLA get rid of materialization (#14770)

2025-03-13 23:39:02 -07:00

gptq_utils.py

[CORE] [QUANT] Support for GPTQModel's dynamic quantization per module override/control (#7086)

2025-02-12 09:19:43 -08:00

int8_utils.py

[Kernel] Support W8A8 channel-wise weights and per-token activations in triton fused_moe_kernel (#16366)

2025-04-11 17:54:08 +00:00

layer_utils.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

machete_utils.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

marlin_utils_fp8.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

marlin_utils_test_24.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

marlin_utils_test_qqq.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

marlin_utils_test.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

marlin_utils.py

[Bugfix] fix use_atomic_add support of marlin kernel when using v1 engine (#15946)

2025-04-05 20:04:22 -07:00

quant_utils.py

[Model][Quant] Fix GLM, Fix fused module mappings for quantization (#12634)

2025-02-05 05:32:06 +00:00

w8a8_utils.py

[Quantization][FP8] Adding support for fp8 gemm layer input in fp8 (#14578)

2025-03-28 02:58:16 +00:00