Jinzhen Lin 1d0c9d6b2d [Kernel] some optimizations for dense marlin and moe marlin (#16850) ...

Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>

2025-05-05 09:39:30 -07:00

..

configs

[Misc] Add tuned R1 w8a8 and MoE configs for NVIDIA L20 (#15322)

2025-03-23 01:10:10 -07:00

__init__.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

allspark_utils.py

[Misc][Kernel]: Add GPTQAllSpark Quantization (#12931)

2025-02-28 22:30:59 -08:00

bitblas_utils.py

Check if bitblas is installed during support check (#17572)

2025-05-02 04:32:54 +00:00

fp8_utils.py

[Attention] MLA get rid of materialization (#14770)

2025-03-13 23:39:02 -07:00

gptq_utils.py

[CORE] [QUANT] Support for GPTQModel's dynamic quantization per module override/control (#7086)

2025-02-12 09:19:43 -08:00

int8_utils.py

[Quantizaton] [AMD] Add support for running DeepSeek int8 w8a8 MoE on ROCm (#17558)

2025-05-02 21:41:10 -07:00

layer_utils.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

machete_utils.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

marlin_utils_fp8.py

[Kernel] some optimizations for dense marlin and moe marlin (#16850)

2025-05-05 09:39:30 -07:00

marlin_utils_test_24.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

marlin_utils_test_qqq.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

marlin_utils_test.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

marlin_utils.py

[Kernel] some optimizations for dense marlin and moe marlin (#16850)

2025-05-05 09:39:30 -07:00

quant_utils.py

[Model][Quant] Fix GLM, Fix fused module mappings for quantization (#12634)

2025-02-05 05:32:06 +00:00

w8a8_utils.py

[Bugfix] Fix moe weight losing all extra attrs after process_weights_after_loading. (#16854)

2025-04-28 21:05:07 +00:00