Michael Goin ea6ae8cb45 [Bugfix] Fix marlin moe fallback logic for llama4 (#18042) ...

Signed-off-by: mgoin <mgoin64@gmail.com>

2025-05-13 07:53:28 +00:00

..

configs

[Misc] Add tuned R1 w8a8 and MoE configs for NVIDIA L20 (#15322)

2025-03-23 01:10:10 -07:00

__init__.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

allspark_utils.py

[Misc][Kernel]: Add GPTQAllSpark Quantization (#12931)

2025-02-28 22:30:59 -08:00

bitblas_utils.py

Check if bitblas is installed during support check (#17572)

2025-05-02 04:32:54 +00:00

fp8_utils.py

Add cutlass support for blackwell fp8 blockwise gemm (#14383)

2025-05-08 15:09:55 -07:00

gptq_utils.py

[CORE] [QUANT] Support for GPTQModel's dynamic quantization per module override/control (#7086)

2025-02-12 09:19:43 -08:00

int8_utils.py

[Bugfix] Fix triton import with local TritonPlaceholder (#17446)

2025-05-06 17:53:09 +08:00

layer_utils.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

machete_utils.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

marlin_utils_fp4.py

[Kernel] fp4 marlin kernel (#17687)

2025-05-10 19:58:49 -07:00

marlin_utils_fp8.py

Fix FBGEMM integration (#18002)

2025-05-12 23:02:07 +00:00

marlin_utils_test_24.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

marlin_utils_test_qqq.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

marlin_utils_test.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

marlin_utils.py

[Bugfix] Fix marlin moe fallback logic for llama4 (#18042)

2025-05-13 07:53:28 +00:00

mxfp4_utils.py

[Quantization] Quark MXFP4 format loading (#16943)

2025-05-07 15:05:05 -04:00

nvfp4_emulation_utils.py

[Misc] Add compressed-tensors NVFP4A16 emulation support (#17914)

2025-05-11 15:58:38 +08:00

quant_utils.py

[Model][Quant] Fix GLM, Fix fused module mappings for quantization (#12634)

2025-02-05 05:32:06 +00:00

w8a8_utils.py

[Bugfix] Fix moe weight losing all extra attrs after process_weights_after_loading. (#16854)

2025-04-28 21:05:07 +00:00