3 people acc1a6e10a Fix the bug related to loading GPTP INT3 weights. (#23328) ...

Signed-off-by: JunHowie <JunHowie@aliyun.com>
Co-authored-by: JunHowie <JunHowie@aliyun.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

2025-09-01 05:39:57 +00:00

..

configs

Tuned H100/H200 triton fp8 block configs for fused_qkv_a_proj (#23939)

2025-08-29 10:28:35 -07:00

__init__.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

allspark_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

bitblas_utils.py

[Bugfix] Add proper comparison for package versions (#22314)

2025-08-06 20:31:03 -07:00

flashinfer_fp4_moe.py

[Kernels] Clean up FusedMoeMethodBase and modular kernel setup. Remove extra arguments from modular kernel methods. (#22035)

2025-08-15 14:46:00 -04:00

flashinfer_utils.py

[NVIDIA] Add SM100 Flashinfer Cutlass MoE fp8 backend (#22357)

2025-08-19 18:01:53 -04:00

fp8_utils.py

[Feature] Add Hopper DeepGEMM E8M0 for DeepSeekV3.1 scale_fmt (#23666)

2025-08-27 14:09:08 +00:00

gptq_utils.py

Fix the bug related to loading GPTP INT3 weights. (#23328)

2025-09-01 05:39:57 +00:00

int8_utils.py

[Perf] Cuda Kernel for Int8 Per Token Group Quant (#21476)

2025-07-25 17:07:07 -07:00

layer_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

machete_utils.py

Enable group size 64 for Machete (#20290)

2025-07-01 18:05:44 -07:00

marlin_utils_fp4.py

[Kernel] [Quantization] Add MXFP4 and bias support for marlin kernel (#22428)

2025-08-14 11:23:22 -07:00

marlin_utils_fp8.py

[Kernel] [Quantization] Add MXFP4 and bias support for marlin kernel (#22428)

2025-08-14 11:23:22 -07:00

marlin_utils_test_24.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

marlin_utils_test.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

marlin_utils.py

[Kernel] [Quantization] Add MXFP4 and bias support for marlin kernel (#22428)

2025-08-14 11:23:22 -07:00

mxfp4_utils.py

DP/EP Support for gpt-oss with deepep-ht comm kernel on SM100 (#23608)

2025-08-27 17:33:21 -04:00

mxfp8_utils.py

DP/EP Support for gpt-oss with deepep-ht comm kernel on SM100 (#23608)

2025-08-27 17:33:21 -04:00

nvfp4_emulation_utils.py

[Refactor] Refactor MOE NVFP4 Code Base: ModelOpt + Compressed Tensor (#21631)

2025-07-27 05:25:21 -07:00

nvfp4_moe_support.py

Support Tensorrt-LLM MoE fp4 for low-latency (#21331)

2025-08-07 19:18:22 -07:00

petit_utils.py

Quantization: support FP4 quantized models on AMD CDNA2/CDNA3 GPUs (#22527)

2025-08-22 20:53:21 -06:00

quant_utils.py

[NVIDIA][torch.compile] Support Flashinfer TRTLLM FP8-q/kv NVFP4-out Attention Kernel (#22703)

2025-08-22 22:09:05 +00:00

w8a8_utils.py

[Kernel] Added flashinfer fp8 per-tensor gemms (#22895)

2025-08-26 06:54:04 -07:00