3 people 9a161307f5 [torch.compile][ROCm][V1] Enable attention output FP8 fusion for V1 attention backends (#19767) ...

Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

2025-09-10 13:59:55 -07:00

..

configs

Tuned H100/H200 triton fp8 block configs for fused_qkv_a_proj (#23939)

2025-08-29 10:28:35 -07:00

__init__.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

allspark_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

bitblas_utils.py

[Bugfix] Add proper comparison for package versions (#22314)

2025-08-06 20:31:03 -07:00

flashinfer_fp4_moe.py

[Kernels] Clean up FusedMoeMethodBase and modular kernel setup. Remove extra arguments from modular kernel methods. (#22035)

2025-08-15 14:46:00 -04:00

flashinfer_utils.py

[NVIDIA] Add SM100 Flashinfer Cutlass MoE fp8 backend (#22357)

2025-08-19 18:01:53 -04:00

fp8_utils.py

[Feature] Add Hopper DeepGEMM E8M0 for DeepSeekV3.1 scale_fmt (#23666)

2025-08-27 14:09:08 +00:00

gptq_utils.py

Fix the bug related to loading GPTP INT3 weights. (#23328)

2025-09-01 05:39:57 +00:00

int8_utils.py

[Perf] Cuda Kernel for Int8 Per Token Group Quant (#21476)

2025-07-25 17:07:07 -07:00

layer_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

machete_utils.py

Enable group size 64 for Machete (#20290)

2025-07-01 18:05:44 -07:00

marlin_utils_fp4.py

[Kernel] [Quantization] Add MXFP4 and bias support for marlin kernel (#22428)

2025-08-14 11:23:22 -07:00

marlin_utils_fp8.py

[Kernel] [Quantization] Add MXFP4 and bias support for marlin kernel (#22428)

2025-08-14 11:23:22 -07:00

marlin_utils_test_24.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

marlin_utils_test.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

marlin_utils.py

[Doc]: fix typos in Python comments (#24417)

2025-09-08 00:22:16 -07:00

mxfp4_utils.py

DP/EP Support for gpt-oss with deepep-ht comm kernel on SM100 (#23608)

2025-08-27 17:33:21 -04:00

mxfp8_utils.py

DP/EP Support for gpt-oss with deepep-ht comm kernel on SM100 (#23608)

2025-08-27 17:33:21 -04:00

nvfp4_emulation_utils.py

[Refactor] Refactor MOE NVFP4 Code Base: ModelOpt + Compressed Tensor (#21631)

2025-07-27 05:25:21 -07:00

nvfp4_moe_support.py

Support Tensorrt-LLM MoE fp4 for low-latency (#21331)

2025-08-07 19:18:22 -07:00

petit_utils.py

Quantization: support FP4 quantized models on AMD CDNA2/CDNA3 GPUs (#22527)

2025-08-22 20:53:21 -06:00

quant_utils.py

[Doc]: fix typos in Python comments (#24042)

2025-09-01 19:07:45 -07:00

w8a8_utils.py

[torch.compile][ROCm][V1] Enable attention output FP8 fusion for V1 attention backends (#19767)

2025-09-10 13:59:55 -07:00