danisereb 9609b1f18d Integrate flashinfer mm_mxfp8 in ModelOpt MXFP8 (#35053) ...

Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>

2026-02-24 08:45:13 -07:00

..

configs

[AMD][QWEN3-NEXT] FP8 Tunings (#32042)

2026-01-27 09:34:13 +00:00

__init__.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

allspark_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

flashinfer_fp4_moe.py

Fix fallback to default tactic (flashinfer autotuner) with trtllm_fp4_block_scale_moe (#35088)

2026-02-24 07:25:44 -08:00

flashinfer_mxint4_moe.py

[Hardware][SM100] Add TRTLLM Kernel for INT4 W4A16 Kernel. (#32437)

2026-01-30 10:30:46 -08:00

flashinfer_utils.py

[Bugfix] Fix cutlass fp8 kernel on hopper for Qwen3.5 (#34914)

2026-02-19 13:34:55 -08:00

fp8_utils.py

[Bugfix] Fix quant RMS norm fusion for quantization with TMA-aligned scales (#33255)

2026-02-17 23:35:04 -08:00

gptq_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

int8_utils.py

[Bugfix][Quantization] Ensure input contiguity in per_token_quant_int8 (#31637)

2026-01-10 12:40:02 -08:00

layer_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

machete_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

marlin_utils_fp4.py

Refactor NVFP4 Linear utils for ModelOpt and CT (#33201)

2026-01-30 16:37:42 -08:00

marlin_utils_fp8.py

[Refactor] Rename gptq_marlin to marlin to match MoE (#32952)

2026-01-23 16:48:12 -05:00

marlin_utils_test.py

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722)

2025-11-29 07:19:33 -08:00

marlin_utils.py

[Refactor] Rename gptq_marlin to marlin to match MoE (#32952)

2026-01-23 16:48:12 -05:00

mxfp4_utils.py

[Refactor] Replace activation: str with MoEActivation enum (#33843)

2026-02-11 17:29:32 -08:00

mxfp6_utils.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

mxfp8_utils.py

Integrate flashinfer mm_mxfp8 in ModelOpt MXFP8 (#35053)

2026-02-24 08:45:13 -07:00

nvfp4_emulation_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

nvfp4_utils.py

[Misc] Fix flashinfer related tests (#33462)

2026-01-31 16:10:24 -05:00

ocp_mx_utils.py

[ROCm][Quantization] GPT_OSS in amd-quark format model loading and emulations (#29008)

2026-02-10 10:08:05 -05:00

petit_utils.py

[Misc] Replace Optional[X] with X | None syntax (#33332)

2026-01-30 01:56:59 -08:00

quant_utils.py

Refactor NVFP4 Linear utils for ModelOpt and CT (#33201)

2026-01-30 16:37:42 -08:00

w8a8_utils.py

[Refactor] Make FP8 Linear Ops use kernel abstraction (#27814)

2026-01-20 14:48:20 +08:00