Shu WangandMichael Goin f95da13c3d [ModelOpt] Load w13/w2_input_scale for all experts, nvfp4 (#26135) ...

Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

2025-10-21 01:50:31 -04:00

..

configs

Tuned H100/H200 triton fp8 block configs for fused_qkv_a_proj (#23939)

2025-08-29 10:28:35 -07:00

__init__.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

allspark_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

bitblas_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

flashinfer_fp4_moe.py

[Docs] Replace rst style double-backtick with md single-backtick (#27091)

2025-10-17 02:47:34 -07:00

flashinfer_utils.py

[ModelOpt] Load w13/w2_input_scale for all experts, nvfp4 (#26135)

2025-10-21 01:50:31 -04:00

fp8_utils.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

gptq_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

int8_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

layer_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

machete_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

marlin_utils_fp4.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

marlin_utils_fp8.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

marlin_utils_test_24.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

marlin_utils_test.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

marlin_utils.py

[Quantization] [Performance] Enable Marlin GEMM kernels for the calibration-free RTN-based quantization (#26051)

2025-10-13 18:52:54 +00:00

mxfp4_utils.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

mxfp6_utils.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

mxfp8_utils.py

[Feature][OCP MX] Support mxfp6 and mixed mxfp6-mxfp4 (#21166)

2025-10-07 09:35:26 -04:00

nvfp4_emulation_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

nvfp4_moe_support.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

ocp_mx_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

petit_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

quant_utils.py

[Quantization] Automatically infer AWQ modules_to_not_convert field (#26909)

2025-10-21 01:49:28 +00:00

w8a8_utils.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00