3 people e8ebbdde83 [Quantization] Add FlashInfer CuteDSL batched experts backend for NVFP4 MoE (#38251) ...

Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

2026-04-06 11:57:53 -07:00

..

configs

[AMD][QWEN3-NEXT] FP8 Tunings (#32042)

2026-01-27 09:34:13 +00:00

__init__.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

allspark_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

flashinfer_fp4_moe.py

[Quantization] Add FlashInfer CuteDSL batched experts backend for NVFP4 MoE (#38251)

2026-04-06 11:57:53 -07:00

flashinfer_mxint4_moe.py

[Hardware][SM100] Add TRTLLM Kernel for INT4 W4A16 Kernel. (#32437)

2026-01-30 10:30:46 -08:00

flashinfer_utils.py

[Perf] Change Trtllm fp8 MoE to use Shuffled Weights and BlockMajorK Layout (#38993)

2026-04-05 10:54:31 -04:00

fp8_utils.py

[Bugfix] Fix DeepGemm E8M0 accuracy degradation for Qwen3.5 FP8 on Blackwell (#38083)

2026-03-26 01:21:47 -07:00

gptq_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

int8_utils.py

[Intel][Triton] Support round_int8 for Intel backend (#38825)

2026-04-03 20:47:35 +08:00

layer_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

machete_utils.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

marlin_utils_fp4.py

[Bugfix]fix output Nan/Inf in marlin if dtype=float16 (#33972)

2026-03-27 16:36:08 -07:00

marlin_utils_fp8.py

[Kernel] Add MXFP8 to Marlin GEMM/MoE and refactor Mxfp8LinearOp (#34664)

2026-04-01 09:41:42 -07:00

marlin_utils_test.py

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722)

2025-11-29 07:19:33 -08:00

marlin_utils.py

[ROCm][Refactor] Enable AWQMarlinConfig on ROCm to use choose_mp_linear_kernel (#36505)

2026-03-23 15:36:08 +08:00

mxfp4_utils.py

[ROCm] Fix GPT-OSS import for triton 3.6 (#37453)

2026-03-27 18:00:57 +00:00

mxfp6_utils.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

mxfp8_utils.py

[Kernel] Add MXFP8 to Marlin GEMM/MoE and refactor Mxfp8LinearOp (#34664)

2026-04-01 09:41:42 -07:00

nvfp4_emulation_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

nvfp4_utils.py

[NVIDIA] Bugfix NVFP4 DGX Spark and RTX50 (#38423)

2026-03-30 09:36:18 -07:00

ocp_mx_utils.py

[ROCm][Quantization] GPT_OSS in amd-quark format model loading and emulations (#29008)

2026-02-10 10:08:05 -05:00

quant_utils.py

[Quant][Feature] Support online MXFP8 quantization for MoE and dense models (#35448)

2026-03-16 18:07:39 -04:00

w8a8_utils.py

[Sparse24] [Deprecation] Remove Sparse24 CT integration and kernels (#36799)

2026-03-23 16:03:29 -04:00