Kate ChengandJhao-Ting Chen cc6dafaef2 [Perf][Kernels] Enable FlashInfer DeepGEMM swapAB on SM90 (for W8A8 Linear Op) (#29213) ...

Signed-off-by: Kate Cheng <yunhsuanc@nvidia.com>
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
Co-authored-by: Jhao-Ting Chen <jhaotingc@nvidia.com>

2026-01-07 10:53:54 -05:00

..

configs

[Model][Qwen3VL] Tune Triton w8a8 block fp8 kernel for L40s (#29217)

2025-11-21 17:30:55 -08:00

__init__.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

allspark_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

bitblas_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

flashinfer_fp4_moe.py

Revert "[SM100] Enable fp8 compute for prefill MLA (#30746)" (#31197)

2025-12-22 18:15:33 -08:00

flashinfer_utils.py

[MoE Refactor][14/N] Clean Up FI Quant Config Smuggling (#31593)

2026-01-06 15:47:04 +00:00

fp8_utils.py

[Perf][Kernels] Enable FlashInfer DeepGEMM swapAB on SM90 (for W8A8 Linear Op) (#29213)

2026-01-07 10:53:54 -05:00

gptq_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

int8_utils.py

[CI/Build][AMD][Quantization] Fix test_int8_kernel.py by updating int8_utils to use hip.libdevice.round (#30151)

2025-12-05 20:52:11 -08:00

layer_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

machete_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

marlin_utils_fp4.py

[Quantization] add marlin w4a8/w8a8 check (#31061)

2025-12-20 21:58:11 +00:00

marlin_utils_fp8.py

[MoE Refactor][12/N] Marlin Fp8 MoE Pure Function (#31499)

2025-12-29 13:27:00 -08:00

marlin_utils_test_24.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

marlin_utils_test.py

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722)

2025-11-29 07:19:33 -08:00

marlin_utils.py

[Quantization][Refactor] Move CPU GPTQ kernel into MP linear (#31801)

2026-01-06 19:10:18 +00:00

mxfp4_utils.py

[Feature] Add SM103 (Blackwell Ultra) Support to vLLM (#30484)

2025-12-12 19:34:23 -08:00

mxfp6_utils.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

mxfp8_utils.py

[Bugfix] Fix gpt-oss w4a8 DP/EP on B200 (#26729)

2025-10-21 01:51:14 -04:00

nvfp4_emulation_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

nvfp4_moe_support.py

[MoE] Nvfp4 Masked Gemm: Add flashinfer grouped_gemm_nt_masked (#25990)

2025-11-19 13:29:06 -08:00

ocp_mx_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

petit_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

quant_utils.py

[Bugfix][Hardware][AMD] Consolidate FP8 min/max values helper function (#31106)

2026-01-07 06:55:03 +00:00

w8a8_utils.py

[Quantization] FP8 Weight Reloading for Quantized RL Rollout (#28480)

2025-12-09 13:54:32 -08:00