SeonjinandMisha Goin bd8865a299 [Kernel] Add FlashInfer TRTLLM MXFP8 linear backend (#52204) ...

Signed-off-by: seonjinn <sna@nvidia.com>
Signed-off-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>

2026-08-20 10:07:22 -04:00

..

nvfp4_utils.py

Add nvfp4 support to reshape_and_cache_flash (#37332)

2026-04-17 07:28:00 -07:00

test_aiter_hipb_mm_linear_kernel.py

[ROCm][CI] Move ROCm AITER quantization tests (#40938)

2026-08-18 14:50:35 +08:00

test_allspark_gemm.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

test_awq_triton.py

[Kernel][Test] Extend lightning_attn and awq_triton kernel tests to XPU (#43307)

2026-06-04 14:25:59 -04:00

test_awq.py

[Refactor] Remove dead quantization code and tests (#45454)

2026-06-17 16:12:01 -04:00

test_block_fp8.py

[Refactor] Simplify B12X linear kernels and warmup (#52368)

2026-08-17 09:45:45 -07:00

test_cpu_fp8_scaled_mm.py

[CPU] Add FP8 W8A16 linear support (#41186)

2026-05-06 07:05:27 +00:00

test_cutlass_scaled_mm.py

[Perf] SM90 cutlass fp8 mm supports odd M by swap_ab, 180~290% kernel performance improvement (#44572)

2026-06-13 12:05:45 -07:00

test_cutlass_w4a8_moe.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

test_cutlass_w4a8.py

[CI/Build][AMD] Skip quantization kernels tests that require CUTLASS or e4m3fn when not supported by platform (#30020)

2025-12-10 02:28:37 +00:00

test_flashinfer_mxfp8_trtllm.py

[Kernel] Add FlashInfer TRTLLM MXFP8 linear backend (#52204)

2026-08-20 10:07:22 -04:00

test_flashinfer_nvfp4_scaled_mm.py

[Kernel][Performance] Add FlashInfer cutedsl NVFP4 GEMM backend (#42235)

2026-06-22 16:17:18 -04:00

test_flashinfer_scaled_mm.py

[Platform] Deprecate seed_everything (#31659)

2026-01-04 18:34:04 -08:00

test_fp8_min_max_helper.py

[Bugfix][Hardware][AMD] Consolidate FP8 min/max values helper function (#31106)

2026-01-07 06:55:03 +00:00

test_fp8_quant_group.py

[Bugfix] Initialize DeepGemmQuantScaleFMT oracle lazily; bound QuantFP8 UE8M0 packed path to group_size 128 (#51359)

2026-08-12 14:27:50 -04:00

test_fp8_quant.py

[CI] Bump mypy version (#34950)

2026-03-04 20:55:11 +00:00

test_gptq.py

[Kernel] Add GPTQv2 format support for low-bit or asymmetric quantization, by adapting gptq_gemm (#26092)

2025-10-23 23:26:13 -04:00

test_hadacore.py

[CI/Build][AMD] Skip marlin, machete, and hadacore tests since these require _C functions not defined for ROCm (#30109)

2025-12-06 12:54:17 +08:00

test_int4_emulation_moe.py

[feature]Add int4 quantization support for emulation moe backend (#48451)

2026-07-16 02:00:12 +00:00

test_int8_kernel.py

[Misc] Add and enable Triton kernel unit tests on XPU (#45694)

2026-08-07 02:53:03 -07:00

test_int8_quant.py

[Platform] Deprecate seed_everything (#31659)

2026-01-04 18:34:04 -08:00

test_machete_mm.py

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00

test_marlin_gemm.py

[Bugfix] Fix SM121 (DGX Spark) exclusion from Marlin/CUTLASS FP8 paths (#35568)

2026-05-15 10:59:00 -07:00

test_marlin_tile_padding.py

[MoE Refactor] Combine CompressedTensorsWNA16MarlinMoEMethod with CompressedTensorsWNA16MoEMethod (#44570)

2026-07-31 14:13:03 -07:00

test_mxfp4_kernel_selection.py

[Online quantization] Add online MXFP4 quantization support (#49347)

2026-08-07 12:39:46 -07:00

test_mxfp4_qutlass.py

[Platform] Deprecate seed_everything (#31659)

2026-01-04 18:34:04 -08:00

test_mxfp4_triton_ep.py

[Perf][gpt-oss] Downgrade triton_kernels to v3.5.1 (#43135)

2026-05-20 14:13:12 -07:00

test_mxfp6_kernel_selection.py

[ROCm][Quark][7/N] Use MXFP4 linear kernel abstraction for emulation backend (#48949)

2026-07-31 10:07:15 -07:00

test_nvfp4_emulation.py

Make bare hugging_face imports forbidden (#49726)

2026-07-25 04:18:39 -07:00

test_nvfp4_quant.py

[Perf] Padded nvfp4 quant kernel to remove additional copy, 2.4%~5.7% e2e performance improvement (#42774)

2026-05-18 16:38:12 -07:00

test_nvfp4_qutlass.py

[Platform] Deprecate seed_everything (#31659)

2026-01-04 18:34:04 -08:00

test_nvfp4_scaled_mm.py

[Platform] Deprecate seed_everything (#31659)

2026-01-04 18:34:04 -08:00

test_per_token_group_quant.py

[XPU][Tests] Make tests device-agnostic (#51968)

2026-08-20 02:25:41 -07:00

test_quant_op_schema.py

[ROCm][CI] Move ROCm AITER quantization tests (#40938)

2026-08-18 14:50:35 +08:00

test_quantized_embedding.py

[Quant] Support compressed-tensors WNA8O8Int linears and WNInt embeddings (#44340)

2026-06-04 07:40:33 -07:00

test_rdna3_compile_guards.py

[Refactor] Rename rocm_moe.py to rocm_moe_rdna.py (#45011)

2026-06-10 17:02:09 +08:00

test_rdna3_moe_w4a16.py

[ROCm][Perf] Fused MoE W4A16 HIP kernel for AMD RDNA3 (gfx1100) (#44075)

2026-06-06 15:30:39 -05:00

test_rdna3_w4a16_selection.py

[Kernel][ROCm] Native W4A16 kernel for AMD RDNA3 (gfx1100) — fp16 + bf16 (#41394)

2026-05-29 11:04:40 +00:00

test_rdna3_w4a16.py

[Kernel][ROCm] Native W4A16 kernel for AMD RDNA3 (gfx1100) — fp16 + bf16 (#41394)

2026-05-29 11:04:40 +00:00

test_rdna_hybrid_w4a16.py

[ROCm][Kernel] Add HybridW4A16LinearKernel: Triton prefill + HIP skinny decode (#40977)

2026-07-13 20:22:00 -07:00

test_rocm_aiter_grouped_quant.py

[ROCm][CI] Move ROCm AITER quantization tests (#40938)

2026-08-18 14:50:35 +08:00

test_rocm_compressed_tensors_w4a16.py

[Kernel][Hardware][AMD] Add TritonW4A16LinearKernel for ROCm (#37352)

2026-04-10 10:25:27 +00:00

test_rocm_fp8.py

[ROCm][CI] Add More AITER quantization/MoE kernel tests (#49375)

2026-08-05 21:27:33 +00:00

test_rocm_mxfp4.py

[ROCm][CI] Add More AITER quantization/MoE kernel tests (#49375)

2026-08-05 21:27:33 +00:00

test_rocm_skinny_gemms.py

[ROCm][CI] Speed Up ROCm Skinny GEMM Tests (reduced parameterizations, (#51877)

2026-08-12 01:40:13 +00:00

test_scaled_mm_kernel_selection.py

[OOT] Add OOT support for linear kernel. (#37989)

2026-03-31 14:33:21 +08:00

test_silu_mul_nvfp4_quant.py

[Misc] Fix Current vLLM config is not set. warnings, assert to avoid issues in the future (#31747)

2026-01-08 15:20:49 -08:00

test_triton_scaled_mm.py

[Kernel][XPU] Tensor-descriptor operand loads for Triton W8A8 scaled_mm (#47205)

2026-08-10 00:56:11 +00:00

test_triton_w4a16.py

[ROCm][Bugfix] Fix Triton W4A16 bug in determining if transpose is required for GPTQ/AutoGPTQ (#48998)

2026-08-17 12:26:05 +00:00

test_w4a16_kernel_selection.py

[ROCm][Kernel] Add HybridW4A16LinearKernel: Triton prefill + HIP skinny decode (#40977)

2026-07-13 20:22:00 -07:00