vLLM/tests/kernels/moe at 382970ee6ca490aeaaaf4e32c53695b581ff61ba - vLLM

modular_kernel_tools

[ROCm][CI] Enable AITER FP8/unquantized cases in modular-kernel sweep + fix MoRI per-tensor FP8 dispatch (#57074 )

2026-09-16 19:53:06 -05:00

__init__.py

[Kernel] DeepEP dispatch-combine kernel integration (#18434 )

2025-06-03 12:30:02 -07:00

conftest.py

[Bugfix][MoE] Reject hash routing for unsupported monolithic backends (#57867 )

2026-09-21 16:28:35 -04:00

parallel_utils.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_b12x.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_batched_deepgemm.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_batched_moe.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_block_fp8.py

[Model] Support Qwen3.8-Flash-Next (#53896 )

2026-08-31 05:57:56 +00:00

test_block_int8.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_count_expert_num_tokens.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_cpu_fused_moe.py

[HARDWARE][POWER] Enable W8A8 INT8 MoE on POWER (#55316 )

2026-09-17 21:45:13 +08:00

test_cpu_int4_moe.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_cpu_quant_fused_moe.py

[CPU] Add CPU FP8 W8A8 linear/MoE support (#49942 )

2026-09-18 17:59:42 +08:00

test_cutedsl_moe.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_cutlass_moe.py

[Bugfix] Handle padded routes in CUTLASS MoE permutations (#54747 )

2026-09-01 19:08:17 -07:00

test_deepep_deepgemm_moe.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_deepep_moe.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_deepep_v2_async_finalize.py

[Kernel][MoE] DeepEP v2: async finalize to overlap shared experts with combine (#52781 )

2026-09-15 00:04:22 -04:00

test_deepep_v2_moe.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_deepgemm.py

[BugFxi] Fix DeepGEMM FP8 workspace over allocation (#53914 )

2026-09-17 09:35:34 -04:00

test_flashinfer_b12x_moe.py

[BugFix] weights processing peak memory reduction for nvfp4 MoE layers (#46276 )

2026-07-11 02:05:35 +00:00

test_flashinfer_cutedsl_layout.py

[Kernel] Support Nvfp4 Cutedsl Moe Swiglu-oai and Relu2(non-gated) Activation (#47106 )

2026-08-06 17:42:45 -07:00

test_flashinfer_cutedsl_nvfp4_moe.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_flashinfer_moe.py

Revert "[Bugfix][MoE] Tune FlashInfer experts to scheduler token limit" (#52989 ) (#53186 )

2026-08-21 12:39:28 -06:00

test_flashinfer.py

[CI][Bugfix] Fix MoE reprocess test mock after #57405 's kernel refactor (#57641 )

2026-09-19 21:42:21 +00:00

test_flydsl_moe.py

[ROCm][CI] Stabilize MI355 FlyDSL MoE accuracy test (#53024 )

2026-08-21 13:17:18 -07:00

test_fp8_tp_loading.py

[Qwen3.8-Flash-Next] Enable FP8 TP with FlashInfer TRTLLM MoE (#55867 )

2026-09-17 08:56:28 +00:00

test_fused_topk.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_gemma4router.py

[FEAT] [Perf] [Gemma4] Fused Gemma4 Routing Function Triton (#39083 )

2026-04-19 09:57:39 +00:00

test_gpt_oss_triton_kernels.py

[ROCm][CI] Adapt MoE tests to the triton_kernels 3.8 API (#57385 )

2026-09-17 11:21:22 -05:00

test_grouped_topk.py

[MoE][Bugfix] Skip SP padded rows in grouped MoE routing (#56079 )

2026-09-17 19:36:19 +00:00

test_marlin_vs_trtllm_mxint4.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_modular_kernel_combinations.py

[ROCm][CI] Enable AITER FP8/unquantized cases in modular-kernel sweep + fix MoRI per-tensor FP8 dispatch (#57074 )

2026-09-16 19:53:06 -05:00

test_modular_oai_triton_moe.py

[ROCm][CI] Adapt MoE tests to the triton_kernels 3.8 API (#57385 )

2026-09-17 11:21:22 -05:00

test_moe_align_block_size.py

[Feature][Humming] Humming feature integration (#56685 )

2026-09-20 08:11:01 -07:00

test_moe_fused_mul_sum.py

[Quantization][Humming] Support MXFP4 weight + block-FP8 activation for MoE (#51332 )

2026-08-25 10:21:00 -04:00

test_moe_kernel_oracle.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_moe_layer.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_moe_permute_unpermute.py

[Feature][Humming] Humming feature integration (#56685 )

2026-09-20 08:11:01 -07:00

test_moe_weight_loading_padded.py

[MoE] Encapsulate TRT-LLM BF16 weight layout handling (#57405 )

2026-09-17 17:47:30 -04:00

test_moe.py

[Feature][Humming] Humming feature integration (#56685 )

2026-09-20 08:11:01 -07:00

test_moonep_bf16_poc.py

[Distributed][MoonEP] BF16 integration of MoonEP balanced EP backend (#52101 )

2026-09-18 10:34:01 -04:00

test_mxfp4_moe.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_mxfp8_aiter_backend_selection.py

[ROCm][Bugfix] Gate AITER MXFP8 MoE on the aiter enable flag (#57426 )

2026-09-18 00:06:05 +00:00

test_nvfp4_moe.py

[MoE] Remove inplace fused experts mechanism (#43727 )

2026-05-27 20:00:19 -07:00

test_ocp_mx_moe.py

[Bugfix][ROCm] Reject unsupported EP for monolithic AITER MXFP4 MoE (#57866 )

2026-09-21 15:30:21 -05:00

test_profile_modular_kernel.py

[Bugfix] Fix broken profile_modular_kernel.py (#43300 )

2026-06-11 12:17:23 +01:00

test_rocm_aiter_moe.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_rocm_aiter_topk.py

[MoE] Move various experts classes to fused_moe/experts/ (#41979 )

2026-05-11 07:54:33 +08:00

test_routed_experts_capture_monolithic.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_routing_simulator.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_routing.py

[MoE][Bugfix] Skip SP padded rows in grouped MoE routing (#56079 )

2026-09-17 19:36:19 +00:00

test_shared_fused_moe_routed_transform.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_silu_mul_fp8_quant_deep_gemm.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_silu_mul_per_token_group_quant_fp8_colmajor.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_situ_mul_fp8_quant.py

[MoE] Generalize masked activation for padded layouts (#51217 )

2026-09-01 11:34:13 -04:00

test_topk_softplus_sqrt.py

[Bugfix][MoE] Reject hash routing for unsupported monolithic backends (#57867 )

2026-09-21 16:28:35 -04:00

test_triton_moe_no_act_mul.py

[XPU][Tests] Make tests device-agnostic (#51968 )

2026-08-20 02:25:41 -07:00

test_triton_moe_ptpc_fp8.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_trtllm_bf16_moe.py

[MoE] Encapsulate TRT-LLM BF16 weight layout handling (#57405 )

2026-09-17 17:47:30 -04:00

test_trtllm_nvfp4_moe.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_unquantized_backend_selection.py

[Bugfix][ROCm][MoE] Fall back instead of crashing when AITER MoE is requested for a non-gated (is_act_and_mul=False) model (#56590 )

2026-09-17 13:39:26 +00:00

test_zen_cpu_fused_moe.py

[Model] Add DeepSeek-V4 CPU backend (#55355 )

2026-09-10 14:14:48 +08:00

test_zen_cpu_int8_moe.py

[Model] Add DeepSeek-V4 CPU backend (#55355 )

2026-09-10 14:14:48 +08:00

test_zero_expert_moe.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

utils.py

[ROCm][CI] Adapt MoE tests to the triton_kernels 3.8 API (#57385 )

2026-09-17 11:21:22 -05:00