Fangzhou AiandCursor Agent 77e8b02c8d [ROCm][Perf] Add opt-in a4w4 (FP4 activation) MoE for DeepSeek V4.1 on AITER (#58819) ...

Signed-off-by: fai <fangzhouai@gmail.com>
Signed-off-by: Fangzhou Ai <31551580+Fangzhou-Ai@users.noreply.github.com>
Co-authored-by: Cursor Agent (Claude Sonnet 5) <cursoragent@cursor.com>

2026-09-30 15:07:44 +08:00

..

modular_kernel_tools

[Refactor] Remove dead tests utils (#58803)

2026-09-26 09:16:53 -04:00

__init__.py

[Kernel] DeepEP dispatch-combine kernel integration (#18434)

2025-06-03 12:30:02 -07:00

conftest.py

[Bugfix][MoE] Reject hash routing for unsupported monolithic backends (#57867)

2026-09-21 16:28:35 -04:00

parallel_utils.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_b12x.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_batched_deepgemm.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_batched_moe.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_block_fp8.py

[Perf][MoE] Skip top-k slots routed to non-local experts in TritonExp… (#58051)

2026-09-23 21:03:21 +08:00

test_block_int8.py

[ROCm] Fix CI runtime and tests for MI355 DPX (#58244)

2026-09-24 23:15:11 -05:00

test_count_expert_num_tokens.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_cpu_fused_moe.py

[HARDWARE][POWER] Enable W8A8 INT8 MoE on POWER (#55316)

2026-09-17 21:45:13 +08:00

test_cpu_int4_moe.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_cpu_quant_fused_moe.py

[CPU] Add CPU FP8 W8A8 linear/MoE support (#49942)

2026-09-18 17:59:42 +08:00

test_cutedsl_moe.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_cutlass_moe.py

[Bugfix] Handle padded routes in CUTLASS MoE permutations (#54747)

2026-09-01 19:08:17 -07:00

test_deepep_deepgemm_moe.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_deepep_moe.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_deepep_v2_async_finalize.py

[Kernel][MoE] DeepEP v2: async finalize to overlap shared experts with combine (#52781)

2026-09-15 00:04:22 -04:00

test_deepep_v2_moe.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_deepgemm.py

[BugFxi] Fix DeepGEMM FP8 workspace over allocation (#53914)

2026-09-17 09:35:34 -04:00

test_flashinfer_b12x_moe.py

[BugFix] weights processing peak memory reduction for nvfp4 MoE layers (#46276)

2026-07-11 02:05:35 +00:00

test_flashinfer_cutedsl_layout.py

[Kernel] Support Nvfp4 Cutedsl Moe Swiglu-oai and Relu2(non-gated) Activation (#47106)

2026-08-06 17:42:45 -07:00

test_flashinfer_cutedsl_nvfp4_moe.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_flashinfer_moe.py

Revert "[Bugfix][MoE] Tune FlashInfer experts to scheduler token limit" (#52989) (#53186)

2026-08-21 12:39:28 -06:00

test_flashinfer.py

[Perf][MoE] Use fused MiniMax2 routing with non-unit routed scaling (#58880)

2026-09-27 19:37:33 +00:00

test_flydsl_moe.py

[ROCm][CI] Stabilize MI355 FlyDSL MoE accuracy test (#53024)

2026-08-21 13:17:18 -07:00

test_fp8_tp_loading.py

[Qwen3.8-Flash-Next] Enable FP8 TP with FlashInfer TRTLLM MoE (#55867)

2026-09-17 08:56:28 +00:00

test_fused_topk.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_gemma4router.py

[FEAT] [Perf] [Gemma4] Fused Gemma4 Routing Function Triton (#39083)

2026-04-19 09:57:39 +00:00

test_gpt_oss_triton_kernels.py

[ROCm][CI] Adapt MoE tests to the triton_kernels 3.8 API (#57385)

2026-09-17 11:21:22 -05:00

test_grouped_topk.py

[MoE][Bugfix] Skip SP padded rows in grouped MoE routing (#56079)

2026-09-17 19:36:19 +00:00

test_marlin_vs_trtllm_mxint4.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_modular_kernel_combinations.py

[ROCm][CI][AITER Coverage] Harden MoE sorting-backend/dispatch env-var test matrix (#58393)

2026-09-24 21:14:02 -05:00

test_modular_oai_triton_moe.py

[ROCm][CI] Adapt MoE tests to the triton_kernels 3.8 API (#57385)

2026-09-17 11:21:22 -05:00

test_moe_align_block_size.py

[Feature][Humming] Humming feature integration (#56685)

2026-09-20 08:11:01 -07:00

test_moe_fused_mul_sum.py

[Quantization][Humming] Support MXFP4 weight + block-FP8 activation for MoE (#51332)

2026-08-25 10:21:00 -04:00

test_moe_kernel_oracle.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_moe_layer.py

[Refactor] Remove dead tests utils (#58803)

2026-09-26 09:16:53 -04:00

test_moe_permute_unpermute.py

[Feature][Humming] Humming feature integration (#56685)

2026-09-20 08:11:01 -07:00

test_moe_weight_loading_padded.py

[Perf][MoE] Index expert mapping lookups in RoutedExperts.load_weights (#58720)

2026-09-26 06:48:24 -07:00

test_moe.py

[Feature][Humming] Humming feature integration (#56685)

2026-09-20 08:11:01 -07:00

test_moonep_bf16_poc.py

[Distributed][MoonEP] BF16 integration of MoonEP balanced EP backend (#52101)

2026-09-18 10:34:01 -04:00

test_mori_moe.py

[ROCm][CI] Add MI355 dense NVFP4 and MoRI kernel mirrors (#58281)

2026-09-23 03:06:15 -05:00

test_mori_prepare_finalize.py

[ROCm] Upgrade MoRI version on rocm dockers required for WideEP DP16 DI CI enablement and fixes for combine API (#56073)

2026-09-29 18:07:31 +00:00

test_mxfp4_moe.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_mxfp8_aiter_backend_selection.py

[ROCm][Bugfix] Gate AITER MXFP8 MoE on the aiter enable flag (#57426)

2026-09-18 00:06:05 +00:00

test_nvfp4_moe.py

[MoE] Remove inplace fused experts mechanism (#43727)

2026-05-27 20:00:19 -07:00

test_ocp_mx_moe.py

[ROCm] Bump AITER to v0.1.23 (#58867)

2026-09-27 19:04:58 -05:00

test_profile_modular_kernel.py

[Bugfix] Fix broken profile_modular_kernel.py (#43300)

2026-06-11 12:17:23 +01:00

test_rocm_aiter_moe.py

[ROCm][Perf] Add opt-in a4w4 (FP4 activation) MoE for DeepSeek V4.1 on AITER (#58819)

2026-09-30 15:07:44 +08:00

test_rocm_aiter_topk.py

[MoE] Move various experts classes to fused_moe/experts/ (#41979)

2026-05-11 07:54:33 +08:00

test_routed_experts_capture_monolithic.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_routing_simulator.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_routing.py

[Perf][MoE] Use fused MiniMax2 routing with non-unit routed scaling (#58880)

2026-09-27 19:37:33 +00:00

test_shared_fused_moe_routed_transform.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_silu_mul_fp8_quant_deep_gemm.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_silu_mul_per_token_group_quant_fp8_colmajor.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_situ_mul_fp8_quant.py

[MoE] Generalize masked activation for padded layouts (#51217)

2026-09-01 11:34:13 -04:00

test_topk_softplus_sqrt.py

Revert "[DSpark] Support pipeline-parallel targets in aggregated serving (#56956)" (#58484)

2026-09-24 08:48:36 -07:00

test_triton_moe_no_act_mul.py

[XPU][Tests] Make tests device-agnostic (#51968)

2026-08-20 02:25:41 -07:00

test_triton_moe_ptpc_fp8.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_trtllm_bf16_moe.py

[MoE] Encapsulate TRT-LLM BF16 weight layout handling (#57405)

2026-09-17 17:47:30 -04:00

test_trtllm_nvfp4_moe.py

[MoE] Defer the TRTLLM-Gen top-k finalize on the modular path (#58635)

2026-09-25 15:38:29 +08:00

test_unquantized_backend_selection.py

[Bugfix][ROCm][MoE] Fall back instead of crashing when AITER MoE is requested for a non-gated (is_act_and_mul=False) model (#56590)

2026-09-17 13:39:26 +00:00

test_zen_cpu_fused_moe.py

[Model] Add DeepSeek-V4 CPU backend (#55355)

2026-09-10 14:14:48 +08:00

test_zen_cpu_int8_moe.py

[Model] Add DeepSeek-V4 CPU backend (#55355)

2026-09-10 14:14:48 +08:00

test_zero_expert_moe.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

utils.py

[Refactor] Remove dead tests code (#58916)

2026-09-30 04:39:03 +00:00