Jack HuandDouglas Lehr ef38e8d006 [Model][Hardware][AMD][Kernel] Part 2/2 -> Enable e2e QK Norm + RoPE + KV Cache runtime fusion for Qwen3-30B-A3B on ROCM_ATTN (#42755) ...

Signed-off-by: Jack Hu <Jack.Hu@amd.com>
Signed-off-by: Jack Hu <jingxujaster@hotmail.com>
Signed-off-by: Jack Hu <jack.hu@amd.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>

2026-10-15 17:10:14 -07:00

..

attention

[Model][Hardware][AMD][Kernel] Part 2/2 -> Enable e2e QK Norm + RoPE + KV Cache runtime fusion for Qwen3-30B-A3B on ROCM_ATTN (#42755)

2026-10-15 17:10:14 -07:00

core

[Qwen4Exp] support Sequence Parallelism for Qwen3.8-Flash-Next (#56322)

2026-10-12 20:56:44 +08:00

fla

[Perf] Tune Triton GDN decode tiles on SM100-family GPUs (#61355)

2026-10-13 17:01:12 +08:00

helion

[MyPy][3/N] Fix MyPy errors in test groups (part 3) (#55939)

2026-09-30 11:06:07 +00:00

ir

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

mamba

[ROCm][Perf] Make AITER FlyDSL GDN prefill default on gfx942/gfx950 (#60645)

2026-10-14 10:11:57 +00:00

mhc

[Test] Allow one bf16 ulp in the fused mHC post/pre residual check (#60724)

2026-10-09 17:54:06 -05:00

moe

[ROCm] gfx1250 optimizations and model enablement (#58800)

2026-10-15 14:51:57 -07:00

quantization

[ROCm][Perf][Bugfix] Probe the preshuffled FP4 GEMM config by logical K (#59406)

2026-10-15 21:11:33 +00:00

scripts

[CI/Build][ROCm] Run the TileLang HIP symbol checks in their own interpreter (#53117)

2026-08-21 16:17:42 -05:00

turboquant

[Kernel][ROCm][Perf] FlyDSL decode-attention kernel for 4-bit TurboQuant KV cache (#47896)

2026-08-11 08:45:39 -07:00

ultraquant

[Attention] Add UltraQuant 4-bit KV cache backend (FlyDSL D=256) (#57057)

2026-10-06 20:42:52 +00:00

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

allclose_default.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

conftest.py

[CI] Fix stale/fragile untethered kernels-root tests (#49423)

2026-07-22 14:43:07 -06:00

quant_utils.py

[Refactor] Remove dead tests utils (#58803)

2026-09-26 09:16:53 -04:00

test_apply_repetition_penalties.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_awq_int4_to_int8.py

[CPU][Whisper] Support W4A16 quantized Whisper on the CPU WNA16 kernel (#58268)

2026-09-30 13:52:53 +08:00

test_bf16_skinny_gemm.py

[Misc] Consolidate csrc shared headers and prune dead code (#60721)

2026-10-12 09:46:22 -07:00

test_bf16x3_router_gemm_cutedsl.py

[Perf] Improve BF16x3 router GEMM accuracy and make it default on sm100 (#55899)

2026-09-09 07:33:12 -07:00

test_bf16x3_router_gemm_rocm.py

[ROCm][Perf] Use a stacked hipBLASLt GEMM for the bf16x3 router (#52668)

2026-10-05 17:28:07 +00:00

test_cache_kernels.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_compressor_kv_cache.py

[Kernel][DSv4.1] Bump FlashMLA to the 2026.09.30 release and its interleaved V4.1 KV cache (#61371)

2026-10-15 13:58:25 -07:00

test_concat_mla_q.py

[Bugfix][ROCm] Use the platform FP8 range in the concat MLA q test (#58153)

2026-09-22 18:05:33 -05:00

test_cp_gather_fp8.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_cpu_fused_sampling.py

[Bugfix][CPU] Fix fused Gumbel-max wrapping-window bias (#60221)

2026-10-08 15:15:53 +08:00

test_deepseek_v4_cpu_kernels.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_dsv41_mega_attn_layouts.py

[Model][DeepSeek-V4.1] Permute mega-attention wq_b / wo_a while loading (#60064)

2026-10-06 05:20:09 +00:00

test_engram.py

[Perf][DSv4.1] Exchange packed FP8 Engram rows across DP and feed wkv MXFP8 (#59923)

2026-10-09 15:30:18 +08:00

test_flashinfer_bf16_gemm.py

[Kernel] Remove WAR for LL CuTeDSL BF16 GEMM (#60434)

2026-10-08 05:38:07 +00:00

test_flex_attention.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_fp32_router_gemm.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_fused_deepseek_v4_qnorm_rope_kv_insert.py

[Kernel][DSv4.1] Bump FlashMLA to the 2026.09.30 release and its interleaved V4.1 KV cache (#61371)

2026-10-15 13:58:25 -07:00

test_fused_deepseek_v32_norm_rope.py

[Kernel][Build] Bump DeepGEMM to the 26/09/30 release and adapt the sparse indexer (#61149)

2026-10-12 23:24:43 -07:00

test_fused_indexer_q_rope_quant.py

[Kernel][Build] Bump DeepGEMM to the 26/09/30 release and adapt the sparse indexer (#61149)

2026-10-12 23:24:43 -07:00

test_fused_inv_rope_fp8_quant.py

[Perf][DSv4.1] Fuse small-batch WO-A with inverse RoPE and MXFP8 quant on SM100/SM103 (#58634)

2026-09-26 21:16:12 -07:00

test_fused_minimax_m3_qknorm_rope_kv_insert.py

[Attention][MiniMax-M3] NVFP4 KV cache on the MSA sparse attention path (#59300)

2026-10-01 14:39:55 -07:00

test_fused_qk_norm_rope_gate.py

[Kernel][Perf] Enable fused QK-norm + partial MRoPE + gate for Qwen3.6 (#52676)

2026-08-24 18:28:49 -07:00

test_fused_quant_activation.py

[Fusion] Support 3D activation quantization fusion and enable it for Pixtral (#59612)

2026-10-09 15:12:03 +08:00

test_gate_linear_rocm_dispatch.py

[ROCm][Perf] Use a stacked hipBLASLt GEMM for the bf16x3 router (#52668)

2026-10-05 17:28:07 +00:00

test_gemm_rs_ar.py

[Kernel][DSV4.1] Fuse MXFP8 wo_b GEMM with sequence-parallel reduce-scatter (#57428)

2026-09-22 01:07:17 -07:00

test_kpool_decode_update_batched.py

[Kernel][Build] Bump DeepGEMM to the 26/09/30 release and adapt the sparse indexer (#61149)

2026-10-12 23:24:43 -07:00

test_ll_bf16_gemm.py

[Kimi-K3][Perf] Prefetch ll_bf16 router weights for M=1 (#53524)

2026-09-01 21:40:19 +00:00

test_ll_fp32w_gemm.py

[Perf][Feat] Add generic cuteDSL LL FP32 router (GEMM) (#44343)

2026-10-13 12:38:46 -04:00

test_minimax_m3_amd_ops.py

[Bugfix][Quantization] Fix MXFP8 startup crash on layers below mm_mxfp8 shape limits (#54223)

2026-09-25 02:54:11 +00:00

test_minimax_m3_sparse_attn_fp8_scale.py

[ROCm][MiniMax-M3] Add AITER sparse paged attention (#47287)

2026-07-12 19:27:29 -07:00

test_onednn.py

[CPU] Speedup LM Head on Arm CPUs (#55352)

2026-09-11 16:21:14 +08:00

test_relu2_fp8_quant.py

[Perf][Kernel][Quantization] Fuse ReLU2 with static FP8 activation quantization (#53793)

2026-09-14 10:26:15 -07:00

test_rocm_fp32_router_gemm.py

[ROCm][Perf] Add low-M FP32 router GEMM for gfx950 (#54845)

2026-09-03 10:42:25 -07:00

test_rocm_gemm_rs_ar.py

[ROCm][CI] Mirror generic GEMM-RS/AR on MI355 (#58433)

2026-09-29 10:28:15 +00:00

test_shuffle_rows.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_top_k_per_row.py

[ROCm][Perf][GLM-5.3-Flash] Add AITER topk backend for decodes (#58167)

2026-10-02 11:47:41 +01:00

utils.py

[Refactor] Remove dead tests utils (#58803)

2026-09-26 09:16:53 -04:00