[ROCm][Bugfix] Pass num_kv_splits to aiter mla_reduce_v1 (#46760)

Signed-off-by: Rohan Potdar <rohanpotdar138@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This commit is contained in:
Rohan Potdar
2026-06-26 21:58:40 +00:00
committed by GitHub
co-authored by Claude Opus 4.8
parent 75fdcc82a5
commit 2ff76a5e85
@@ -828,6 +828,9 @@ class AiterMLAImpl(MLACommonImpl[AiterMLAMetadata]):
attn_metadata.fp8_prefill_reduce_final_map,
attn_metadata.fp8_prefill_reduce_partial_map,
tile_q,
# num_kv_splits added by ROCm/aiter#3391; 0 selects the kernel
# default max(cu_num, 0) == cu_num, matching pre-#3391 behavior.
0,
out_3d,
final_lse,
)