[ROCm][Bugfix] Pass num_kv_splits to aiter mla_reduce_v1 (#46760)
Signed-off-by: Rohan Potdar <rohanpotdar138@gmail.com> Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This commit is contained in:
co-authored by
Claude Opus 4.8
parent
75fdcc82a5
commit
2ff76a5e85
@@ -828,6 +828,9 @@ class AiterMLAImpl(MLACommonImpl[AiterMLAMetadata]):
|
||||
attn_metadata.fp8_prefill_reduce_final_map,
|
||||
attn_metadata.fp8_prefill_reduce_partial_map,
|
||||
tile_q,
|
||||
# num_kv_splits added by ROCm/aiter#3391; 0 selects the kernel
|
||||
# default max(cu_num, 0) == cu_num, matching pre-#3391 behavior.
|
||||
0,
|
||||
out_3d,
|
||||
final_lse,
|
||||
)
|
||||
|
||||
Reference in New Issue
Block a user