[ROCm][Perf] Support N=5 in wvSplitK skinny GEMM kernels for speculative decoding (#40687)

Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
This commit is contained in:
Matthias Gehre
2026-05-28 16:28:21 +00:00
committed by GitHub
parent 4bfa0f2b14
commit a9ec46d4b7
2 changed files with 7 additions and 1 deletions
+1 -1
View File
@@ -178,7 +178,7 @@ def rocm_unquantized_gemm_impl(
if use_skinny:
x_view = x.reshape(-1, x.size(-1))
if m > 8 and 0 < n <= 4:
if m > 8 and 0 < n <= 5:
cu_count = num_compute_units()
out = ops.wvSplitK(weight, x_view, cu_count, bias)
return out.reshape(*x.shape[:-1], weight.shape[0])