[Performance][DSv4] Size dequant gather launch grid by rows (#55061)

Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen524@gmail.com>
This commit is contained in:
aoshen02
2026-09-03 20:06:34 -07:00
committed by GitHub
co-authored by aoshen02
parent a26b71d868
commit 69cf055936
@@ -73,7 +73,12 @@ class DequantGatherKCacheKernel:
),
)
grid = (out.shape[0], 1024, 1)
num_reqs = out.shape[0]
max_rows = out.shape[1] - offset
num_workers = cutlass.max(
1, cutlass.min(cute.ceil_div(max_rows, 4), cute.ceil_div(8192, num_reqs))
)
grid = (num_reqs, num_workers, 1)
self.kernel(
out,
k_data,