[ROCm][Bugfix] Sanitize AITER paged-MQA logits before sparse top-k for DeepSeek-V4 (#49714)

Signed-off-by: shen-shanshan <467638484@qq.com>
This commit is contained in:
Shanshan Shen
2026-07-28 11:08:50 -07:00
committed by GitHub
parent 1db989bbf1
commit 6c7e679f04
2 changed files with 65 additions and 0 deletions
@@ -442,6 +442,7 @@ def rocm_fp8_paged_mqa_logits(
KVBlockSize=block_size,
WavePerEU=2,
)
out_logits.nan_to_num_(float("-inf"))
return out_logits
deepgemm_fp8_paged_mqa_logits_stage1 = (
aiter_paged_mqa_logits_module.deepgemm_fp8_paged_mqa_logits_stage1