[ROCm][Cleanup] Remove stale AITER FA hybrid KV-cache TODO (#44178)
Signed-off-by: Tuukka Sarvi <tuukka.sarvi@amd.com> Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
This commit is contained in:
co-authored by
Cyrus Leung
parent
eb04c769d3
commit
3d34f8cbdc
@@ -1408,8 +1408,6 @@ class AiterFlashAttentionImpl(AttentionImpl):
|
||||
assert k_scale is not None and v_scale is not None, (
|
||||
"k_scale and v_scale are required for shuffled update"
|
||||
)
|
||||
# TODO: Add correct KV cache handling for hybrid model. KV cache
|
||||
# may not be contiguous if mamba state exists.
|
||||
reshape_and_cache_shuffle_triton(
|
||||
key,
|
||||
value,
|
||||
|
||||
Reference in New Issue
Block a user