[CI/Build][BugFix][The Rock] Make supports_mm_prefix return False for ROCm attn and unified attn since Prefix-LM not implemented (#52395)
Signed-off-by: Randall Smith <Randall.Smith@amd.com> Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com> Co-authored-by: Andreas Karatzas <akaratza@amd.com>
This commit is contained in:
co-authored by
mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Andreas Karatzas
parent
e03875f4d2
commit
8a497d7557
@@ -83,7 +83,8 @@ class RocmAiterUnifiedAttentionBackend(RocmAttentionBackend):
|
||||
|
||||
@classmethod
|
||||
def supports_mm_prefix(cls) -> bool:
|
||||
return True
|
||||
# Not implemented
|
||||
return False
|
||||
|
||||
@classmethod
|
||||
def supports_sink(cls) -> bool:
|
||||
|
||||
@@ -193,7 +193,8 @@ class RocmAttentionBackend(AttentionBackend):
|
||||
|
||||
@classmethod
|
||||
def supports_mm_prefix(cls) -> bool:
|
||||
return True
|
||||
# Not implemented
|
||||
return False
|
||||
|
||||
@classmethod
|
||||
def supports_sink(cls) -> bool:
|
||||
|
||||
Reference in New Issue
Block a user