[Core] Refactor Attention Take 2 (#3462)
This commit is contained in:
+1
-1
@@ -431,7 +431,7 @@ class SequenceGroup:
|
||||
|
||||
|
||||
class SequenceGroupMetadata:
|
||||
"""Metadata for a sequence group. Used to create `InputMetadata`.
|
||||
"""Metadata for a sequence group. Used to create `AttentionMetadata`.
|
||||
|
||||
Args:
|
||||
request_id: The ID of the request.
|
||||
|
||||
Reference in New Issue
Block a user