[Doc]: fix typos in Python comments (#24042)
Signed-off-by: Didier Durand <durand.didier@gmail.com> Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
This commit is contained in:
co-authored by
Jee Jee Li
parent
a344a5aa0a
commit
0235103cbb
+1
-1
@@ -1193,7 +1193,7 @@ class HiddenStates(msgspec.Struct, array_like=True,
|
||||
seq_ids are the sequence ids of each entry of the batch
|
||||
dimension of the hidden_states tensor"""
|
||||
# Scorer hidden states. For prefill step, it is used for hidden states of
|
||||
# all tokens, whereas for decode step, it use used for last accepted tokens.
|
||||
# all tokens, whereas for decode step, it is used for last accepted tokens.
|
||||
hidden_states: torch.Tensor
|
||||
# The sequence group metadata list. Only needed for decode step.
|
||||
seq_group_metadata_list: Optional[list[SequenceGroupMetadata]] = None
|
||||
|
||||
Reference in New Issue
Block a user