[BugFix] fix some typos found by typos. (#16314)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
This commit is contained in:
@@ -83,8 +83,8 @@ spda_o = scaled_dot_product_attention(
|
||||
return spda_o @ W_O
|
||||
|
||||
NOTE: in the actual code,
|
||||
`kv_b_proj` is [W_UK; W_UV] concatnated per head
|
||||
`q_b_proj` is [W_UQ; W_QR] concatnated per head
|
||||
`kv_b_proj` is [W_UK; W_UV] concatenated per head
|
||||
`q_b_proj` is [W_UQ; W_QR] concatenated per head
|
||||
`out_proj` is W_O
|
||||
|
||||
|
||||
@@ -667,7 +667,7 @@ class MLACommonMetadata(AttentionMetadata):
|
||||
assert num_seqs > num_queries
|
||||
|
||||
if turn_prefills_into_decodes:
|
||||
# When Mutli-Step is enabled with Chunked-Prefill, prefills and
|
||||
# When Multi-Step is enabled with Chunked-Prefill, prefills and
|
||||
# decodes are scheduled together. In the first step, all the
|
||||
# prefills turn into decodes. This update reflects that
|
||||
# conversion.
|
||||
|
||||
Reference in New Issue
Block a user