[Bugfix] Fix repeated DSv4 RoPE cache initialization (#41148)
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
This commit is contained in:
co-authored by
gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
parent
11b69129e2
commit
9d8ad5b408
@@ -1027,7 +1027,6 @@ class DeepseekV4Attention(nn.Module):
|
||||
max_position=self.max_position_embeddings,
|
||||
rope_parameters=rope_parameters,
|
||||
is_neox_style=False,
|
||||
dtype=config.torch_dtype,
|
||||
)
|
||||
|
||||
self.indexer = None
|
||||
|
||||
Reference in New Issue
Block a user