[Misc] Standardize RoPE handling for Qwen2-VL (#9250)

This commit is contained in:
Cyrus Leung
2024-10-16 13:56:17 +08:00
committed by GitHub
parent ed920135c8
commit 7e7eae338d
16 changed files with 102 additions and 200 deletions
+1 -1
View File
@@ -179,7 +179,7 @@ class Phi3SmallSelfAttention(nn.Module):
rope_scaling["factor"] = self.rope_position_scale
else:
rope_scaling = {
"type": "linear",
"rope_type": "linear",
"factor": self.rope_position_scale,
}