[Bugfix] Fix Qwen25VL packed_modules_mapping (#23604)

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com> Co-authored-by: Michael Goin <mgoin64@gmail.com>
2025-08-26 01:09:14 -07:00
parent ff77764f86
commit 9b5f64238f
1 changed files with 1 additions and 0 deletions
@@ -853,6 +853,7 @@ class Qwen2_5_VLForConditionalGeneration(nn.Module, SupportsMultiModal,
                                         SupportsQuant):

    packed_modules_mapping = {
+        "qkv_proj": ["q_proj", "k_proj", "v_proj"],
        "gate_up_proj": ["gate_proj", "up_proj"],
    }