[Bugfix] add support for 'num_attention_groups' in ModelArchConfigConvertorBase for Step3p5 (#39796)

Signed-off-by: realliujiaxu <realliujiaxu@163.com>
This commit is contained in:
realliujiaxu
2026-04-16 05:48:00 +00:00
committed by GitHub
parent 4b7ca37bd4
commit 7845379230
3 changed files with 20 additions and 0 deletions
@@ -77,6 +77,8 @@ class ModelArchConfigConvertorBase:
"num_key_value_heads",
# For ChatGLM:
"multi_query_group_num",
# For Step3p5:
"num_attention_groups",
]
# For non-grouped-query attention models, the number of KV heads is
# equal to the number of attention heads.