[Model] Support MiMo-7B inference with MTP (#17433)

Signed-off-by: wp-alpha <wangpeng66@xiaomi.com>
Co-authored-by: wangpeng66 <wangpeng66@xiaomi.com>
This commit is contained in:
bwshen-mi
2025-05-12 23:25:33 +00:00
committed by GitHub
co-authored by wangpeng66
parent f065de4e88
commit acee8f48aa
7 changed files with 507 additions and 4 deletions
+5
View File
@@ -592,6 +592,11 @@ Specified using `--task generate`.
* `Zyphra/Zamba2-7B-instruct`, `Zyphra/Zamba2-2.7B-instruct`, `Zyphra/Zamba2-1.2B-instruct`, etc.
*
*
- * `MiMoForCausalLM`
* MiMo
* `XiaomiMiMo/MiMo-7B-RL`, etc.
*
*
:::
:::{note}