[Model][V1] Support Ernie MTP (#22169)
Signed-off-by: zhouchong <zhouchong03@baidu.com> Co-authored-by: zhouchong <zhouchong03@baidu.com>
This commit is contained in:
@@ -77,7 +77,8 @@ class Worker(LocalOrDistributedWorkerBase):
|
||||
"eagle",
|
||||
"deepseek_mtp",
|
||||
"glm4_moe_mtp",
|
||||
"mimo_mtp")) \
|
||||
"mimo_mtp",
|
||||
"ernie_mtp")) \
|
||||
else {"return_hidden_states": True}
|
||||
|
||||
ModelRunnerClass: Type[GPUModelRunnerBase] = ModelRunner
|
||||
|
||||
Reference in New Issue
Block a user