[Bugfix][Frontend] Do not modify caller params in LLM.score() (#59959)
Signed-off-by: 叮当猫 <2756823972@qq.com> Signed-off-by: apex-mochen <2756823972@qq.com> Co-authored-by: DeepSeek Harness <noreply@deepseek.com> Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com> Co-authored-by: Codex <noreply@openai.com>
This commit is contained in:
co-authored by
DeepSeek Harness
Taneem Ibrahim
Codex
parent
9e3e37cb3c
commit
2dd887426e
@@ -362,6 +362,8 @@ class PoolingOfflineMixin(OfflineInferenceMixin):
|
||||
|
||||
assert isinstance(pooling_params, PoolingParams)
|
||||
pooling_task = io_processor.pooling_task
|
||||
# Clone to avoid modifying the caller's pooling parameters.
|
||||
pooling_params = pooling_params.clone()
|
||||
if pooling_params.task is None:
|
||||
pooling_params.task = pooling_task
|
||||
elif pooling_params.task != pooling_task:
|
||||
|
||||
Reference in New Issue
Block a user