[Responses] Add tool_choice/tools validation to match OpenAI behavior (#40399)
Signed-off-by: sfeng33 <4florafeng@gmail.com> Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
This commit is contained in:
co-authored by
mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
parent
98a242ff61
commit
8317cedc77
@@ -718,9 +718,10 @@ class OpenAIServingResponses(OpenAIServing):
|
||||
request: ResponsesRequest,
|
||||
prev_response: ResponsesResponse | None,
|
||||
):
|
||||
if request.tool_choice != "auto":
|
||||
if request.tool_choice not in ("auto", "none"):
|
||||
raise NotImplementedError(
|
||||
"Only 'auto' tool_choice is supported in response API with Harmony"
|
||||
"Only 'auto' or 'none' tool_choice is supported "
|
||||
"in response API with Harmony"
|
||||
)
|
||||
|
||||
arrival_time = time.time()
|
||||
|
||||
Reference in New Issue
Block a user