[Responses] Add tool_choice/tools validation to match OpenAI behavior (#40399)

Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
This commit is contained in:
Flora Feng
2026-04-22 22:46:10 -07:00
committed by GitHub
co-authored by mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
parent 98a242ff61
commit 8317cedc77
3 changed files with 227 additions and 2 deletions
+3 -2
View File
@@ -718,9 +718,10 @@ class OpenAIServingResponses(OpenAIServing):
request: ResponsesRequest,
prev_response: ResponsesResponse | None,
):
if request.tool_choice != "auto":
if request.tool_choice not in ("auto", "none"):
raise NotImplementedError(
"Only 'auto' tool_choice is supported in response API with Harmony"
"Only 'auto' or 'none' tool_choice is supported "
"in response API with Harmony"
)
arrival_time = time.time()