[ROCm][CI][Bugfix] Fix flaky parallel tool-call streaming (test assertion + Mistral/Granite parsers) (#47550)

Signed-off-by: Aakif Nawaz <aakif.nawaz@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
This commit is contained in:
akii96
2026-07-06 19:06:19 -04:00
committed by GitHub
co-authored by Andreas Karatzas
parent 8484ca5d45
commit 5769a7382c
6 changed files with 141 additions and 46 deletions
+4 -6
View File
@@ -115,14 +115,12 @@ async def test_parallel_tool_calls(
assert not role_name or role_name == "assistant"
role_name = "assistant"
# if a tool call is streamed make sure there's exactly one
# (based on the request parameters
# a chunk may carry >1 tool-call delta at a parallel-call boundary
streamed_tool_calls = chunk.choices[0].delta.tool_calls
if streamed_tool_calls and len(streamed_tool_calls) > 0:
# make sure only one diff is present - correct even for parallel
assert len(streamed_tool_calls) == 1
tool_call = streamed_tool_calls[0]
for tool_call in streamed_tool_calls or []:
# deltas arrive in non-decreasing index order
assert tool_call.index >= tool_call_idx
# if a new tool is being called, set up empty arguments
if tool_call.index != tool_call_idx: