[Bugfix][OpenAI] Fix streamed completion logprob offsets with echo (#47815)

Signed-off-by: Ting Sun <suntcrick@gmail.com>
2026-08-27 18:19:07 +08:00
parent acd0af90e8
commit 50708f95ae
1 changed files with 1 additions and 1 deletions
@@ -395,7 +395,7 @@ class OpenAIServingCompletion(GenerateBaseServing):
                    else:
                        logprobs = None

-                    previous_text_lens[i] += len(output.text)
+                    previous_text_lens[i] += len(delta_text)
                    previous_num_tokens[i] += len(output.token_ids)
                    finish_reason = output.finish_reason
                    stop_reason = output.stop_reason