[Doc] Document /inference/v1/generate request/response fields and DP rank header (#62305)

Signed-off-by: aoshen02 <aoshen@inferact.ai> Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-18 15:26:36 +00:00
parent e80b6c642f
commit fe8f2140ee
3 changed files with 49 additions and 4 deletions
@@ -3,6 +3,8 @@
 """Call a token-in/token-out server started with:

 vllm serve Qwen/Qwen3-0.6B --enable-scale-out
+
+Fields and DP rank routing: docs/serving/online_serving/token_in_token_out.md
 """

 import httpx