Seiji Eicher 6370e53f24 [Frontend] Reuse prefill token ids on the decode chat path for disaggregated serving (#48145) ...

Signed-off-by: Seiji Eicher <seiji@anyscale.com>

2026-07-29 10:02:57 +02:00

..

__init__.py

…

test_batched_chat_completions.py

…

test_chat_completion_with_prompt_embeds.py

…

test_chat_completion.py

[Frontend] Reuse prefill token ids on the decode chat path for disaggregated serving (#48145)

2026-07-29 10:02:57 +02:00

test_chat_echo.py

…

test_chat_error.py

…

test_chat_logit_bias_validation.py

…

test_chat.py

…

test_completion_with_function_calling.py

…

test_enable_force_include_usage.py

…

test_extra_content_fields.py

…

test_include_reasoning.py

…

test_logprob_token_ids.py

…

test_root_path.py

…

test_serving_chat.py

[Frontend] Reuse prefill token ids on the decode chat path for disaggregated serving (#48145)

2026-07-29 10:02:57 +02:00

test_thinking_token_budget_validation.py

…

test_thinking_token_budget.py

…