[Feature][Frontend] Add DeepSeek-V4 FIM completion rendering (#44229)

Signed-off-by: QwertyJack <7554089+QwertyJack@users.noreply.github.com>
Co-authored-by: QwertyJack <7554089+QwertyJack@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
This commit is contained in:
jack
2026-09-23 13:02:00 +00:00
committed by GitHub
co-authored by QwertyJack Chauncey
parent 157bcb7c48
commit d95a896ea6
5 changed files with 243 additions and 7 deletions
@@ -116,9 +116,7 @@ class OpenAIServingCompletion(GenerateBaseServing):
See https://platform.openai.com/docs/api-reference/completions/create
for the API specification. This API mimics the OpenAI Completion API.
NOTE: Currently we do not support the following feature:
- suffix (the language models we currently support do not support
suffix)
NOTE: suffix is only supported by models that implement FIM rendering.
"""
return await self._with_kv_transfer_rejection_cleanup(
self._create_completion(request, raw_request), request, raw_request