Feature/vllm/input embedding completion api (#17590)

Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Nan2018 <nan@protopia.ai>
Co-authored-by: 临景 <linjing.yx@alibaba-inc.com>
Co-authored-by: Bryce1010 <bryceyx@gmail.com>
Co-authored-by: Andrew Sansom <andrew@protopia.ai>
Co-authored-by: Andrew Sansom <qthequartermasterman@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
This commit is contained in:
Nan Qin
2025-05-18 20:18:05 -07:00
committed by GitHub
co-authored by 临景 Bryce1010 Andrew Sansom Andrew Sansom Cyrus Leung
parent 9da1095daf
commit 221cfc2fea
10 changed files with 637 additions and 40 deletions
+1
View File
@@ -119,6 +119,7 @@ serving/offline_inference
serving/openai_compatible_server
serving/serve_args
serving/multimodal_inputs
serving/prompt_embeds
serving/distributed_serving
serving/metrics
serving/engine_args