Replace "online inference" with "online serving" (#11923)

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
This commit is contained in:
Harry Mellor
2025-01-10 12:05:56 +00:00
committed by GitHub
parent ef725feafc
commit d85c47d6ad
11 changed files with 16 additions and 16 deletions
@@ -1,5 +1,5 @@
"""An example showing how to use vLLM to serve multimodal models
and run online inference with OpenAI client.
and run online serving with OpenAI client.
Launch the vLLM server with the following command:
@@ -309,7 +309,7 @@ def main(args) -> None:
if __name__ == "__main__":
parser = FlexibleArgumentParser(
description='Demo on using OpenAI client for online inference with '
description='Demo on using OpenAI client for online serving with '
'multimodal language models served with vLLM.')
parser.add_argument('--chat-type',
'-c',