[Docs] Update server entrypoint examples (#42077)

Signed-off-by: Ethan Feng <ethan.fengch@gmail.com>
This commit is contained in:
Ethan Feng
2026-05-09 02:03:52 +00:00
committed by GitHub
parent 236bf9d152
commit a43bc34baf
4 changed files with 5 additions and 8 deletions
+1 -2
View File
@@ -62,8 +62,7 @@ The filesystem resolver is installed with vLLM by default and enables loading Lo
3. **Start vLLM server**:
Your base model can be `meta-llama/Llama-2-7b-hf`. Please make sure you set up the Hugging Face token in your env var `export HF_TOKEN=xxx235`.
```bash
python -m vllm.entrypoints.openai.api_server \
--model your-base-model \
vllm serve your-base-model \
--enable-lora
```
+1 -1
View File
@@ -16,7 +16,7 @@ User-set flags take precedence over optimization level defaults.
```bash
# CLI usage
python -m vllm.entrypoints.api_server --model RedHatAI/Llama-3.2-1B-FP8 -O1
vllm serve RedHatAI/Llama-3.2-1B-FP8 -O1
# Python API usage
from vllm.entrypoints.llm import LLM