[Doc] Add documentation for offline API docs feature (#32134)
Signed-off-by: rickychen-infinirc <ricky.chen@infinirc.com>
This commit is contained in:
@@ -173,6 +173,14 @@ with `--enable-request-id-headers`.
|
|||||||
print(completion._request_id)
|
print(completion._request_id)
|
||||||
```
|
```
|
||||||
|
|
||||||
|
## Offline API Documentation
|
||||||
|
|
||||||
|
The FastAPI `/docs` endpoint requires an internet connection by default. To enable offline access in air-gapped environments, use the `--enable-offline-docs` flag:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
vllm serve NousResearch/Meta-Llama-3-8B-Instruct --enable-offline-docs
|
||||||
|
```
|
||||||
|
|
||||||
## API Reference
|
## API Reference
|
||||||
|
|
||||||
### Completions API
|
### Completions API
|
||||||
|
|||||||
Reference in New Issue
Block a user