[Docs] List additional unauthenticated endpoints (#61081)
Signed-off-by: Jimmy Wang <53066820+JimmyWang0417@users.noreply.github.com> Co-authored-by: Juan Pérez de Algaba <124347725+jperezdealgaba@users.noreply.github.com>
This commit is contained in:
co-authored by
Juan Pérez de Algaba
parent
5a09062632
commit
2534a96fcf
@@ -208,9 +208,13 @@ The following endpoints **do not require authentication** even when `--api-key`
|
||||
- `/update_weights` - Update model weights (can alter model behavior)
|
||||
- `/get_world_size` - Get distributed world size
|
||||
- `/abort_requests` - Abort in-flight requests (available with `--tokens-only`. Use the authenticated `/inference/v1/abort_requests` otherwise)
|
||||
- `/fault_tolerance/apply` - Trigger fault-recovery operations across ranks (available when fault tolerance is enabled)
|
||||
- `/fault_tolerance/status` - Query fault-recovery status (available when fault tolerance is enabled)
|
||||
|
||||
**Utility endpoints:**
|
||||
|
||||
- `/metrics` - Prometheus metrics, including model, throughput, queue, and KV-cache statistics
|
||||
- `/kv_event_sources` - KV-event publisher configuration for each data-parallel rank, which may reveal internal transport endpoints (when KV events are configured)
|
||||
- `/tokenize` - Tokenize text (not gated by `--enable-scale-out`)
|
||||
- `/detokenize` - Detokenize tokens
|
||||
- `/health` - Health check
|
||||
|
||||
Reference in New Issue
Block a user