[Docs] List additional unauthenticated endpoints (#61081)

Signed-off-by: Jimmy Wang <53066820+JimmyWang0417@users.noreply.github.com>
Co-authored-by: Juan Pérez de Algaba <124347725+jperezdealgaba@users.noreply.github.com>
This commit is contained in:
Jimmy Wang
2026-10-12 11:47:52 +02:00
committed by GitHub
co-authored by Juan Pérez de Algaba
parent 5a09062632
commit 2534a96fcf
+4
View File
@@ -208,9 +208,13 @@ The following endpoints **do not require authentication** even when `--api-key`
- `/update_weights` - Update model weights (can alter model behavior)
- `/get_world_size` - Get distributed world size
- `/abort_requests` - Abort in-flight requests (available with `--tokens-only`. Use the authenticated `/inference/v1/abort_requests` otherwise)
- `/fault_tolerance/apply` - Trigger fault-recovery operations across ranks (available when fault tolerance is enabled)
- `/fault_tolerance/status` - Query fault-recovery status (available when fault tolerance is enabled)
**Utility endpoints:**
- `/metrics` - Prometheus metrics, including model, throughput, queue, and KV-cache statistics
- `/kv_event_sources` - KV-event publisher configuration for each data-parallel rank, which may reveal internal transport endpoints (when KV events are configured)
- `/tokenize` - Tokenize text (not gated by `--enable-scale-out`)
- `/detokenize` - Detokenize tokens
- `/health` - Health check