[Metrics] Add admission rejection metrics (#55812)

Signed-off-by: Thuongvu Ho <thuongvuho@gmail.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@mistral.ai>
This commit is contained in:
Thuongvu Ho
2026-10-12 08:31:07 +00:00
committed by GitHub
co-authored by Nicolò Lucchesi
parent 5bed289707
commit 99b44c7a42
5 changed files with 119 additions and 4 deletions
+1
View File
@@ -30,6 +30,7 @@ In v1, an extensive set of metrics are exposed via a Prometheus-compatible `/met
- `vllm:prompt_tokens_total` (Counter) - Total number of prompt tokens processed.
- `vllm:generation_tokens_total` (Counter) - Total number of generated tokens.
- `vllm:request_success_total` (Counter) - Number of finished requests (by finish reason).
- `vllm:admission_rejections_total` (Counter) - Admission attempts rejected by a queue limit, by reason.
- `vllm:request_prompt_tokens` (Histogram) - Histogram of input prompt token counts.
- `vllm:request_generation_tokens` (Histogram) - Histogram of generation token counts.
- `vllm:time_to_first_token_seconds` (Histogram) - Time to first token (TTFT).