Guy StoneandClaude Fable 5 37d6174096 [Metrics] Add --custom-histogram-buckets to override histogram bucket families (#48867) ...

The core engine histograms ship with default bucket boundaries tuned for
typical serving workloads. The `--custom-histogram-buckets` option replaces
the boundaries of one or more bucket families. Use it, for example, to track
sub-300ms latency SLOs with the request-phase histograms, whose smallest
default boundary is 0.3s.

Signed-off-by: Guy Stone <guys@spotify.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>

2026-10-01 01:03:39 +00:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

[Metrics] Add --custom-histogram-buckets to override histogram bucket families (#48867)

2026-10-01 01:03:39 +00:00

async_llm_engine.py

[Docs] Reduce time spent generating API docs (#34255)

2026-02-11 02:56:02 -08:00

llm_engine.py

[Docs] Reduce time spent generating API docs (#34255)

2026-02-11 02:56:02 -08:00

protocol.py

[Frontend][RL] Align sleep-mode API responses and operation metrics (#52864)

2026-09-29 23:16:38 -07:00