[HiSparse] Report host-pool block residency as HiSparse metrics (#59485)

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
Matthew Bonanni
2026-10-09 16:45:34 -06:00
committed by GitHub
co-authored by Claude Opus 5.5
parent 783ac12071
commit 4c43254d52
7 changed files with 147 additions and 6 deletions
+4 -1
View File
@@ -50,7 +50,10 @@ The following metrics are exposed:
These metrics are exposed when the `HiSparseConnector` KV connector is
configured. The host-pool gauges are reported by the scheduler once per engine
step, for the host pool shared by all tensor-parallel ranks; evictable cached
blocks count as free.
blocks count as free. With `--kv-cache-metrics`, the
`vllm:hisparse_host_block_*_seconds` histograms sample host-pool block
residency, like the device `vllm:kv_block_*_seconds` histograms, which cover
only the GPU pool.
--8<-- "gen:metrics-hisparse"