[HiSparse] Report host-pool block residency as HiSparse metrics (#59485)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com> Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
co-authored by
Claude Opus 5.5
parent
783ac12071
commit
4c43254d52
@@ -50,7 +50,10 @@ The following metrics are exposed:
|
||||
These metrics are exposed when the `HiSparseConnector` KV connector is
|
||||
configured. The host-pool gauges are reported by the scheduler once per engine
|
||||
step, for the host pool shared by all tensor-parallel ranks; evictable cached
|
||||
blocks count as free.
|
||||
blocks count as free. With `--kv-cache-metrics`, the
|
||||
`vllm:hisparse_host_block_*_seconds` histograms sample host-pool block
|
||||
residency, like the device `vllm:kv_block_*_seconds` histograms, which cover
|
||||
only the GPU pool.
|
||||
|
||||
--8<-- "gen:metrics-hisparse"
|
||||
|
||||
|
||||
Reference in New Issue
Block a user