[Bugfix][HiSparse] Stop the host pool feeding device KV cache residency metrics (#58725)
Signed-off-by: Yueh-Ting Chen <yueh.ting.chen@gmail.com> Signed-off-by: Matthew Bonanni <mbonanni@redhat.com> Co-authored-by: Matthew Bonanni <mbonanni@redhat.com> Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
co-authored by
Matthew Bonanni
Claude Opus 5.5
parent
51048b13ce
commit
73c7cae4d7
@@ -2247,7 +2247,7 @@ class HiSparseSourceManager(FullAttentionManager):
|
||||
enable_caching=self.enable_caching and self.kv_cache_spec.prefix_cacheable,
|
||||
hash_block_size=device_pool.hash_block_size,
|
||||
enable_kv_cache_events=device_pool.enable_kv_cache_events,
|
||||
metrics_collector=device_pool.metrics_collector,
|
||||
metrics_collector=None,
|
||||
medium=MEDIUM_CPU,
|
||||
event_owner=device_pool,
|
||||
)
|
||||
|
||||
Reference in New Issue
Block a user