[kv_offload] Establish tier-owned KV event handling (#46544)
Signed-off-by: Change72 <changg@nvidia.com> Signed-off-by: Chang Guo <changg@nvidia.com> Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com> Co-authored-by: Or Ozeri <oro@il.ibm.com>
This commit is contained in:
co-authored by
Claude Opus 4.8
Or Ozeri
parent
65dcde1695
commit
c46ced1ee3
@@ -43,6 +43,7 @@ class KVCacheEvent(
|
||||
|
||||
|
||||
MEDIUM_GPU = "GPU"
|
||||
MEDIUM_CPU = "CPU"
|
||||
|
||||
|
||||
class BlockStored(KVCacheEvent):
|
||||
|
||||
Reference in New Issue
Block a user