[HMA] [KVEvent] Enable GPU-side KV events for HMA (#37688)

Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: Or Ozeri <or@ozery.com>
This commit is contained in:
Martin Hickey
2026-04-12 10:01:02 +03:00
committed by GitHub
co-authored by Or Ozeri
parent 17e787a779
commit cc07dad789
8 changed files with 300 additions and 28 deletions
@@ -43,10 +43,13 @@ class BlockStored(KVCacheEvent):
prompt embeddings data, etc. for that specific block.
"""
group_idx: int | None = None
class BlockRemoved(KVCacheEvent):
block_hashes: list[ExternalBlockHash]
medium: str | None
group_idx: int | None = None
class AllBlocksCleared(KVCacheEvent):