[6/N][KV-Cache Layout Refactor] Standardize KV cache layout (#51718)

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
This commit is contained in:
Lucas Wilkinson
2026-08-21 17:47:49 -07:00
committed by GitHub
parent 9ff7041b55
commit 8bdc70ec7b
150 changed files with 4006 additions and 5815 deletions
+1
View File
@@ -294,6 +294,7 @@ class TestTurboQuantKVCacheSpec:
head_size_v=128,
num_kv_heads=4,
sliding_window=None,
get_attn_backend=lambda: TurboQuantAttentionBackend,
)
vllm_config = SimpleNamespace(cache_config=SimpleNamespace(block_size=32))