[KVCache] Support Pluggable KVCacheSpec (#37505)

Signed-off-by: MengqingCao <cmq0113@163.com>
Signed-off-by: Mengqing Cao <cmq0113@163.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
This commit is contained in:
Mengqing Cao
2026-06-03 09:05:16 -07:00
committed by GitHub
co-authored by zjy0516 mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
parent df7252c343
commit 0c6631f02a
11 changed files with 698 additions and 59 deletions
+7
View File
@@ -698,6 +698,13 @@ class Platform:
mamba_padding_pct,
)
@classmethod
def register_custom_kv_cache_specs(cls, vllm_config: "VllmConfig") -> None:
"""
Register custom KVCacheSpec class on current platform.
"""
pass
@classmethod
def verify_model_arch(cls, model_arch: str) -> None:
"""