Signed-off-by: xuebi <xuebi@minimaxi.com> Co-authored-by: xuebi <xuebi@minimaxi.com>
Optional[x]
x | None
Union[x, y]
x | y
get_kv_cache_spec
AttentionLayerBase
vllm.utils