get_kv_cache_layout
use_trtllm_attention
Signed-off-by: NickLucche <nlucches@redhat.com>
AsyncLLM.abort()
VLLM_USE_DEEP_GEMM_E8M0