Signed-off-by: stevenkuang <stevenkuang@tencent.com> Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
scope="local"
torch.cuda.empty_cache
torch.accelerator.empty_cache
vllm/model_executor
vllm/model_executor/layers