3 people 9090bf02e7 Support FP8-E5M2 KV Cache (#2279) ...

Co-authored-by: zhaoyang <zhao.yang16@zte.com.cn>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

2024-01-28 16:43:54 -08:00

..

benchmark_paged_attention.py

Support FP8-E5M2 KV Cache (#2279)

2024-01-28 16:43:54 -08:00