Commit Graph
3 Commits
Author SHA1 Message Date
Woosuk Kwon a463c333dd Use CuPy for CUDA graphs (#2811) 2024-02-13 11:32:06 -08:00
Woosuk Kwon c3372e87be Remove dependency on CuPy (#2152) 2023-12-17 01:49:07 -08:00
37ca558103 Optimize model execution with CUDA graph (#1926)
Co-authored-by: Chen Shen <scv119@gmail.com>
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
2023-12-16 21:12:08 -08:00