iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
147 Commits 3 Branches 0 Tags
aedba6d5ec4e1eaad10745f71970c10b601f9dc1
Commit Graph
1 Commits
Author SHA1 Message Date
Siyuan (Ryans) Zhuang e3cec88aa5 Memcpy kernel for flash attention (#29) 
* optimize

* add benchmark

* add assert

* add test
 2023-04-10 18:22:49 -07:00