iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
134 Commits 3 Branches 0 Tags
707ec647bb3a5018e5d8cdded409d6244bbb9ea5
Commit Graph
1 Commits
Author SHA1 Message Date
Siyuan (Ryans) Zhuang e3cec88aa5 Memcpy kernel for flash attention (#29) 
* optimize

* add benchmark

* add assert

* add test
 2023-04-10 18:22:49 -07:00