iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
145 Commits 3 Branches 0 Tags
3f942acfe15de367931a63aa96c1931eb74799c0
Commit Graph
1 Commits
Author SHA1 Message Date
Siyuan (Ryans) Zhuang e3cec88aa5 Memcpy kernel for flash attention (#29) 
* optimize

* add benchmark

* add assert

* add test
 2023-04-10 18:22:49 -07:00