iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
149 Commits 3 Branches 0 Tags
057daef778ec4e951841f44afda1cd0b1eb50ee4
Commit Graph
1 Commits
Author SHA1 Message Date
Siyuan (Ryans) Zhuang e3cec88aa5 Memcpy kernel for flash attention (#29) 
* optimize

* add benchmark

* add assert

* add test
 2023-04-10 18:22:49 -07:00