iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
98 Commits 3 Branches 0 Tags
897cb2ae28e93de1b22ecfbffcccfb9493f8f4d9
Commit Graph
2 Commits
Author SHA1 Message Date
Woosuk Kwon 897cb2ae28 Optimize data movement (#20) 2023-04-02 00:30:17 -07:00
Woosuk Kwon 0deacbce6e Implement single_query_cached_kv_attention kernel (#3) 2023-03-01 15:02:19 -08:00