iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
2,132 Commits 3 Branches 0 Tags
f230cc2ca6614dd4eecf3af9f12c3ddbcf83036e
Commit Graph
1 Commits
Author SHA1 Message Date
afeldman-nmandWoosuk Kwon 543aa48573 [Kernel] Correctly invoke prefill & decode kernels for cross-attention (towards eventual encoder/decoder model support) (#4888) 
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2024-07-08 17:12:15 +00:00