This website requires JavaScript.
Explore
Help
Sign In
iHore
/
vLLM
Watch
8
Star
0
Fork
0
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
2,381
Commits
3
Branches
0
Tags
0df7ec0b2d890799ca71e2f862fdff5fcc52cdc0
Commit Graph
2 Commits
Include renames
Author
SHA1
Message
Date
3 people
afeldman-nm
Andrew Feldman
Nick Hill
fd95e026e0
[Core] Subclass ModelRunner to support cross-attention & encoder sequences (towards eventual encoder/decoder model support) (
#4942
)
...
Co-authored-by: Andrew Feldman <
afeld2012@gmail.com
> Co-authored-by: Nick Hill <
nickhill@us.ibm.com
>
2024-08-06 16:51:47 -04:00
afeldman-nm
4238bc82f2
[Core] Cross-attention KV caching and memory-management (towards eventual encoder/decoder model support) (
#4837
)
2024-05-29 16:09:13 +00:00