iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
1,863 Commits 3 Branches 0 Tags
fc17110bbef4e78703abffac51133a2fb71e9f79
Commit Graph
1 Commits
Author SHA1 Message Date
afeldman-nm 4238bc82f2 [Core] Cross-attention KV caching and memory-management (towards eventual encoder/decoder model support) (#4837) 2024-05-29 16:09:13 +00:00