This website requires JavaScript.
Explore
Help
Sign In
iHore
/
vLLM
Watch
8
Star
0
Fork
0
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
664
Commits
3
Branches
0
Tags
5b23c3f26fcf08fdbe2b7e6beecb4d970e632897
Commit Graph
3 Commits
Include renames
Author
SHA1
Message
Date
3 people
shiyi.c_98
DouHappy
Zhuohan Li
d10f8e1d43
[Experimental] Prefix Caching Support (
#1669
)
...
Co-authored-by: DouHappy <
2278958187@qq.com
> Co-authored-by: Zhuohan Li <
zhuohan123@gmail.com
>
2024-01-17 16:32:10 -08:00
Zhuohan Li
fd4ea8ef5c
Use NCCL instead of ray for control-plane communication to remove serialization overhead (
#2221
)
2024-01-03 11:30:22 -08:00
Woosuk Kwon
cd3aa153a4
Fix broken worker test (
#1900
)
2023-12-02 22:17:33 -08:00