iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
871 Commits 3 Branches 0 Tags
dfc77408bdca19308cbb28a54dfe697442fbf335
Commit Graph
2 Commits
Author SHA1 Message Date
Zhuohan Li eeab52a4ff [FIX] Simpler fix for async engine running on ray (#3371) 2024-03-13 14:18:40 -07:00
Zhuohan Li 4c922709b6 Add distributed model executor abstraction (#3191) 2024-03-11 11:03:45 -07:00