iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
927 Commits 3 Branches 0 Tags
865732342b4e3b8a4ef38f28a2a5bdb87cf3f970
Commit Graph
2 Commits
Author SHA1 Message Date
Zhuohan Li 4c922709b6 Add distributed model executor abstraction (#3191) 2024-03-11 11:03:45 -07:00
Jiaxiang 6549aef245 [DOC] Add additional comments for LLMEngine and AsyncLLMEngine (#1011) 2024-01-11 19:26:49 -08:00