iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
927 Commits 3 Branches 0 Tags
865732342b4e3b8a4ef38f28a2a5bdb87cf3f970
Commit Graph
1 Commits
Author SHA1 Message Date
Cheng Su 4abf6336ec Add one example to run batch inference distributed on Ray (#2696) 2024-02-02 15:41:42 -08:00