iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
19,362 Commits 3 Branches 0 Tags
f1899b2ffdf87598350c416a074c8c291c845902
Commit Graph
5 Commits
Author SHA1 Message Date
wang.yuqi 61c9ef986a [Frontend] Parallelize preprocessing within the same request for pooling models online serving. (#49153) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
 2026-07-22 10:56:23 +00:00
wang.yuqi 3e90d015ba [Frontend] Overlap preprocessing and computation for pooling models offline inference (#47699) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
 2026-07-16 14:00:20 +00:00
Harry Mellor 03878d1c22 Deprecations for v0.23 and v0.24 (#44992) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-11 14:35:38 +00:00
wang.yuqiandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> d5cf7b4a2c [Frontend] Split the offline inference APIs and utils. (#43553) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-05-26 05:20:24 +00:00
wang.yuqi 75fd68c7a5 [Entrypoints] Split the pooling offline API into PoolingOfflineMixin. (#42267) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
 2026-05-15 08:05:57 +00:00