wang.yuqi 3e90d015ba [Frontend] Overlap preprocessing and computation for pooling models offline inference (#47699) ...

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>

2026-07-16 14:00:20 +00:00

..

__init__.py

[Frontend][3/n] Improve pooling entrypoints | scoring. (#28631)

2026-03-31 07:52:00 +00:00

api_router.py

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

io_processor.py

[Frontend] Overlap preprocessing and computation for pooling models offline inference (#47699)

2026-07-16 14:00:20 +00:00

protocol.py

[Pooling] Validate non-negative rerank top_n (#46119)

2026-06-22 11:40:47 -04:00

serving.py

[Frontend] Remove frontend pooling multi task support. (#37861)

2026-04-21 12:27:44 +00:00

typing.py

[Frontend][3/n] Improve pooling entrypoints | scoring. (#28631)

2026-03-31 07:52:00 +00:00

utils.py

feat: add max_tokens_per_doc in rerank request. (#38827)

2026-04-13 01:24:09 -07:00