wang.yuqi 61c9ef986a [Frontend] Parallelize preprocessing within the same request for pooling models online serving. (#49153) ...

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>

2026-07-22 10:56:23 +00:00

..

__init__.py

[Frontend][3/n] Improve pooling entrypoints | scoring. (#28631)

2026-03-31 07:52:00 +00:00

api_router.py

[Frontend] Parallelize preprocessing within the same request for pooling models online serving. (#49153)

2026-07-22 10:56:23 +00:00

io_processor.py

[Frontend] Parallelize preprocessing within the same request for pooling models online serving. (#49153)

2026-07-22 10:56:23 +00:00

protocol.py

[Pooling] Validate non-negative rerank top_n (#46119)

2026-06-22 11:40:47 -04:00

serving.py

[Frontend] Parallelize preprocessing within the same request for pooling models online serving. (#49153)

2026-07-22 10:56:23 +00:00

typing.py

[Frontend][3/n] Improve pooling entrypoints | scoring. (#28631)

2026-03-31 07:52:00 +00:00

utils.py

feat: add max_tokens_per_doc in rerank request. (#38827)

2026-04-13 01:24:09 -07:00