Clinton ThomasandLucas Bourtoule ee17d0d869 Use server-generated keys for late-interaction query caches (#51445) ...

Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com>

2026-09-03 07:15:58 +00:00

..

__init__.py

[Frontend][3/n] Improve pooling entrypoints | scoring. (#28631)

2026-03-31 07:52:00 +00:00

api_router.py

[Frontend] Move engine/protocol.py out openai folder (#54492)

2026-08-31 10:13:50 +00:00

io_processor.py

[Bugfix][Frontend] Truncate pooling prompts before padding them (#54364)

2026-08-30 22:12:03 -07:00

protocol.py

[Frontend] Move engine/protocol.py out openai folder (#54492)

2026-08-31 10:13:50 +00:00

serving.py

Use server-generated keys for late-interaction query caches (#51445)

2026-09-03 07:15:58 +00:00

typing.py

[Frontend][3/n] Improve pooling entrypoints | scoring. (#28631)

2026-03-31 07:52:00 +00:00

utils.py

[Misc] Use VLLMValidationError in scoring input validation (#51753)

2026-08-11 04:12:22 +00:00