[Feature][Multimodal] Add cross-encoder caching to Mooncake P2P (#56242)

Signed-off-by: Zhou ziheng <jiaranran2@gmail.com>
Co-authored-by: Tianyu Guo <guoty@inferact.ai>
Co-authored-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: Codex <noreply@openai.com>
This commit is contained in:
Zhou ziheng
2026-09-17 13:16:41 +08:00
committed by GitHub
co-authored by Tianyu Guo jiangkuaixue123 Codex
parent 2d8a5c5741
commit 2743dc4f92
15 changed files with 1863 additions and 154 deletions
+3
View File
@@ -45,6 +45,9 @@ Below ready-to-run scripts shows the workflow:
## 3 Test Script
For optional cross-Encoder output reuse while retaining Mooncake P2P delivery,
see [Cross-encoder output reuse](cross_encoder_cache.md).
Please refer to the directories `tests/v1/ec_connector`
## 4 Development