[Feature][Multimodal] Add cross-encoder caching to Mooncake P2P (#56242)
Signed-off-by: Zhou ziheng <jiaranran2@gmail.com> Co-authored-by: Tianyu Guo <guoty@inferact.ai> Co-authored-by: jiangkuaixue123 <jiangxiaozhou111@163.com> Co-authored-by: Codex <noreply@openai.com>
This commit is contained in:
co-authored by
Tianyu Guo
jiangkuaixue123
Codex
parent
2d8a5c5741
commit
2743dc4f92
@@ -45,6 +45,9 @@ Below ready-to-run scripts shows the workflow:
|
||||
|
||||
## 3 Test Script
|
||||
|
||||
For optional cross-Encoder output reuse while retaining Mooncake P2P delivery,
|
||||
see [Cross-encoder output reuse](cross_encoder_cache.md).
|
||||
|
||||
Please refer to the directories `tests/v1/ec_connector`
|
||||
|
||||
## 4 Development
|
||||
|
||||
Reference in New Issue
Block a user