[Doc] Add an automatic prefix caching section in vllm documentation (#5324)

Co-authored-by: simon-mo <simon.mo@hey.com>
This commit is contained in:
Kuntai Du
2024-06-11 10:24:59 -07:00
committed by GitHub
co-authored by simon-mo
parent 4c2ffb28ff
commit 9fde251bf0
3 changed files with 160 additions and 1 deletions
+7 -1
View File
@@ -104,8 +104,14 @@ Documentation
.. toctree::
:maxdepth: 1
:caption: Automatic Prefix Caching
automatic_prefix_caching/apc
automatic_prefix_caching/details
.. toctree::
:caption: Developer Documentation
dev/sampling_params
dev/offline_inference/offline_index
dev/engine/engine_index