Files

T

Nithin ChalapathiandCyrus Leung 80b18230e0 [Frontend] Add multimodal support to /inference/v1/generate endpoint (#38405 )

Signed-off-by: Nithin Chalapathi <nithin.ch10@gmail.com>
Signed-off-by: Nithin Chalapathi <nithinc@berkeley.edu>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

2026-04-17 20:31:56 -07:00

mooncake_connector

[CI][BugFix] ShellCheck cleanup to remove baseline and preserve runtime behavior (#34514 )

2026-02-17 12:22:56 +00:00

disagg_proxy_demo.py

[Bugfix] Fix 'remove_instance_endpoint' method logic in disagg_proxy_demo (#32922 )

2026-02-17 10:06:53 +00:00

example_mm_serve.py

[Frontend] Add multimodal support to /inference/v1/generate endpoint (#38405 )

2026-04-17 20:31:56 -07:00

kv_events.sh

[CI][BugFix] ShellCheck cleanup to remove baseline and preserve runtime behavior (#34514 )

2026-02-17 12:22:56 +00:00

moriio_toy_proxy_server.py

[ROCm][P/D][MORI][BugFix] Add transfer_id for moriio_connector so moriio_connector to restore P/D functionality (#34907 )

2026-03-16 10:36:51 +08:00

README.md

[P/D] rework mooncake connector and introduce its bootstrap server (#31034 )

2026-02-03 08:08:25 -08:00

README.md

Disaggregated Serving

This example contains scripts that demonstrate the disaggregated serving features of vLLM.

Files

disagg_proxy_demo.py - Demonstrates XpYd (X prefill instances, Y decode instances).
kv_events.sh - Demonstrates KV cache event publishing.
mooncake_connector - A proxy demo for MooncakeConnector.