Files

T

f42761204f llmd+vllm+mori-ep(inter node wide-ep)+mori-io(write) for 2p2d with dp=ep=16 tp=1 (#45043 )

Signed-off-by: Shiksha Patel <shikpate@amd.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

2026-08-04 00:13:15 +00:00

disagg_proxy_demo.py

[Examples] Resettle Disaggregated examples. (#40759 )

2026-05-06 01:20:38 -07:00

disagg_proxy_multiturn.py

[Bench] benchmark_serving_multi_turn: make non-standard conversation_id payload opt-in (#43756 )

2026-06-09 19:41:56 -07:00

disagg_proxy_pushconnector_demo.py

[KVConnector][NIXL] Support pipeline-parallel prefill in push mode (#45880 )

2026-07-08 16:49:23 -07:00

kv_events.sh

[Examples] Resettle Disaggregated examples. (#40759 )

2026-05-06 01:20:38 -07:00

moriio_toy_proxy_server.py

llmd+vllm+mori-ep(inter node wide-ep)+mori-io(write) for 2p2d with dp=ep=16 tp=1 (#45043 )

2026-08-04 00:13:15 +00:00

README.md

[Examples] Resettle Disaggregated examples. (#40759 )

2026-05-06 01:20:38 -07:00

README.md

Disaggregated Serving

This example contains scripts that demonstrate the disaggregated serving features of vLLM.

Files

disagg_proxy_demo.py - Demonstrates XpYd (X prefill instances, Y decode instances).
kv_events.sh - Demonstrates KV cache event publishing.
mooncake_connector - A proxy demo for MooncakeConnector.