iHore/vLLM

Fork 0

Files

T

History

41b8c15809 [Feature][MoRIIO] Support hybrid WRITE transfers with DSpark (#60544 )

Signed-off-by: Yichao Zhu <Yichao.Zhu@amd.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-10-17 04:57:58 +00:00

disagg_proxy_demo.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

disagg_proxy_multiturn.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

disagg_proxy_pushconnector_demo.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

kv_events.sh

[Examples] Resettle Disaggregated examples. (#40759 )

2026-05-06 01:20:38 -07:00

moriio_toy_proxy_server.py

[Feature][MoRIIO] Support hybrid WRITE transfers with DSpark (#60544 )

2026-10-17 04:57:58 +00:00

README.md

[Examples] Resettle Disaggregated examples. (#40759 )

2026-05-06 01:20:38 -07:00

README.md

Disaggregated Serving

This example contains scripts that demonstrate the disaggregated serving features of vLLM.

Files

disagg_proxy_demo.py - Demonstrates XpYd (X prefill instances, Y decode instances).
kv_events.sh - Demonstrates KV cache event publishing.
mooncake_connector - A proxy demo for MooncakeConnector.