Files

T

History

Harry MellorandClaude Opus 5 8c1557a79c Add pydocstyle to the ruff rules (#52136 )

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Harry Mellor <hej.mellor@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>

2026-09-16 16:44:29 +00:00

decode_example.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

prefill_example.py

[Examples] Resettle Disaggregated examples. (#40759 )

2026-05-06 01:20:38 -07:00

README.md

[Examples] Resettle Disaggregated examples. (#40759 )

2026-05-06 01:20:38 -07:00

run.sh

[Examples] Resettle Disaggregated examples. (#40759 )

2026-05-06 01:20:38 -07:00

README.md

Disaggregated Prefill V1

This example contains scripts that demonstrate disaggregated prefill in the offline setting of vLLM.

Files

run.sh - A helper script that will run prefill_example.py and decode_example.py sequentially.
- Make sure you are in the examples/disaggregated/example_connector directory before running run.sh.
prefill_example.py - A script which performs prefill only, saving the KV state to the local_storage directory and the prompts to output.txt.
decode_example.py - A script which performs decode only, loading the KV state from the local_storage directory and the prompts from output.txt.