Files

T

9e905f7450 [Bugfix] Account for client queue time in serve benchmarks (#54136 )

Signed-off-by: maithilijoshi20 <maithilijoshi2003@gmail.com>
Signed-off-by: maithilijoshi20 <97733343+maithilijoshi20@users.noreply.github.com>
Signed-off-by: maithilijoshi20 <maithilij2003@gmail.com>
Co-authored-by: maithilijoshi20 <maithilijoshi2003@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

2026-09-01 03:40:51 -07:00

cli.md

[Bugfix] Account for client queue time in serve benchmarks (#54136 )

2026-09-01 03:40:51 -07:00

dashboard.md

more models for vLLM Benchmark Suite (#35086 )

2026-03-12 11:36:51 +08:00

README.md

connects vLLM Recipes with vLLM's native config-based deployment and benchmark (#51308 )

2026-08-11 13:53:51 +00:00

sweeps.md

[Benchmark] Improve UX of sweep scripts (#35600 )

2026-02-28 00:36:02 -08:00

README.md

Benchmark Suites

vLLM provides comprehensive benchmarking tools for performance testing and evaluation.

Benchmark CLI: vllm bench CLI tools and specialized benchmark scripts for interactive performance testing.
Parameter Sweeps: Automate vllm bench runs for multiple configurations, useful for optimization and tuning.
Performance Dashboard: Automated CI that publishes benchmarks on each commit.
Benchmark using vLLM Recipes: Use the Recipe conversion tool to generate config.yaml and env.sh from vLLM Recipes for Benchmarking.