[Benchmark] Add probe requests to vllm bench serve (#49611)

Signed-off-by: Guan-Ming (Wesley) Chiu <105915352+guan404ming@users.noreply.github.com>
This commit is contained in:
Guan-Ming Chiu
2026-08-01 22:10:56 +08:00
committed by GitHub
parent ab06486175
commit 63e78ce365
3 changed files with 106 additions and 0 deletions
@@ -84,6 +84,7 @@ def _args(dataset_path: str) -> argparse.Namespace:
request_rate=16.0,
burstiness=1.0,
max_concurrency=None,
probe_request_rate=0.0,
# misc serve args that main_async reads before reaching get_samples
plot_timeline=False,
plot_dataset_stats=False,