Rodrigo Garcia
3faf214051
[vllm-bench, feature] Added support for Mooncake-style, timed-traces replay. ( #55937 )
2026-10-06 20:39:35 +08:00
Wentao Ye
3e182185aa
[Deprecation] Deprecate sonet dataset as scheduled ( #60129 )
...
Signed-off-by: yewentao256 <zhyanwentao@126.com >
2026-10-06 08:15:12 -04:00
Misha Goin and Claude
1ab18599ca
[Agents] Add pre-commit check for agent files and skills ( #59657 )
...
Signed-off-by: mgoin <mgoin64@gmail.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-10-02 09:38:22 -07:00
Idder Ghanbaja
f3b77eff64
[Rust][Benchmark] Warn when temperature is left to the server default ( #59247 )
2026-10-01 21:03:03 +08:00
31ec1c3aa1
[Bugfix][Rust Frontend] Stop vllm-bench chat latency at the last token ( #59251 )
...
Signed-off-by: zhenchenglin <zhl132@ucsd.edu >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Roy Wang <jasonailu87@gmail.com >
2026-10-01 02:04:19 +00:00
Bugen Zhao and Claude Opus 5.5
afac509a33
[Bugfix][Rust Frontend] Skip engine-derived metrics under --disable-log-stats ( #59205 )
...
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-09-29 11:01:54 -07:00
Harry Mellor and Claude Opus 5.5
d636456b1f
[Frontend] Remove the slow tokenizer mode ( #58545 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-09-24 08:48:28 -07:00
Bugen Zhao
a6c47fbbf4
[Rust Frontend] Separate multimodal instrumentation from request timing ( #58084 )
...
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
2026-09-22 06:57:56 +00:00
f84325c48c
[Frontend][Rust] Add mm-processor benchmark for Rust frontend ( #51922 )
...
Signed-off-by: Karthik Gangula <gangula-karthik@users.noreply.github.com >
Signed-off-by: gangula-karthik <gkarthik923@gmail.com >
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
Co-authored-by: Karthik Gangula <gangula-karthik@users.noreply.github.com >
Co-authored-by: factory-droid[bot] <138933559+factory-droid[bot]@users.noreply.github.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com >
2026-09-22 05:08:35 +00:00
Kevin H. Luu and OpenAI Codex
772e4f05fa
[Bugfix][Rust] Fix HF multi-turn dataset integration ( #56915 )
...
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-09-14 18:04:46 -07:00
f0a61bd438
[Rust][Benchmark] Support HF ShareGPT datasets in multi-turn mode ( #51104 )
...
Signed-off-by: xiaguan <751080330@qq.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-14 16:48:23 -07:00
Taneem Ibrahim
a014e35f38
[Pooling] Fix Rust pooling endpoint for benchmark ( #53352 )
...
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com >
2026-08-22 15:45:09 -04:00
Taneem Ibrahim and mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
704f12aa1e
[Pooling] Report input throughput for batched requests ( #53213 )
...
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-22 09:01:40 -04:00
Roy Wang
df344bf36f
[Rust][Benchmark] Load HF datasets from parquet shards via hf-hub, fixing truncated-cache sampling ( #51570 )
2026-08-21 05:07:43 +00:00
963fcfa48c
[Rust][Benchmark] Align speed-bench CLI flags with Python and add flag parity test ( #51592 )
...
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
Co-authored-by: Bugen Zhao <i@bugenzhao.com >
Signed-off-by: esmeetu <jasonailu87@gmail.com >
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
2026-08-20 08:50:51 +00:00
Tyler Michael Smith and OpenAI Codex
aabc1a0a0b
[Bugfix][Benchmark] Check readiness before tokenizer init in rust vllm-bench ( #51863 )
...
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-08-19 02:52:25 +00:00
c89d692cb5
[Build] Propagate vLLM version to Rust binaries ( #52593 )
...
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
Co-authored-by: Nick Hill <nickhill123@gmail.com >
Co-authored-by: Andreas Karatzas <akaratza@amd.com >
2026-08-17 23:37:37 -07:00
Reid
72cd5424da
[Rust][Benchmark] Preserve UTF-8 across benchmark stream chunks ( #50868 )
...
Signed-off-by: reidliu41 <reid201711@gmail.com >
2026-08-04 06:15:02 +00:00
Reid
62195e9784
[Rust][Benchmark] Prevent invalid token IDs in random benchmarks ( #50058 )
...
Signed-off-by: reidliu41 <reid201711@gmail.com >
2026-08-01 03:20:29 +00:00
Bugen Zhao
d552a68645
[Rust Frontend] Extract shared tracing setup logic into vllm-tracing ( #50129 )
...
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
2026-07-28 19:31:15 +00:00
Bugen Zhao
eb44b3aaa4
[Rust][Benchmark] Use async HTTP clients ( #49295 )
...
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
2026-07-21 16:53:57 +08:00
Bugen Zhao
8688a06d67
[Rust][Benchmark] Use tracing for logs ( #48937 )
...
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
2026-07-21 05:18:13 +00:00
Bugen Zhao and mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
c01618fdc8
[Rust][Benchmark] Integrate vllm-bench to vllm-rs & vllm CLI ( #48930 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
2026-07-20 09:31:25 +00:00
Roy Wang and Bugen Zhao
9354f22204
[Rust][Benchmark] Port in vllm-bench ( #48107 )
...
Co-authored-by: Bugen Zhao <i@bugenzhao.com >
Signed-off-by: esmeetu <jasonailu87@gmail.com >
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
2026-07-17 14:25:29 +08:00
Rodrigo Garcia