Commit Graph
15 Commits
Author SHA1 Message Date
Kevin H. LuuandOpenAI Codex 772e4f05fa [Bugfix][Rust] Fix HF multi-turn dataset integration (#56915)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-14 18:04:46 -07:00
JinYan SuOpenAI Codexmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
f0a61bd438 [Rust][Benchmark] Support HF ShareGPT datasets in multi-turn mode (#51104)
Signed-off-by: xiaguan <751080330@qq.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-14 16:48:23 -07:00
Taneem Ibrahim a014e35f38 [Pooling] Fix Rust pooling endpoint for benchmark (#53352)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
2026-08-22 15:45:09 -04:00
Taneem Ibrahimandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 704f12aa1e [Pooling] Report input throughput for batched requests (#53213)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-22 09:01:40 -04:00
Roy Wang df344bf36f [Rust][Benchmark] Load HF datasets from parquet shards via hf-hub, fixing truncated-cache sampling (#51570) 2026-08-21 05:07:43 +00:00
963fcfa48c [Rust][Benchmark] Align speed-bench CLI flags with Python and add flag parity test (#51592)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: esmeetu <jasonailu87@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-08-20 08:50:51 +00:00
Tyler Michael SmithandOpenAI Codex aabc1a0a0b [Bugfix][Benchmark] Check readiness before tokenizer init in rust vllm-bench (#51863)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-19 02:52:25 +00:00
c89d692cb5 [Build] Propagate vLLM version to Rust binaries (#52593)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-08-17 23:37:37 -07:00
Reid 72cd5424da [Rust][Benchmark] Preserve UTF-8 across benchmark stream chunks (#50868)
Signed-off-by: reidliu41 <reid201711@gmail.com>
2026-08-04 06:15:02 +00:00
Reid 62195e9784 [Rust][Benchmark] Prevent invalid token IDs in random benchmarks (#50058)
Signed-off-by: reidliu41 <reid201711@gmail.com>
2026-08-01 03:20:29 +00:00
Bugen Zhao d552a68645 [Rust Frontend] Extract shared tracing setup logic into vllm-tracing (#50129)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-07-28 19:31:15 +00:00
Bugen Zhao eb44b3aaa4 [Rust][Benchmark] Use async HTTP clients (#49295)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-07-21 16:53:57 +08:00
Bugen Zhao 8688a06d67 [Rust][Benchmark] Use tracing for logs (#48937)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-07-21 05:18:13 +00:00
Bugen Zhaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> c01618fdc8 [Rust][Benchmark] Integrate vllm-bench to vllm-rs & vllm CLI (#48930)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-07-20 09:31:25 +00:00
Roy WangandBugen Zhao 9354f22204 [Rust][Benchmark] Port in vllm-bench (#48107)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: esmeetu <jasonailu87@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-07-17 14:25:29 +08:00