iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
14,683 Commits 3 Branches 0 Tags
42fadebecb79290ad722f33f3094de23b121f33d
Commit Graph
184 Commits
Author SHA1 Message Date
Wentao Ye be292b7c14 [Bug] Fix pooling model benchmark script (#36300) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-03-09 11:17:45 -04:00
Kunshang Ji 7eb524e64c refine vllm bench throughput --backend hf (#35971) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-03-07 02:10:33 +00:00
Cyrus Leung 7196348157 [Bugfix] Fix Qwen-VL tokenizer implementation (#36140) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-03-05 08:07:19 -08:00
Cyrus Leung 1dafb29f91 [Benchmark] Avoid unnecessary video download in MMVU (#35618) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-02-28 09:07:02 -08:00
flutist c68e69f144 custom dataset img support base64 (#35280) 
Signed-off-by: xjx <493337577@qq.com>
 2026-02-28 11:49:52 +00:00
Cyrus Leung 4292e3b807 [Benchmark] Improve UX of sweep scripts (#35600) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-02-28 00:36:02 -08:00
Cyrus Leung 24d6ea8afd [Benchmark] Rename SLA Finder to Workload Explorer (#35586) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-02-27 23:31:55 -08:00
Cyrus Leung fd68cd132b [Bugfix] Fixes for SLA finder (#35537) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-02-27 20:20:55 -08:00
Sophie du CouédicandCyrus Leung 02acd16861 [Benchmarks] Plot benchmark timeline and requests statistics (#35220) 
Signed-off-by: Sophie du Couédic <sop@zurich.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2026-02-26 02:17:43 -08:00
Cyrus Leung d3a51da92a [Benchmark] Simplify SLA scan (#35306) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-02-25 22:35:41 -08:00
Cyrus Leung 392645454b [Refactor] Decouple TimingContext from InputProcessingContext (#35083) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-02-23 14:15:50 +00:00
Jee Jee Li 7291d1b288 [Bugfix] Fix kernel benchmark (#33752) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-02-22 21:18:08 -08:00
Cyrus Leung cbd95a2dd1 [Benchmark] Use sns.relplot for plotting (#35027) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-02-21 20:26:48 -08:00
Cyrus Leung f74f1572ca [Benchmark] Improve benchmarks (#35012) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-02-21 10:31:58 +00:00
Cyrus Leung 73391a1baa [Renderer] Move InputPreprocessor into Renderer (1/2) (#34510) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2026-02-14 10:14:21 -08:00
Frank WangandRoger Wang b86bf4417e [Bugfix] Fix Random Dataset Prefix Length Inaccuracy (#33907) 
Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-02-12 18:21:19 -08:00
Tomas Ruiz 144d9b7cc8 [Benchmarks] Reduce ready checker log verbosity (#34349) 
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
 2026-02-11 20:57:57 +00:00
Cyrus Leung 3bcd494ef4 [Redo] Add --trust-remote-code to dataset bench args (#34251) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-02-11 11:10:12 +08:00
mgazz 599e4335a4 Support benchmarking of Geospatial models (#33922) 
Signed-off-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
 2026-02-10 07:04:16 -08:00
Fan YangandFan Yang a1946570d8 add --insecure arg to the vllm bench to skip TLS (#34026) 
Signed-off-by: Fan Yang <yan9fan@meta.com>
Co-authored-by: Fan Yang <yan9fan@meta.com>
 2026-02-10 22:23:52 +08:00
Cyrus Leung 2c32558a3c [Bugfix] Fix --trust-remote-code conflict (#34218) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-02-10 00:29:10 -08:00
Cyrus Leung 998e2d91f8 Revert #34208 (#34216) 2026-02-09 23:59:04 -08:00
Andrew XiaandAndrew Xia 9608844f96 [responsesAPI] fix simpleContext streaming output_messages (#34188) 
Signed-off-by: Andrew Xia <axia@meta.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
 2026-02-09 22:53:07 -08:00
Cyrus Leung f69b903b4c [Bugfix] Add --trust-remote-code to dataset bench args (#34208) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-02-09 22:37:50 -08:00
Ekagra RanjanandNicolò Lucchesi 1d5922fade [ASR] Fix audio benchmark and add RTFx metric (#32300) 
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
 2026-02-09 10:02:37 +00:00
Huy Do 2647163674 Save startup benchmark results as a list of values (#33629) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2026-02-03 20:37:51 -08:00
Komal Kumar TeruandCyrus Leung ba871fb788 [Misc] support arbitrary MM datasets in spec dec bench (#33486) 
Signed-off-by: kkt-cohere <komal@cohere.com>
Signed-off-by: Komal Kumar Teru <162363718+kkt-cohere@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2026-02-02 08:49:48 +00:00
Luka Govedič 672023877b Change defaults for vllm bench startup (#33489) 2026-01-31 23:46:01 -08:00
Zack Yu 754a8ca942 fix: only include Authorization header when OPENAI_API_KEY is set (#33488) 
Signed-off-by: zack041 <zackyu041@gmail.com>
 2026-01-31 23:35:09 -08:00
Cyrus Leung 79b6ec6aab [Bugfix] Fix inconsistent handling of cache reset (#33481) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-31 20:23:41 -08:00
Huy Do 9ca66ecc10 Indicate compile mode in the benchmark results (#32990) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2026-01-30 15:34:36 -05:00
Harry Mellor 2eb673a088 Add flake8-implicit-str-concat rules to Ruff (#33191) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-01-28 04:56:10 +00:00
Hiroken.andXingran Wang 6450b536a6 [Bugfix] Fix E2E latency calculation and add warmup support in mm_processor benchmark (#32646) 
Signed-off-by: Hongjian Zhang <zhanghongjian@xiaohongshu.com>
Signed-off-by: Xingran Wang <wangxingran123456@outlook.com>
Signed-off-by: Hiroken. <105287758+HirokenOvo@users.noreply.github.com>
Co-authored-by: Xingran Wang <wangxingran123456@outlook.com>
 2026-01-24 10:31:41 +00:00
Reagan LeeandHiroken. 06b557ecd9 feat(benchmark): add encoder forward pass benchmarking to mm-processor (#31655) 
Signed-off-by: Reagan <reaganjlee@gmail.com>
Signed-off-by: Reagan Lee <96998476+reaganjlee@users.noreply.github.com>
Co-authored-by: Hiroken. <105287758+HirokenOvo@users.noreply.github.com>
 2026-01-24 08:24:44 +00:00
Isotr0py 243e78c20f [Benchmark][Bugfix] Fix race condtion when starting server for sweep benchmark (#32927) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-01-23 12:11:18 +00:00
Nick Hill 098b2d66fe [Benchmark] Don't default to temperature==0 in vllm bench serve (#32723) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
 2026-01-22 10:03:15 +00:00
Kebe 1bf1a34b19 [bench] add start_times field to vllm bench serve json result (#32667) 
Signed-off-by: Kebe <mail@kebe7jun.com>
 2026-01-22 07:10:14 +00:00
Tomas Ruiz 4a5299c93f feat: spec decode with draft models (#24322) 
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
 2026-01-19 16:05:46 -05:00
rongfu.leng 3a4e10c847 [Benchmark] [Feature] add vllm bench sweep startup command (#32337) 
Signed-off-by: lengrongfu <lenronfu@gmail.com>
 2026-01-15 09:25:46 +00:00
Cyrus Leung 9ea07b41da [1/N] Reorganize multimodal processing code (#32327) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-14 15:25:31 +00:00
Cyrus Leung 7c0d3c5152 [Benchmark] Share data between SLA runs (#32184) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-13 01:12:22 +08:00
Nicolò Lucchesi 22970c1626 [Misc] Disable default --ready-check-timeout-sec extra call in vllm bench (#30975) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-01-12 01:58:21 -08:00
Cyrus Leung ef96fa3f1f [Benchmark][2/2] Use spline interpolation to tune SLA variables (#32095) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-10 20:27:27 -08:00
Cyrus Leung 5f2385a4c8 [Benchmark][1/2] Generalize SLA criterion validation from binary flags to margins (#32075) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-10 07:11:03 +00:00
Ning Xie abd9224280 resolve pydantic error in startup benchmark (#31348) 
Signed-off-by: Andy Xie <andy.xning@gmail.com>
 2026-01-10 02:41:27 +00:00
Sophie du Couédic b474782ad7 [Feature][Benchmarks] Custom dataset: read output length from dataset (#31881) 
Signed-off-by: Sophie du Couédic <sop@zurich.ibm.com>
 2026-01-09 12:40:59 +00:00
vSeamar 6f351548b2 [Frontend] Implement robust video frame recovery for corrupted videos (#29197) 
Signed-off-by: cmartinez <cmartinez@roblox.com>
Signed-off-by: vSeamar <cmartinez@roblox.com>
 2026-01-07 01:13:24 +00:00
Matthew BonanniBenjamin ChislettBenjamin Chislett
 		d49899732e [Spec Decode][UX] Add acceptance stats to vllm bench serve report (#31739) 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
 2026-01-06 21:21:42 +00:00
Elvir Crnčević dba95378a6 Report error log after vllm bench serve (#31808) 
Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
 2026-01-06 20:24:19 +00:00
Reagan Lee 1f5b7c41c3 Add Multimodal Processor Benchmark (#29105) 
Signed-off-by: Reagan Lee <reaganjlee@gmail.com>
Signed-off-by: Reagan <reaganjlee@gmail.com>
 2026-01-01 19:26:53 -08:00