iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
23,341 Commits 3 Branches 0 Tags
patches
Commit Graph
30 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Huy Do 7b346ba8ed [Bugfix] Propagate compilation_time from workers to main process for TP>1 (#35503) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2026-02-28 05:03:22 +00:00
Huy DoandCyrus Leung 272b535ab3 [Bugfix] Gate 256-bit instructions to CUDA 12.9+ (#34791) 
Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-02-21 04:48:14 -08:00
Huy Do 2647163674 Save startup benchmark results as a list of values (#33629) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2026-02-03 20:37:51 -08:00
Huy Do 9ca66ecc10 Indicate compile mode in the benchmark results (#32990) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2026-01-30 15:34:36 -05:00
Huy Do f5fdec8ce2 Upgrade transformers-4.57.5 (#32287) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2026-01-22 05:19:19 +00:00
Huy DoandRoger Wang c33b87e777 Use official xformers-0.0.33 built for PT 2.9 (#28600) 
Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2025-11-12 22:48:53 -08:00
Huy Do ba33e8830d Reapply "Install pre-built xformers-0.0.32.post2 built with pt-2.9.0" (#27768) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2025-10-30 10:22:30 -07:00
Huy DoandRoger Wang f257544709 Install pre-built xformers-0.0.32.post2 built with pt-2.9.0 (#27598) 
Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2025-10-28 19:39:15 -07:00
Huy Do ed540d6d4c Update release pipeline for PyTorch 2.9.0 (#27303) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2025-10-22 09:18:01 +00:00
Huy DoandLuka Govedič becb7de40b Update PyTorch to 2.9.0+cu129 (#24994) 
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
 2025-10-21 17:20:18 -04:00
Huy Do 8bd696fa53 [Bugfix] Incorrect another MM data format in vllm bench throughput (#26462) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2025-10-09 05:58:46 +00:00
Huy Do d4e7a1152d Update base image to 22.04 (jammy) (#26065) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2025-10-02 05:48:04 -07:00
Huy DoandMichael Goin 67c14906aa Update PyTorch to 2.8.0 (#20358) 
Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
 2025-08-29 18:57:35 +08:00
Huy Do 6ace2f72b0 Fix writing benchmark results with tuple keys (#23633) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2025-08-26 19:16:09 +08:00
Huy Do 971948b846 Handle non-serializable objects in vllm bench (#21665) 2025-07-27 03:35:22 +00:00
Huy Do e98def439c [Take 2] Correctly kill vLLM processes after benchmarks (#21646) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2025-07-26 06:06:05 -07:00
Huy Do a55c95096b Correctly kill vLLM processes after finishing serving benchmarks (#21641) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2025-07-25 19:06:21 -07:00
Huy Do 940af1f03a Add the instruction to run e2e validation manually before release (#21023) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2025-07-20 22:29:18 -07:00
Huy Do cf8cc32674 Fix a couple of Voxtral tests (#21218) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2025-07-19 09:13:41 +00:00
Huy Do 6c9837a761 Fix cuda_archs_loose_intersection when handling sm_*a (#20207) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2025-06-29 16:52:34 -07:00
Huy Do c48c6c4008 Add a doc on how to update PyTorch version (#19705) 2025-06-17 18:10:37 +08:00
Huy Do bc956b38d0 Only build CUTLASS MoE kernels on Hopper (#19648) 2025-06-14 11:44:15 -07:00
Huy Do 0678b52251 Handle non-serializable objects when dumping benchmark results (#19114) 2025-06-04 22:40:04 -07:00
Huy Do 1645b60196 Use prebuilt FlashInfer x86_64 PyTorch 2.7 CUDA 12.8 wheel for CI (#18537) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2025-05-23 21:17:16 +00:00
Huy Do b74d888c63 Fix more broken speculative decode tests (#17450) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2025-05-01 06:05:58 -07:00
Huy Do 88fcf00dda Fix some speculative decode tests with tl.dot (#17371) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2025-04-29 19:41:02 -07:00
Huy Do 2c4f59afc3 Update PyTorch to 2.7.0 (#16859) 2025-04-29 19:08:04 -07:00
Huy Do 092475f738 [ROCm] Tweak the benchmark script to run on ROCm (#14252) 2025-04-03 17:12:48 -07:00
Huy Do e7ef74e26e Fix some issues with benchmark data output (#13641) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2025-02-24 10:23:18 +08:00
Huy Do 45186834a0 Run v1 benchmark and integrate with PyTorch OSS benchmark database (#13068) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2025-02-17 08:16:32 +00:00