iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
23,341 Commits 3 Branches 0 Tags
49d708e158f7b7cfbb00c26f088cd9139c0cf180
Commit Graph
81 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Kevin H. Luu 3481e40743 [chore] Remove models weight on S3 logic (#27725) 
Signed-off-by: kevin <kevin@anyscale.com>
 2025-10-29 10:29:49 +00:00
Kevin H. Luu d981396778 [release] Change dockerhub username for TPU release (#18389) 2025-05-19 23:49:23 -07:00
Kevin H. Luu 3ec97e2cc5 [release] Add command to clean up Docker containers/images in TPU release machine (#17606) 2025-05-02 18:54:34 -07:00
Kevin H. Luu 4055130a85 [release] Always git fetch all to get latest tag on TPU release (#17322) 2025-04-29 17:52:11 -07:00
Kevin H. Luu 0adba91547 [CI] Fix benchmark script level (#16089) 2025-04-05 03:36:01 -07:00
Kevin H. Luu 4dc52e1c53 [CI] Reorganize .buildkite directory (#16001) 
Signed-off-by: kevin <kevin@anyscale.com>
 2025-04-04 12:16:20 -07:00
Kevin H. Luu 3d45e3d749 [release] Tag vllm-cpu with latest upon new version released (#15193) 2025-03-20 01:19:10 -07:00
Kevin H. Luu 7097b4cc1c [release] Remove log cleanup commands from TPU job (#14838) 2025-03-14 11:59:52 -07:00
Kevin H. Luu f1f632d9ec [ci] Reduce number of tests in fastcheck (#14782) 2025-03-13 20:43:45 -07:00
Kevin H. Luu ce20124671 [release] Add force remove for TPU logs (#14697) 2025-03-12 22:35:18 +00:00
Kevin H. Luu 9f583e360c [release] Add commands to clean up logs on TPU release node (#14642) 2025-03-12 00:14:50 +00:00
Kevin H. LuuandEC2 Default User f90a375593 [ci] Add logic to change model to S3 path only when S3 CI env var is on (#13727) 
Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-63-253.us-west-2.compute.internal>
 2025-02-24 06:32:11 +00:00
Kevin H. Luu 2c5e637b57 [ci] Use env var to control whether to use S3 bucket in CI (#13634) 2025-02-22 19:19:45 -08:00
Kevin H. Luu 34ad27fe83 [ci] Fix metrics test model path (#13635) 2025-02-20 22:12:10 -08:00
Kevin H. Luu a64a84433d [2/n][ci] S3: Use full model path (#13564) 
Signed-off-by: <>
 2025-02-20 01:20:15 -08:00
Kevin H. Luu aa1e62d0db [ci] Fix spec decode test (#13600) 2025-02-20 16:56:00 +08:00
Kevin H. Luu 88f6ba3281 [ci] Add AWS creds for AMD (#13572) 2025-02-20 03:56:06 +00:00
Kevin H. LuuandEC2 Default User 473f51cfd9 [3/n][CI] Load Quantization test models with S3 (#13570) 
Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
 2025-02-20 10:12:30 +08:00
Kevin H. LuuandEC2 Default User 3b05cd4555 [perf-benchmark] Fix ECR path for premerge benchmark (#13512) 
Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
 2025-02-19 07:56:11 +00:00
Kevin H. LuuandEC2 Default User d5d214ac7f [1/n][CI] Load models in CI from S3 instead of HF (#13205) 
Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
 2025-02-19 07:34:59 +00:00
Kevin H. LuuandEC2 Default User 9aa95b0e6a [perf-benchmark] Allow premerge ECR (#13509) 
Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
 2025-02-19 05:13:41 +00:00
Kevin H. Luu 9f9704dca6 [perf-benchmark] cleanup unused Docker images and volumes in H100 benchmark instance (#12706) 2025-02-12 19:51:33 -08:00
Kevin H. LuuandEC2 Default User 842b0fd402 [ci] Add more source file dependencies for some tests (#13123) 
Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
 2025-02-11 20:38:10 -08:00
Kevin H. Luu 91e876750e [misc] Fix setup.py condition to avoid AMD from being mistaken with CPU (#13022) 
Signed-off-by: kevin <kevin@anyscale.com>
 2025-02-10 18:06:16 -08:00
Kevin H. Luu fde71262e0 [misc] Add retries with exponential backoff for HF file existence check (#13008) 2025-02-10 01:15:02 -08:00
Kevin H. LuuandEC2 Default User b260782357 [misc] Revert # 12833 (#12857) 
Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
 2025-02-06 16:29:12 -08:00
Kevin H. LuuandEC2 Default User e152f29502 [misc] Reduce number of config file requests to HuggingFace (#12797) 
Signed-off-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
 2025-02-06 14:59:18 +00:00
Kevin H. Luu 35b7a05507 [ci] Upgrade transformers to 4.48.2 in CI dependencies (#12599) 2025-01-31 21:22:23 -08:00
Kevin H. Luu 415f19474d [release] Add input step to ask for Release version (#12631) 
Instead of having to create a new build with release version put in as
env var.
 2025-01-31 13:39:36 -08:00
Kevin H. Luu 64ea24d0b3 [ci/lint] Add back default arg for pre-commit (#12279) 
Signed-off-by: kevin <kevin@anyscale.com>
 2025-01-22 01:15:27 +00:00
Kevin H. Luu fd3a62a122 [perf-benchmark] Fix dependency for steps in benchmark pipeline (#11710) 2025-01-02 22:38:37 -08:00
Kevin H. Luu ccb1aabcca [benchmark] Remove dependency for H100 benchmark step (#11572) 2024-12-30 12:27:07 -08:00
Kevin H. Luu 9974fca047 [ci/build] Fix entrypoints test and pin outlines version (#11088) 2024-12-11 01:01:53 -08:00
Kevin H. Luu 3fb4b4f163 [ci/build] Fix AMD CI dependencies (#11087) 2024-12-11 00:39:53 -08:00
Kevin H. Luu edc4fa3188 [ci/build] Recompile CI dependencies list with Python 3.12 (#11013) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-12-09 11:46:58 -08:00
Kevin H. Luu 7883c2bbe7 [benchmark] Make H100 benchmark optional (#10908) 2024-12-04 17:02:17 -08:00
Kevin H. Luu c92acb9693 [ci/build] Update vLLM postmerge ECR repo (#10887) 2024-12-04 09:01:20 +00:00
Kevin H. Luu c9ca4fce3f [ci/build] Job to build and push release image (#10877) 2024-12-04 15:02:40 +08:00
Kevin H. Luu fa2dea61df [ci/build] Change queue name for Release jobs (#10875) 2024-12-04 15:02:16 +08:00
Kevin H. Luu ed701ca963 [ci/build] Combine nightly and optional (#10465) 2024-11-19 21:36:03 -08:00
Kevin H. Luu 284203f171 [ci/build] Have dependabot ignore all patch update (#10436) 
We have too many dependencies and all patch updates can be a little noisy. This is to have dependabot ignore all patch version updates.
 2024-11-19 01:04:25 +00:00
Kevin H. Luu d522034c85 [ci/build] Have dependabot ignore pinned dependencies (#9935) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-11-01 23:56:13 +00:00
Kevin H. Luu b63c64d95b [ci/build] Configure dependabot to update pip dependencies (#9811) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-10-31 15:55:38 -07:00
Kevin H. Luu 890ca36072 Revert "[Bugfix] Use host argument to bind to interface (#9798)" (#9852) 2024-10-31 01:44:51 +00:00
Kevin H. Luu 62fac4b9aa [ci/build] Pin CI dependencies version with pip-compile (#9810) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-10-30 03:34:55 +00:00
Kevin H. Luu 9f7b4ba865 [ci/Build] Skip Chameleon for transformers 4.46.0 on broadcast test #9675 (#9676) 2024-10-24 20:59:00 -07:00
Kevin H. Luu a78c6ba7c8 [ci/build] Add placeholder command for custom models test (#9262) 2024-10-10 15:45:09 -07:00
Kevin H. LuuandCody Yu aaccca2b4d [CI/Build] Fix machete generated kernel files ordering (#8976) 
Signed-off-by: kevin <kevin@anyscale.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
 2024-10-01 03:33:12 +00:00
Kevin H. Luu 1425a1bcf9 [ci] Add CODEOWNERS for test directories (#8795) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-10-01 00:47:08 +00:00
Kevin H. Luu d9cfbc891e [ci] Soft fail Entrypoints, Samplers, LoRA, Decoder-only VLM (#8872) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-09-26 15:02:16 -07:00
Kevin H. Luu ba262c4e5a [ci] Mark LoRA test as soft-fail (#8160) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-09-04 20:33:12 -07:00
Kevin H. Luu f1575dc99f [ci] Fix GHA workflow (#8129) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-09-03 13:25:09 -07:00
Kevin H. Luu 95a178f861 [CI] Only PR reviewers/committers can trigger CI on PR (#8124) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-09-03 11:32:27 -07:00
Kevin H. Luu 666ad0aa16 [ci] Cleanup & refactor Dockerfile to pass different Python versions and sccache bucket via build args (#7705) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-08-22 20:10:55 +00:00
Kevin H. Luu 0df7ec0b2d [ci] Install Buildkite test suite analysis (#7667) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-08-19 19:55:04 -07:00
Kevin H. Luu 5469146bcc [ci] Remove fast check cancel workflow (#7455) 2024-08-12 21:19:51 -07:00
Kevin H. Luu 1137f343aa [ci] Cancel fastcheck when PR is ready (#7433) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-08-12 10:59:14 -07:00
Kevin H. Luu 9b3e2edd30 [ci] Cancel fastcheck run when PR is marked ready (#7427) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-08-12 10:56:52 -07:00
Kevin H. Luu 65950e8f58 [ci] Entrypoints run upon changes in vllm/ (#7423) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-08-12 10:18:03 -07:00
Kevin H. Luu 469b3bc538 [ci] Make building wheels per commit optional (#7278) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-08-07 11:34:25 -07:00
Kevin H. Luu 4fbf4aa128 [ci] GHA workflow to remove ready label upon "/notready" comment (#6921) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-07-29 17:03:45 -07:00
Kevin H. Luu 2eb9f4ff26 [ci] Mark tensorizer as soft fail and separate from grouped test (#6810) 
[ci] Mark tensorizer test as soft fail and separate it from grouped test in fast check (#6810)
Signed-off-by: kevin <kevin@anyscale.com>
 2024-07-25 18:08:33 -07:00
Kevin H. Luu 69d5ae38dc [ci] Use different sccache bucket for CUDA 11.8 wheel build (#6656) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-07-22 14:20:41 -07:00
Kevin H. Luu 2d4733ba2d Fix PR comment bot (#6554) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-07-18 14:48:29 -07:00
Kevin H. Luu ecdb462c24 [ci] Reword Github bot comment (#6534) 2024-07-18 08:01:45 -07:00
Kevin H. Luu d6f3b3d5c4 Pin sphinx-argparse version (#6453) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-07-16 01:26:11 +00:00
Kevin H. Luu 16ff6bd58c [ci] Fix wording for GH bot (#6398) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-07-12 16:34:37 -07:00
Kevin H. Luu 4dbebd03cc [ci] Add GHA workflows to enable full CI run (#6381) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-07-12 11:36:26 -07:00
Kevin H. Luu b75bce1008 [ci] Add grouped tests & mark tests to run by default for fastcheck pipeline (#6365) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-07-12 09:58:38 -07:00
Kevin H. Luu a0550cbc80 Add support for multi-node on CI (#5955) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-07-09 12:56:56 -07:00
Kevin H. Luu e9de9dd551 [ci] Remove aws template (#5757) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-06-24 21:09:02 -07:00
Kevin H. Luu 949e49a685 [ci] Limit num gpus if specified for A100 (#5694) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-06-19 16:30:03 -07:00
Kevin H. Luu 3ee5c4bca5 [ci] Add A100 queue into AWS CI template (#5648) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-06-19 08:42:13 -06:00
Kevin H. Luu 19091efc44 [ci] Setup Release pipeline and build release wheels with cache (#5610) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-06-18 11:00:36 -07:00
Kevin H. Luu 13db4369d9 [ci] Deprecate original CI template (#5624) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-06-18 14:26:20 +00:00
Kevin H. Luu 916d219d62 [ci] Use sccache to build images (#5419) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-06-12 17:58:12 -07:00
Kevin H. Luu 8b82a89997 [ci] Add AMD, Neuron, Intel tests for AWS CI and turn off default soft fail for GPU tests (#5464) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-06-12 14:00:18 -07:00
Kevin H. Luu 76477a93b7 [ci] Fix Buildkite agent path (#5392) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-06-10 18:58:07 -07:00
Kevin H. Luu c5602f0baa [ci] Mount buildkite agent on Docker container to upload benchmark results (#5330) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-06-10 09:22:34 -07:00
Kevin H. Luu f7f9c5f97b [ci] Use small_cpu_queue for doc build (#5331) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-06-10 09:21:11 -07:00
Kevin H. Luu 4f0d17c05c New CI template on AWS stack (#5110) 
Signed-off-by: kevin <kevin@anyscale.com>
 2024-06-03 16:16:43 -07:00