iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
23,341 Commits 3 Branches 0 Tags
patches
Commit Graph
89 Commits
Author SHA1 Message Date
Rohan PotdarClaude Opus 5.5Micah WilliamsonKevin H. LuuAndreas Karatzas
 		b2456c622b [ROCm][CI] Make ROCm 10.0 the default image; keep ROCm 7.2 as -rocm72 (#58761) 
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-10-17 21:43:59 -05:00
Nick HillandIlia Yastrebov eaf25f675a [NIXL] Prepare KV transfer descriptors as NIXL 1.5 strided lists (#61032) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Ilia Yastrebov <iyastrebov@nvidia.com>
 2026-10-14 18:07:24 +02:00
Nils MattesonSimon Momergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		76d3929916 [Docker] Compile Python bytecode at image build time (#55422) 
Signed-off-by: Nils Matteson <nilsmatteson@icloud.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-10-01 02:20:17 +00:00
Rohan PotdarandClaude Opus 5.5 7a160c6fe5 [ROCm][CI] Pin OpenTelemetry to LMCache's cap in the ROCm images (#59051) 
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-28 12:33:09 -05:00
Micah Williamson b0d2b854f6 [ROCm]Keep LMCache OpenTelemetry on the image's 1.40 stack (#59056) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-09-28 15:49:48 +00:00
Rohan PotdarClaude Fable 5jpvillam
 		e440b75bb6 [ROCm] Bump torch 2.13, triton 3.8, torchaudio, torchvision (#50605) 
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: jpvillam <juan.villamizar@amd.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: jpvillam <juan.villamizar@amd.com>
 2026-09-25 14:55:52 -05:00
Andreas KaratzasandCodex fa94450b74 [CI][ROCm] Prevent Model Executor apt stalls (#58607) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-24 23:18:45 -05:00
Reidandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 8b365ff949 [ROCm][Build] Filter crate tags from vLLM version detection (#57744) 
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2026-09-25 03:06:05 +00:00
Misha Goin 58aa2f1ef1 [Refactor] Move auxiliary files out of the repository root (#58572) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2026-09-24 12:38:56 -07:00
Andreas KaratzasandOpenAI Codex 36bc694889 [ROCm][CI] Include Python tooling in ROCm CI artifacts (#58271) 
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-09-23 16:44:54 +08:00
LucainandClaude Opus 5 6b858751f6 [docs] Fix legacy hf CLI references (vllm) (#57958) 
Signed-off-by: Wauplin <lucainp@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-21 15:32:27 +00:00
djramic 5392fbca2a [ROCm][Docker] Pin AINIC apt repo to snapshot 1.117.5-a-77 (#56459) 
Signed-off-by: Djordje Ramic <djoramic@amd.com>
 2026-09-11 14:14:16 +00:00
shikamd123 1a522b6949 [ROCm] [Docker] Upgrade default AINIC repo to ship libionic 54.0-187-1 (#54112) 
Signed-off-by: Shiksha Patel <shiksha.patel@amd.com>
 2026-09-08 19:21:18 +00:00
Giuseppe GrossiandAndreas Karatzas e47356c63e [ROCm][Installation] Add mooncake package to image using public wheels (#55002) 
Signed-off-by: Giuseppe Grossi <ggrossi@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-09-02 21:48:36 -05:00
Giuseppe GrossiandAndreas Karatzas 56b5495377 [ROCm][AMD][Installation] Add mooncake build to rocm base image (#52650) 
Signed-off-by: Giuseppe Grossi <ggrossi@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-09-02 00:14:58 -05:00
Andreas KaratzasandOpenAI Codex 907b1a7f22 [CI][ROCm] Avoid redundant image pulls during smoke validation (#54408) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-08-31 21:48:25 -05:00
Bugen ZhaoOpenAI CodexNick Hill
 		83c5d59209 [Rust Frontend] Replace external protoc with pure Rust lib protox (#52892) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
 2026-08-20 18:43:51 -07:00
Bugen ZhaoNick HillAndreas Karatzas
 		c89d692cb5 [Build] Propagate vLLM version to Rust binaries (#52593) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-08-17 23:37:37 -07:00
Hongxia YangandAndreas Karatzas e68fb75b25 [ROCm][AMD][Installation] add LMCache kv-connector installation and runtime packages to docker image (#51208) 
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-08-17 16:58:48 -05:00
Nick HillandClaude Opus 4.8 615d4cfade [Core] Check for GPU<->CPU syncs during CI (#43107) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-08-14 17:42:05 -07:00
Rohan Potdar 9df9b0b0a1 [ROCm]: Drop pybind11 from Dockerfile.rocm to prevent version mismatch (#52400) 
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
 2026-08-14 23:50:23 +00:00
Andreas Karatzas 419b51b385 [Bugfix][ROCm][CI] Stabilize build context and source caches (#51721) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
 2026-08-10 21:51:39 -05:00
Andreas KaratzasandOpenAI Codex 7f6432cc0d [ROCm][CI] Reuse equivalent ROCm CI images (#48646) 
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-08-09 01:25:03 -07:00
Andreas Karatzas 76d995df2c [CI][ROCm] Export Helion benchmark script in test artifacts (#50726) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-08-03 13:09:44 -05:00
MattandAndreas Karatzas d91f7af7d0 [Hardware][AMD][Kernel][CI][Bugfix] Fix ROCm DeepEP FP8 max (#50467) 
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-30 21:37:36 -05:00
Andreas KaratzasandOpenAI Codex 1479bd9e9d [ROCm][CI] Prepare AMD mirrors for regating (#49270) 
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-07-23 18:42:25 -07:00
Andreas Karatzas 16aca639b7 [ROCm] Upgrade NIXL and UCX (#49251) 
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
 2026-07-21 22:30:02 -05:00
Andreas Karatzas 3ad85e0de4 [CI][AMD] Configure MI300 tests for native execution without DinD (#48387) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-15 02:14:16 +00:00
Andreas KaratzasandMatthew Wong b7b58d1eba [ROCm][CI] Cache Rust builds by source inputs (#46527) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
 2026-07-13 01:14:08 -05:00
Andreas Karatzas 8484ca5d45 [ROCm][CI] Adding Rust parity (#47478) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-06 15:05:39 -07:00
Bugen Zhao b790c84cde [CI] Enable sccache for Rust build under CUDA/ROCm (#45246) 2026-07-02 23:45:41 -07:00
Andreas Karatzas 407f406300 [ROCm][CI] Adding metadata (#47477) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-02 17:45:23 -07:00
Matt a2a92cbbaa [Hardware][AMD][CI] Tweak mirrored tests; improve CI base dependency change detection (#46930) 
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
 2026-06-28 00:07:14 -07:00
Bugen Zhao 43914dd743 [Rust Frontend] Add Python bridge for Rust tool parsers (#44624) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-06-11 04:51:06 +00:00
Bugen Zhao fdfb2566c0 [Rust Frontend] [CI] Unify Rust artifact builds with setuptools-rust (#44981) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-06-10 17:48:34 +08:00
Andreas Karatzas 967c5c3bc3 [ROCm][CI] Stage C mirrors (#42793) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-06-07 23:00:59 -07:00
Andreas Karatzas 22c2e87555 [CI] Reverted gitignore changes (#44497) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-06-04 00:37:44 -07:00
Andreas Karatzas 87954eb50e [ROCm][CI] Optimize ROCm Docker build: registry cache, DeepEP, and ci-bake script (#36949) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-06-02 23:43:07 -07:00
Andreas Karatzas 33e94fc3ad [ROCm][CI] Stabilize Cargo cache and pre-test image checks (#43815) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-05-28 11:24:44 +08:00
Bugen ZhaoNick HillEric CurtinDev-X25874Will.houWill.hou
 		39910f2b25 [Rust Frontend] Move code from vllm-frontend-rs (#43283) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Eric Curtin <eric.curtin@docker.com>
Signed-off-by: Dev-X25874 <283057883+Dev-X25874@users.noreply.github.com>
Signed-off-by: Will.hou <1205157517@qq.com>
Signed-off-by: Will.hou <willamhou@ceresman.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Eric Curtin <eric.curtin@docker.com>
Co-authored-by: Dev-X25874 <283057883+Dev-X25874@users.noreply.github.com>
Co-authored-by: Will.hou <1205157517@qq.com>
Co-authored-by: Will.hou <willamhou@ceresman.com>

Please see https://github.com/Inferact/vllm-frontend-rs for full original commit history.
 2026-05-21 17:21:48 -07:00
haosdent caf69823d6 [CI] Pin protoc binary in rust-build stages (#43292) 
Signed-off-by: haosdent <haosdent@gmail.com>
 2026-05-21 03:38:07 -07:00
Nick HillandBugen Zhao f2ace1d57d [Frontend][RFC] Rust front-end integration (#40848) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
 2026-05-21 12:24:48 +08:00
haic0rootJhao-Ting Chensimondanielsson
 		ce29c26b31 Update Dockerfile.rocm for AINIC & Thor NIC (#40453) 
Signed-off-by: root <root@gbt350-odcdh5-wbb3.png-odc.dcgpu>
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: root <root@gbt350-odcdh5-wbb3.png-odc.dcgpu>
Co-authored-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
Co-authored-by: simondanielsson <simon.danielsson99@hotmail.com>
 2026-05-14 15:24:27 +08:00
Simon Danielsson f9b9bf3bbb [CI][ROCm] Ship RIXL with vllm/vllm-openai-rocm (#41634) 
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
 2026-05-08 07:05:17 +00:00
Andreas Karatzas 32964e7700 [ROCm][CI] Upgraded UCX and RIXL (#41210) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-05-01 16:40:47 +09:00
tejTJianHAIAI
 		121dbe7a22 [ROCm] ROCm DeepEP API updated to latest (#39721) 
Signed-off-by: Tej Kiran <vpolamre@amd.com>
Signed-off-by: tej <37236721+itej89@users.noreply.github.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: HAIAI <39548240+HAIAI@users.noreply.github.com>
 2026-04-30 07:46:59 -07:00
Andreas Karatzas 95995bbef8 [ROCm][Engine] Fix GPU memory leaks in engine shutdown and test workaround for async KV prefix cache reset (#38503) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-04-25 05:25:20 +00:00
TJian 583e6f2226 [ROCm] [Wheel] [Bugfix] [Critical] Remove any packages installed from github from rocm.txt e.g fastsafetensors as it is incompatible with uv pip (#40461) 
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
 2026-04-22 00:18:07 +00:00
Theresa ShanTheresa ShanTJian
 		2390caf157 Enable building MoRI with AMD AINIC stack (#38371) 
Signed-off-by: Theresa Shan <thshan@smci355-ccs-aus-n08-21.prov.aus.ccs.cpe.ice.amd.com>
Signed-off-by: Theresa Shan <theresa.shan@amd.com>
Co-authored-by: Theresa Shan <thshan@smci355-ccs-aus-n08-21.prov.aus.ccs.cpe.ice.amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
 2026-04-20 11:17:59 -07:00
Ryan Rock 58da4ee047 [AMD][CI] Update DeepEP branch (#38396) 
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
 2026-04-17 14:30:20 -05:00