iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
23,099 Commits 3 Branches 0 Tags
429a3da6654facfa792995bbbc75ee64cf83be56
Commit Graph
473 Commits
Author SHA1 Message Date
josh-schell-amdandClaude Opus 5.5 273a04964e [ROCm] Bump AITER to v0.1.25 and relax the DSv4.1 mono MoE tolerance (#61697) 
Signed-off-by: josh schell <josh.schell@amd.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
 2026-10-14 23:50:24 +00:00
Nick HillandIlia Yastrebov eaf25f675a [NIXL] Prepare KV transfer descriptors as NIXL 1.5 strided lists (#61032) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Ilia Yastrebov <iyastrebov@nvidia.com>
 2026-10-14 18:07:24 +02:00
Ronald ec8a372566 [ROCm][Bugfix] Pin AITER back to v0.1.24.post1 for DSv4.1 mono decode numerics (#61559) 
Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
 2026-10-14 00:19:38 -07:00
Andrey TalmanAndrey TalmanClaude Opus 5.5
 		30e79c3a76 [Core] Update PyTorch to 2.14.0, torchvision to 0.29.0, triton to 3.8.0 (release channel) (#52183) 
Signed-off-by: Andrey Talman <atalman@users.noreply.github.com>
Signed-off-by: Andrey Talman <atalman@fb.com>
Co-authored-by: Andrey Talman <atalman@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-14 00:17:59 -07:00
josh-schell-amdandMicah Williamson 7a9d3db896 [ROCm] Bump ROCm base images to AITER v1.25.0 (#61230) 
Signed-off-by: josh schell <josh.schell@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>
 2026-10-13 18:55:09 -05:00
Puneet Sharma 5ca26880ad Optimize ppc64le vLLM runtime image size (#48074) 
Signed-off-by: puneetsharma21 <puneet.sharma21@ibm.com>
 2026-10-10 12:39:58 +08:00
Misha GoinandClaude Opus 5.5 29e4d2d42e [Frontend][Build] Add vllm download-kernels for FlashInfer precompiled kernels (#58765) 
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-09 21:22:35 -07:00
Tiezhen WANGandKevin H. Luu 295c062db8 Remove sudo from dockerfile command (#60488) 
Signed-off-by: Tiezhen WANG <38108242+xianbaoqian@users.noreply.github.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
 2026-10-08 19:24:56 -07:00
Harry MellorandClaude Opus 5.5 21d9758459 Remove Python 3.10 support now that it is EOL (#60402) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-08 02:30:52 -07:00
Artem Perevedentsev 4ac5a36a8e [CI/Build][NVIDIA] Build NIXL with NIXL EP from source in Rubin image (#60090) 
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
 2026-10-08 02:44:17 +04:00
Chinmay-Kulkarni-AMDandCursor Agent 533d81b4b0 [ZenCPU][Test] Add zentorch/torch version pin consistency test (#52888) 
Signed-off-by: Chinmay Kulkarni <Chinmay.Kulkarni@amd.com>
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
 2026-10-06 13:12:19 +08:00
Micah WilliamsonandFangzhou Ai ac8c2130a8 [ROCm] Bump AITER to 0.1.24.post1 (#59794) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Fangzhou Ai <31551580+Fangzhou-Ai@users.noreply.github.com>
 2026-10-05 00:19:19 -04:00
Shang WangClaude Opus 5.5Tyler Michael SmithShengqi Chen
 		8e443871f0 [CI/Build][NVIDIA] Build Rubin images on the public nvidia/cuda base image (#59288) 
Signed-off-by: Shang Wang <samshang.wang@mail.utoronto.ca>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
 2026-10-03 00:12:33 +00:00
Nils MattesonSimon Momergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		76d3929916 [Docker] Compile Python bytecode at image build time (#55422) 
Signed-off-by: Nils Matteson <nilsmatteson@icloud.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-10-01 02:20:17 +00:00
rasmith 42a3dd5fec [ROcm][BugFix][The Rock] Update The Rock dockerfile to most recent Triton 3.8 (#59287) 
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
 2026-09-30 11:15:03 -05:00
rasmithandMisha Goin c4df37dfcc [ROCm][BugFix][The Rock] Fix mori build for the rock (#59372) 
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
 2026-09-30 10:51:40 -05:00
Wei Zhao 678baf5372 [Dependency] Upgrade FlashInfer to 0.7.0.post1 (#59323) 
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
 2026-09-30 02:34:36 +00:00
Chaitanya Sri Krishna Lollashikamd123Andreas Karatzas
 		467d81d9a0 [ROCm] Upgrade MoRI version on rocm dockers required for WideEP DP16 DI CI enablement and fixes for combine API (#56073) 
Signed-off-by: Shiksha Patel <shiksha.patel@amd.com>
Signed-off-by: lcskrishna <lollachaitanya@gmail.com>
Co-authored-by: shikamd123 <shikpate@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-09-29 18:07:31 +00:00
Kevin H. LuuandClaude Opus 5.5 aedaba8664 [CI/Build] Skip the snapshot runtime on CUDA 12.x images (#59118) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-28 20:17:59 -07:00
Rohan PotdarandClaude Opus 5.5 7a160c6fe5 [ROCm][CI] Pin OpenTelemetry to LMCache's cap in the ROCm images (#59051) 
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-28 12:33:09 -05:00
Micah Williamson b0d2b854f6 [ROCm]Keep LMCache OpenTelemetry on the image's 1.40 stack (#59056) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-09-28 15:49:48 +00:00
Louie Tsai ccfd1cea75 [CPU] Include vLLM Recipes tooling in release image to deploy models using vLLM Recipes (#58796) 
Signed-off-by: louie-tsai <louie.tsai@intel.com>
 2026-09-28 16:46:53 +08:00
Rehan KhanandLi, Jiang <jiang1.li@intel.com> fd2f3fcfa5 [CPU] Add video inferencing via torchcodec on s390x (#58693) 
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2026-09-28 14:16:59 +08:00
Turner JabbourandClaude Sonnet 5 2407f405b5 [CI] Allowlist-shrink batch 1: wire 17 root-level tests + drop 5 stale watermarking entries into misc.yaml (#58055) 
Signed-off-by: Turner Jabbour <doubleujabbour@gmail.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
 2026-09-27 22:23:46 -07:00
zhao, zhenhuiandjiang1.li 5eaa50f151 [CPU] Build CPU wheels on Ubuntu 22.04 with AMX-FP8 support (#58515) 
Signed-off-by: zhejiangxiaomai <zhenhui.zhao@intel.com>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: jiang1.li <jiang1.li@intel.com>
 2026-09-28 11:46:02 +08:00
Fangzhou AiCursorAndreas Karatzas
 		31afa4f1bb [ROCm] Bump AITER to v0.1.23 (#58867) 
Signed-off-by: fai <fangzhouai@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-09-27 19:04:58 -05:00
Anton Peganovmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>OpenAI Codex
 		73859fec58 [Frontend] Switch Python Harmony dependency to oss-harmony (#55128) 
Signed-off-by: Anton Peganov <apeganov@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-09-28 00:43:56 +04:00
Rohan PotdarClaude Fable 5jpvillam
 		e440b75bb6 [ROCm] Bump torch 2.13, triton 3.8, torchaudio, torchvision (#50605) 
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: jpvillam <juan.villamizar@amd.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: jpvillam <juan.villamizar@amd.com>
 2026-09-25 14:55:52 -05:00
Andreas KaratzasandCodex fa94450b74 [CI][ROCm] Prevent Model Executor apt stalls (#58607) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-24 23:18:45 -05:00
Reidandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 8b365ff949 [ROCm][Build] Filter crate tags from vLLM version detection (#57744) 
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2026-09-25 03:06:05 +00:00
Misha Goin 58aa2f1ef1 [Refactor] Move auxiliary files out of the repository root (#58572) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2026-09-24 12:38:56 -07:00
Li, Jiang b44895cf93 [CPU] Use pre-built triton (#58140) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2026-09-24 16:12:34 +08:00
Wei ZhaoCodexYongye ZhuKevin H. Luu
 		44bf011f44 [Dependency] Upgrade FlashInfer version to 0.7.0 (#58069) 
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
 2026-09-23 22:45:23 -07:00
Yan MaandKunshang Ji e34489a543 [XPU] upgrade to PyTorch 2.14 (#56013) 
Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-09-23 09:18:52 +00:00
Andreas KaratzasandOpenAI Codex 36bc694889 [ROCm][CI] Include Python tooling in ROCm CI artifacts (#58271) 
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-09-23 16:44:54 +08:00
rasmith 111d7d7be2 [ROCm][Build][The Rock] Bump Triton version to 3.8.x tip-of-tree with source build in The Rock image (#58006) 
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
 2026-09-22 18:05:13 -05:00
Jee Jee Li d90f0eade5 [Build] Fix CUDA 12 KV connector dependency selection (#57945) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-09-22 06:13:07 -07:00
Kevin H. LuuandClaude Fable 5.1 64a48b19b4 [CI] Emit a kernel symbol map from the csrc build (opt-in, for test selection) (#58097) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
 2026-09-22 01:37:34 -07:00
AlecCodexBugen Zhao
 		f07e227ee9 [Docker] Expose bundled vllm-rs on PATH (#57606) 
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
Signed-off-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-21 20:03:03 -07:00
Turner JabbourClaude Sonnet 5Kevin H. LuuNick Hill
 		e9f169d16b [CI] Add pre-commit check that new tests are tethered to Buildkite jobs (#54867) 
Signed-off-by: Turner Jabbour <doubleujabbour@gmail.com>
Signed-off-by: Turner <doubleujabbour@gmail.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
 2026-09-21 18:36:45 -07:00
Nils MattesonTaneem IbrahimelehayymAndreas Karatzasmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		13058faa49 [Frontend] Add reusable TP1 initialized-engine snapshots (#51360) 
Signed-off-by: Nils Matteson <nilsmatteson@icloud.com>
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: elehayym <52448798+Yuzu23@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-09-21 23:18:49 +00:00
vllm-agentandkimi-no-na-wa 8644d2af2f [CI][Build] Harden triton-cpu sleef submodule fetch in CPU image build (#57871) 
Signed-off-by: kimi-no-na-wa <kimi-no-na-wa@users.noreply.github.com>
Co-authored-by: kimi-no-na-wa <kimi-no-na-wa@users.noreply.github.com>
 2026-09-21 15:30:14 -07:00
LucainandClaude Opus 5 6b858751f6 [docs] Fix legacy hf CLI references (vllm) (#57958) 
Signed-off-by: Wauplin <lucainp@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-21 15:32:27 +00:00
Micah Williamson 468663a5e5 [ROCm] Bump AITER to v0.1.22.post1 (#56885) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-09-18 18:36:45 -07:00
Matt 4c6c1a40b3 [ROCm][Bugfix] Fix intermittent ROCR host segfault (#57328) 
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
 2026-09-18 03:13:45 -07:00
Tyler Michael SmithOpenAI CodexOpenAI CodexMisha Goinmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		4f9a41ac94 [CI/Build][Hardware][NVIDIA] Add Rubin CUDA 13.4 nightly images (#55953) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-09-17 08:05:31 -07:00
coderfornowandLi, Jiang <jiang1.li@intel.com> 88afb77700 [CPU][s390x] Pin protobuf to 7.36.1 and drop C++ extension removal workaround (#54978) 
Signed-off-by: coderfornow <Ritik.Dhiranan@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2026-09-17 16:35:17 +08:00
MattandClaude Code 68f2c7e74f [ROCm][CI] Fix Nixl+Offloading PD edge cases on TheRock image (#57249) 
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Claude Code <noreply@anthropic.com>
 2026-09-16 22:56:13 -05:00
Rohan PotdarClaude Opus 4.8Matt
 		3e267bae70 [ROCm] triton+triton_kernels 3.8 mxfp4 MoE support (gpt-oss + DeepSeek-V4) (#55934) 
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Matt <156021403+mawong-amd@users.noreply.github.com>
 2026-09-16 20:03:34 -05:00
Andreas KaratzasandCodex 711768fc17 [CI][ROCm] Add opt-in TheRock builds for AMD CI (#56351) 
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-16 00:09:45 -05:00