iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
22,600 Commits 3 Branches 0 Tags
14e3902d5136e2fb00ef86c05fdc8d098f736283
Commit Graph
463 Commits
Author SHA1 Message Date
Chinmay-Kulkarni-AMDandCursor Agent 533d81b4b0 [ZenCPU][Test] Add zentorch/torch version pin consistency test (#52888) 
Signed-off-by: Chinmay Kulkarni <Chinmay.Kulkarni@amd.com>
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
 2026-10-06 13:12:19 +08:00
Micah WilliamsonandFangzhou Ai ac8c2130a8 [ROCm] Bump AITER to 0.1.24.post1 (#59794) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Fangzhou Ai <31551580+Fangzhou-Ai@users.noreply.github.com>
 2026-10-05 00:19:19 -04:00
Shang WangClaude Opus 5.5Tyler Michael SmithShengqi Chen
 		8e443871f0 [CI/Build][NVIDIA] Build Rubin images on the public nvidia/cuda base image (#59288) 
Signed-off-by: Shang Wang <samshang.wang@mail.utoronto.ca>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
 2026-10-03 00:12:33 +00:00
Nils MattesonSimon Momergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		76d3929916 [Docker] Compile Python bytecode at image build time (#55422) 
Signed-off-by: Nils Matteson <nilsmatteson@icloud.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-10-01 02:20:17 +00:00
rasmith 42a3dd5fec [ROcm][BugFix][The Rock] Update The Rock dockerfile to most recent Triton 3.8 (#59287) 
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
 2026-09-30 11:15:03 -05:00
rasmithandMisha Goin c4df37dfcc [ROCm][BugFix][The Rock] Fix mori build for the rock (#59372) 
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
 2026-09-30 10:51:40 -05:00
Wei Zhao 678baf5372 [Dependency] Upgrade FlashInfer to 0.7.0.post1 (#59323) 
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
 2026-09-30 02:34:36 +00:00
Chaitanya Sri Krishna Lollashikamd123Andreas Karatzas
 		467d81d9a0 [ROCm] Upgrade MoRI version on rocm dockers required for WideEP DP16 DI CI enablement and fixes for combine API (#56073) 
Signed-off-by: Shiksha Patel <shiksha.patel@amd.com>
Signed-off-by: lcskrishna <lollachaitanya@gmail.com>
Co-authored-by: shikamd123 <shikpate@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-09-29 18:07:31 +00:00
Kevin H. LuuandClaude Opus 5.5 aedaba8664 [CI/Build] Skip the snapshot runtime on CUDA 12.x images (#59118) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-28 20:17:59 -07:00
Rohan PotdarandClaude Opus 5.5 7a160c6fe5 [ROCm][CI] Pin OpenTelemetry to LMCache's cap in the ROCm images (#59051) 
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-28 12:33:09 -05:00
Micah Williamson b0d2b854f6 [ROCm]Keep LMCache OpenTelemetry on the image's 1.40 stack (#59056) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-09-28 15:49:48 +00:00
Louie Tsai ccfd1cea75 [CPU] Include vLLM Recipes tooling in release image to deploy models using vLLM Recipes (#58796) 
Signed-off-by: louie-tsai <louie.tsai@intel.com>
 2026-09-28 16:46:53 +08:00
Rehan KhanandLi, Jiang <jiang1.li@intel.com> fd2f3fcfa5 [CPU] Add video inferencing via torchcodec on s390x (#58693) 
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2026-09-28 14:16:59 +08:00
Turner JabbourandClaude Sonnet 5 2407f405b5 [CI] Allowlist-shrink batch 1: wire 17 root-level tests + drop 5 stale watermarking entries into misc.yaml (#58055) 
Signed-off-by: Turner Jabbour <doubleujabbour@gmail.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
 2026-09-27 22:23:46 -07:00
zhao, zhenhuiandjiang1.li 5eaa50f151 [CPU] Build CPU wheels on Ubuntu 22.04 with AMX-FP8 support (#58515) 
Signed-off-by: zhejiangxiaomai <zhenhui.zhao@intel.com>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: jiang1.li <jiang1.li@intel.com>
 2026-09-28 11:46:02 +08:00
Fangzhou AiCursorAndreas Karatzas
 		31afa4f1bb [ROCm] Bump AITER to v0.1.23 (#58867) 
Signed-off-by: fai <fangzhouai@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-09-27 19:04:58 -05:00
Anton Peganovmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>OpenAI Codex
 		73859fec58 [Frontend] Switch Python Harmony dependency to oss-harmony (#55128) 
Signed-off-by: Anton Peganov <apeganov@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-09-28 00:43:56 +04:00
Rohan PotdarClaude Fable 5jpvillam
 		e440b75bb6 [ROCm] Bump torch 2.13, triton 3.8, torchaudio, torchvision (#50605) 
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: jpvillam <juan.villamizar@amd.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: jpvillam <juan.villamizar@amd.com>
 2026-09-25 14:55:52 -05:00
Andreas KaratzasandCodex fa94450b74 [CI][ROCm] Prevent Model Executor apt stalls (#58607) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-24 23:18:45 -05:00
Reidandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 8b365ff949 [ROCm][Build] Filter crate tags from vLLM version detection (#57744) 
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2026-09-25 03:06:05 +00:00
Misha Goin 58aa2f1ef1 [Refactor] Move auxiliary files out of the repository root (#58572) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2026-09-24 12:38:56 -07:00
Li, Jiang b44895cf93 [CPU] Use pre-built triton (#58140) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2026-09-24 16:12:34 +08:00
Wei ZhaoCodexYongye ZhuKevin H. Luu
 		44bf011f44 [Dependency] Upgrade FlashInfer version to 0.7.0 (#58069) 
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
 2026-09-23 22:45:23 -07:00
Yan MaandKunshang Ji e34489a543 [XPU] upgrade to PyTorch 2.14 (#56013) 
Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-09-23 09:18:52 +00:00
Andreas KaratzasandOpenAI Codex 36bc694889 [ROCm][CI] Include Python tooling in ROCm CI artifacts (#58271) 
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-09-23 16:44:54 +08:00
rasmith 111d7d7be2 [ROCm][Build][The Rock] Bump Triton version to 3.8.x tip-of-tree with source build in The Rock image (#58006) 
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
 2026-09-22 18:05:13 -05:00
Jee Jee Li d90f0eade5 [Build] Fix CUDA 12 KV connector dependency selection (#57945) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-09-22 06:13:07 -07:00
Kevin H. LuuandClaude Fable 5.1 64a48b19b4 [CI] Emit a kernel symbol map from the csrc build (opt-in, for test selection) (#58097) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
 2026-09-22 01:37:34 -07:00
AlecCodexBugen Zhao
 		f07e227ee9 [Docker] Expose bundled vllm-rs on PATH (#57606) 
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
Signed-off-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-21 20:03:03 -07:00
Turner JabbourClaude Sonnet 5Kevin H. LuuNick Hill
 		e9f169d16b [CI] Add pre-commit check that new tests are tethered to Buildkite jobs (#54867) 
Signed-off-by: Turner Jabbour <doubleujabbour@gmail.com>
Signed-off-by: Turner <doubleujabbour@gmail.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
 2026-09-21 18:36:45 -07:00
Nils MattesonTaneem IbrahimelehayymAndreas Karatzasmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		13058faa49 [Frontend] Add reusable TP1 initialized-engine snapshots (#51360) 
Signed-off-by: Nils Matteson <nilsmatteson@icloud.com>
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: elehayym <52448798+Yuzu23@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-09-21 23:18:49 +00:00
vllm-agentandkimi-no-na-wa 8644d2af2f [CI][Build] Harden triton-cpu sleef submodule fetch in CPU image build (#57871) 
Signed-off-by: kimi-no-na-wa <kimi-no-na-wa@users.noreply.github.com>
Co-authored-by: kimi-no-na-wa <kimi-no-na-wa@users.noreply.github.com>
 2026-09-21 15:30:14 -07:00
LucainandClaude Opus 5 6b858751f6 [docs] Fix legacy hf CLI references (vllm) (#57958) 
Signed-off-by: Wauplin <lucainp@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-21 15:32:27 +00:00
Micah Williamson 468663a5e5 [ROCm] Bump AITER to v0.1.22.post1 (#56885) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-09-18 18:36:45 -07:00
Matt 4c6c1a40b3 [ROCm][Bugfix] Fix intermittent ROCR host segfault (#57328) 
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
 2026-09-18 03:13:45 -07:00
Tyler Michael SmithOpenAI CodexOpenAI CodexMisha Goinmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		4f9a41ac94 [CI/Build][Hardware][NVIDIA] Add Rubin CUDA 13.4 nightly images (#55953) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-09-17 08:05:31 -07:00
coderfornowandLi, Jiang <jiang1.li@intel.com> 88afb77700 [CPU][s390x] Pin protobuf to 7.36.1 and drop C++ extension removal workaround (#54978) 
Signed-off-by: coderfornow <Ritik.Dhiranan@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2026-09-17 16:35:17 +08:00
MattandClaude Code 68f2c7e74f [ROCm][CI] Fix Nixl+Offloading PD edge cases on TheRock image (#57249) 
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Claude Code <noreply@anthropic.com>
 2026-09-16 22:56:13 -05:00
Rohan PotdarClaude Opus 4.8Matt
 		3e267bae70 [ROCm] triton+triton_kernels 3.8 mxfp4 MoE support (gpt-oss + DeepSeek-V4) (#55934) 
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Matt <156021403+mawong-amd@users.noreply.github.com>
 2026-09-16 20:03:34 -05:00
Andreas KaratzasandCodex 711768fc17 [CI][ROCm] Add opt-in TheRock builds for AMD CI (#56351) 
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-16 00:09:45 -05:00
Shang WangandCodex 031f5810c1 [Build][NVIDIA] Update public Rubin dependencies and MSA compatibility (#56545) 
Signed-off-by: Shang Wang <samshang.wang@mail.utoronto.ca>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-15 16:29:13 -07:00
Yongye ZhuandClaude Opus 5 8263ea12bd [Build] Move DeepGEMM pin to the vLLM fork and update the Mega MoE call convention (#56876) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-15 00:57:18 -07:00
MattandAndreas Karatzas 3192898754 [ROCm][CI] Prepare TheRock image for CI (#56921) 
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-09-14 20:57:59 -05:00
djramic 5392fbca2a [ROCm][Docker] Pin AINIC apt repo to snapshot 1.117.5-a-77 (#56459) 
Signed-off-by: Djordje Ramic <djoramic@amd.com>
 2026-09-11 14:14:16 +00:00
Li, Jiang 46bae7e98c [CI/Build][CPU] Fix flaky rust downloads, broken prune flag, and triton-cpu cache coupling (#56247) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2026-09-10 22:27:26 +08:00
Wei ZhaoandOpenAI Codex 8c87c333b8 [Perf] Fix TRTLLM ragged prefill perf regression (#55499) 
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
 2026-09-09 20:38:20 +00:00
Micah WilliamsonandFangzhou Ai 4e990dfcec [ROCm] Bump AITER to v0.1.21.post2 (#55968) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Fangzhou Ai <31551580+Fangzhou-Ai@users.noreply.github.com>
 2026-09-09 07:49:59 -07:00
meena-at-workShang WangTyler Michael Smith
 		385dce36bc [CI/Build][Hardware][NVIDIA] Add public CUDA 13.4 Rubin build path (#54640) 
Signed-off-by: Meenakshi Venkataraman <meenakshiv@nvidia.com>
Signed-off-by: meena-at-work <80416898+meena-at-work@users.noreply.github.com>
Signed-off-by: Shang Wang <shangw@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Shang Wang <shangw@nvidia.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
 2026-09-09 04:53:12 +00:00
Matt bc8587f829 [ROCm][Perf][Bugfix] Multi-stream perf improvements; rocprofiler fixes (#55099) 
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
 2026-09-08 17:42:34 -07:00
Kevin H. Luu 05e52f6336 [CI] Fix ARM64 test dependency builds with GCC 15 (#55877) 
Signed-off-by: khluu <khluu000@gmail.com>
 2026-09-08 14:27:13 -07:00