Commit Graph
396 Commits
Author SHA1 Message Date
Misha GoinandOpenAI Codex c9331d8064 [CI] Preserve Rust Docker cache across commits (#53290)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-25 11:13:36 -07:00
Kevin H. LuuandOpenAI Codex e25c586b90 [CI/Build] Pin Cython below 3.3 for arm64 tilelang sdist (#53358)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-23 01:09:27 -07:00
Rohan Potdar 610bfc58e9 [ROCm] Ship rocprofiler-sdk 1.3.2 in Dockerfile.rocm_base to fix torch.profiler traces (#53182)
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
2026-08-22 12:16:25 -05:00
83c5d59209 [Rust Frontend] Replace external protoc with pure Rust lib protox (#52892)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
2026-08-20 18:43:51 -07:00
Andrey Talman 54ba80d961 [CI][Docker] Pin manylinux2_28-builder:cuda13.0 to the release/2.13 image (#52994)
Signed-off-by: Andrey Talman <atalman@fb.com>
2026-08-20 15:19:40 -07:00
Sandeep MaddipatlaandKunshang Ji 4b7cb949a9 [Docker] Update to nixl-1.3.2 (#51777)
Signed-off-by: Sandeep Maddipatla <sandeep.maddipatla@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
2026-08-20 21:03:32 +08:00
Turner JabbourandClaude Sonnet 5 1eab6fef01 [CI] replace shellcheck script with shellcheck-py hook (#52572)
Signed-off-by: Turner <doubleujabbour@gmail.com>
Signed-off-by: Turner Jabbour <doubleujabbour@gmail.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
2026-08-20 10:09:59 +00:00
Rohan Potdar 823ec22b78 [ROCm]: Bump triton 3.7 commit (#52819)
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
2026-08-19 17:39:08 -05:00
Wei Zhao 689be2bcd3 Upgrade Flashinfer version to 0.6.17 (#52681)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
2026-08-18 23:04:36 +08:00
c89d692cb5 [Build] Propagate vLLM version to Rust binaries (#52593)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-08-17 23:37:37 -07:00
Yan MaandKunshang Ji b0e9cff5e7 [XPU] update xpu-manager to v2.1.0 (#52569)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
2026-08-18 06:27:41 +00:00
Hongxia YangandAndreas Karatzas e68fb75b25 [ROCm][AMD][Installation] add LMCache kv-connector installation and runtime packages to docker image (#51208)
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-08-17 16:58:48 -05:00
Nick HillandClaude Opus 4.8 615d4cfade [Core] Check for GPU<->CPU syncs during CI (#43107)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-08-14 17:42:05 -07:00
Rohan Potdar 9df9b0b0a1 [ROCm]: Drop pybind11 from Dockerfile.rocm to prevent version mismatch (#52400)
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
2026-08-14 23:50:23 +00:00
Kunshang Ji 8e6d8e4f6a [XPU][CI/Release][3/N] Add xpu wheel release to release pipeline (#52108)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
2026-08-14 14:00:17 +08:00
Li, Jiang 1c3633acaf [CI/Build][CPU] Shrink triton-cpu-build layer by dropping build artifacts (#52127)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
2026-08-13 17:17:00 +08:00
Li, Jiang 373592ef57 [CPU] Ship triton-cpu wheel and fix several hardcoded pin_memory=True (#52092)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
2026-08-13 14:40:53 +08:00
ovidiusm 5658391af7 Remove NIXL reinstall step (#51882)
Signed-off-by: Ovidiu Mara <ovidium@nvidia.com>
2026-08-12 22:44:05 -07:00
Yan MaandKunshang Ji 63344913a6 [XPU] update UMD to 26.27 (#50513)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
2026-08-13 13:15:25 +08:00
Hongxia Yangmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Andreas Karatzas
324f452f64 [ROCm] update triton in base docker for gluon compatibility (#51464)
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-08-12 11:26:17 -05:00
Li, Jiang 6accb779a3 [CI] Add registry layer cache to x86 CPU image build (#51911)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
2026-08-12 17:58:01 +08:00
Yan MaandKunshang Ji b76cf758db [XPU] install xpu-manager for device monitor (#50831)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
2026-08-11 14:18:41 +08:00
Andreas Karatzas 419b51b385 [Bugfix][ROCm][CI] Stabilize build context and source caches (#51721)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
2026-08-10 21:51:39 -05:00
21c667aa64 [Docker] Cache test dependencies before vLLM install (#51184)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-08-10 10:34:59 -07:00
Andreas KaratzasandOpenAI Codex 7f6432cc0d [ROCm][CI] Reuse equivalent ROCm CI images (#48646)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-09 01:25:03 -07:00
f18e10a7e1 Bump Flashinfer version to 0.6.16.post3 (#50892)
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
2026-08-09 00:54:07 -07:00
Isotr0py 073c510c91 [Migration] Migrate bitsandbytes support to OOT plugin (#43529)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
2026-08-09 10:27:31 +08:00
cb1a52aee3 [Build] Upgrade runtime image to Ubuntu 24.04, pick up rdma-core > 44 (#51058)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
2026-08-08 18:17:50 -07:00
14e57ad47d [Docker][KVConnector] Install mooncake from official wheels instead of a custom build (#51067)
Signed-off-by: Zhewen Li <zhewenli@inferact.ai>
Co-authored-by: Zhewen Li <zhewenli@inferact.ai>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-05 11:58:44 -07:00
Michael GoinandShengqi Chen e8586b2878 [Build] Remove Ubuntu build-stage option from the CUDA dockerfile (#51060)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
2026-08-05 10:50:58 -07:00
Rehan KhanandLi, Jiang <jiang1.li@intel.com> 0187f4c88e [CPU] Enable tcmalloc for s390x (#50841)
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
2026-08-05 10:55:39 +08:00
Rohan PotdarandClaude Opus 4.8 d0ce3dadb6 [ROCm]: Bump torch 2.12, triton 3.7, torchaudio, torchvision (#50607)
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-08-04 20:14:11 -05:00
Andreas Karatzas 76d995df2c [CI][ROCm] Export Helion benchmark script in test artifacts (#50726)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
2026-08-03 13:09:44 -05:00
Ryan RockAndreas Karatzasdepthfirst-app[bot] <184448029+depthfirst-app[bot]@users.noreply.github.com>root
6724051c57 [CI/Build][AMD] Install triton_kernels via CMake (#50328)
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: depthfirst-app[bot] <184448029+depthfirst-app[bot]@users.noreply.github.com>
Co-authored-by: root <root@smci355-ccs-aus-m11-05.cs-aus.dcgpu>
2026-07-30 22:05:19 -05:00
MattandAndreas Karatzas d91f7af7d0 [Hardware][AMD][Kernel][CI][Bugfix] Fix ROCm DeepEP FP8 max (#50467)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-07-30 21:37:36 -05:00
+1 4f1da84eb5 Enable gfx1250 ROCm architecture (#46516)
Signed-off-by: Douglas Lehr <Doug.Lehr@amd.com>
Signed-off-by: jpvillam <juan.villamizar@amd.com>
Signed-off-by: Daniel <danichan@amd.com>
Signed-off-by: Jaden Mathias <jaden.mathias@amd.com>
Signed-off-by: jpvillam <jpvillam@amd.com>
Signed-off-by: Juan Villamizar <100237675+jpvillam-amd@users.noreply.github.com>
Signed-off-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
Signed-off-by: Jaden Mathias <Jaden.Mathias@amd.com>
Co-authored-by: Douglas Lehr <Doug.Lehr@amd.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Daniel <danichan@amd.com>
Co-authored-by: Jaden Mathias <jaden.mathias@amd.com>
Co-authored-by: jpvillam <jpvillam@amd.com>
Co-authored-by: root <root@ctheliosr-1b114-f01-2.mnb.dcgpu>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
Co-authored-by: dllehr <douglehr@amd.com>
Co-authored-by: Daniel Chan <Daniel.Chan@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-07-31 01:41:12 +00:00
Rohan PotdarandAndreas Karatzas 3333d7cb63 [ROCm]: bump AITER to 0.1.19 (#49361)
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-07-30 19:15:19 -05:00
Kevin H. LuuandMichael Goin 5f8f72866c [Build] Fix CUDA release wheel builds (#50243)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
2026-07-30 11:48:09 -07:00
Tyler Michael SmithandOpenAI Codex 1ad5182ba9 [CI/Build] Limit wheel size check to CUDA 13 (#50357)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-07-29 20:10:42 -07:00
5b29c958c7 [XPU] upgrade to torch 2.13 (#48677)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
2026-07-29 01:24:56 -07:00
Rehan KhanandLi, Jiang <jiang1.li@intel.com> db7a79cbf7 [CPU] Fix s390x builds and update torch version in dockerfile (#50144)
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
2026-07-29 12:52:17 +08:00
Rohan PotdarandClaude Opus 4.8 caa9cad31e [ROCm][Docker] Drop MORI_GPU_ARCHS so MoRI autodetects the device arch (#49737)
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-24 21:14:03 +00:00
5d8e90a966 [WideEP] Update NCCL to 2.30.7 to enable DeepEPv2 in the vllm/vllm-openai image (#45321)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Tyler Michael Smith <tyler@vllm.ai>
Signed-off-by: Tyler Michael Smith <tyler@tylermsmith.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Ilya Markov <ilmarkov@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Codex <noreply@openai.com>
2026-07-24 13:00:02 -07:00
Andreas KaratzasandOpenAI Codex 1479bd9e9d [ROCm][CI] Prepare AMD mirrors for regating (#49270)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-07-23 18:42:25 -07:00
75ccdf3145 [Core] Update PyTorch to 2.13.0, torchvision to 0.28.0, triton to 3.7.1 (#48155)
Signed-off-by: Andrey Talman <atalman@users.noreply.github.com>
Co-authored-by: Andrey Talman <atalman@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
2026-07-23 11:09:36 -07:00
Rehan Khan f83de6d44c [CPU][Docs] Update docs and dockerfile for s390x (#49523)
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
2026-07-23 07:17:24 +00:00
61a09532f2 Bump Flashinfer version to 0.6.15 (#48914)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: Wei Zhao <weizha@oci-aga-slurm-1-vscode-02.cm.cluster>
Co-authored-by: Wei Zhao <weizha@oci-aga-slurm-1-vscode-02.cm.cluster>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
2026-07-22 13:32:05 -07:00
Andreas Karatzas 16aca639b7 [ROCm] Upgrade NIXL and UCX (#49251)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
2026-07-21 22:30:02 -05:00
6e96891ba0 [ROCm] Bump AITER to v0.1.16.post5 (#48683)
Signed-off-by: Fangzhou Ai <fangzhouai@gmail.com>
Signed-off-by: Fangzhou Ai <31551580+Fangzhou-Ai@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-07-21 10:39:11 -05:00
Artem PerevedentsevandMatthew Bonanni 7cd1d57b74 [CI/Build][Docker] Bump nvidia-cutlass-dsl to 4.6.0 and drop packaging workarounds (#47442)
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
2026-07-16 13:51:41 +00:00