[CI/Build][Hardware][NVIDIA] Add public CUDA 13.4 Rubin build path (#54640)

Signed-off-by: Meenakshi Venkataraman <meenakshiv@nvidia.com>
Signed-off-by: meena-at-work <80416898+meena-at-work@users.noreply.github.com>
Signed-off-by: Shang Wang <shangw@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Shang Wang <shangw@nvidia.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
This commit is contained in:
meena-at-work
2026-09-09 04:53:12 +00:00
committed by GitHub
co-authored by Shang Wang Tyler Michael Smith
parent bf7eee9d7b
commit 385dce36bc
3 changed files with 63 additions and 33 deletions
@@ -425,12 +425,7 @@ For (G)B300, we recommend using CUDA 13, as shown in the following command.
#### [Preview] Building vLLM's Docker Image from Source for NVIDIA Rubin GPU Architecture
At this time, the Rubin preview is available only to NVIDIA engineers and
partners with access to NVIDIA's internal prerequisites. Set
`INSTALL_RUBIN_PRERELEASE=true` to enable the Rubin build path. It requires a
`requirements/rubin-prerelease.txt` file containing pointers to NVIDIA's
internal prerelease packages, plus NVIDIA-internal CUDA 13.4 or CUDA 13.5
development images for `BUILD_BASE_IMAGE` and `FINAL_BASE_IMAGE`.
Set `INSTALL_RUBIN_PRERELEASE=true` to enable the Rubin build path.
Triton must currently be installed from source for Rubin compatibility.
Specify its repository with `TRITON_INSTALL_FROM_SOURCE_REPO`; an empty
@@ -444,54 +439,53 @@ BuildKit does not automatically invalidate cached layers when a mutable Git
ref changes. Use `--no-cache-filter extensions-build` to refresh an empty,
branch, or tag revision.
Use `ARCH=arm64` on VR200 or `ARCH=amd64` on R100:
For `FINAL_BASE_IMAGE`, use the public, multi-arch
`nvcr.io/nvidia/cuda-dl-base:26.08-cuda13.4-devel-ubuntu24.04` image.
For `BUILD_BASE_IMAGE`, use:
??? console "CUDA 13.4 command"
- `pytorch/manylinux2_28-builder:cuda13.4` for x86_64 CPUs.
- `pytorch/manylinuxaarch64-builder:cuda13.4` for ARM64/AArch64 CPUs.
??? console "ARM64/AArch64 build command"
```bash
ARCH=arm64
docker buildx build --progress=plain --load \
--file docker/Dockerfile \
--target vllm-openai \
--platform "linux/${ARCH}" \
--tag "vllm/vllm-rubin-openai:prerelease-cu134-${ARCH}" \
--platform "linux/arm64" \
--tag "vllm/vllm-rubin-openai:prerelease-cu134-public-arm64" \
--build-arg max_jobs="$(nproc)" \
--build-arg nvcc_threads=2 \
--build-arg RUN_WHEEL_CHECK=false \
--build-arg INSTALL_RUBIN_PRERELEASE=true \
--build-arg TRITON_INSTALL_FROM_SOURCE_REPO=https://github.com/triton-lang/triton.git \
--build-arg TRITON_INSTALL_FROM_SOURCE_REVISION=3f6e41132b5edf639bfb872ad73d4688765e08b8 \
--build-arg CUDA_VERSION=13.4.1 \
--build-arg BUILD_BASE_IMAGE="<cuda-13.4-manylinux-devel-image-${ARCH}>" \
--build-arg FINAL_BASE_IMAGE="<cuda-13.4-ubuntu24.04-devel-image-${ARCH}>" \
--build-arg CUDA_VERSION=13.4 \
--build-arg BUILD_BASE_IMAGE="pytorch/manylinuxaarch64-builder:cuda13.4" \
--build-arg FINAL_BASE_IMAGE="nvcr.io/nvidia/cuda-dl-base:26.08-cuda13.4-devel-ubuntu24.04" \
.
```
??? console "CUDA 13.5 command"
??? console "x86_64 build command"
```bash
ARCH=arm64
docker buildx build --progress=plain --load \
--file docker/Dockerfile \
--target vllm-openai \
--platform "linux/${ARCH}" \
--tag "vllm/vllm-rubin-openai:prerelease-cu135-${ARCH}" \
--platform "linux/amd64" \
--tag "vllm/vllm-rubin-openai:prerelease-cu134-public-amd64" \
--build-arg max_jobs="$(nproc)" \
--build-arg nvcc_threads=2 \
--build-arg RUN_WHEEL_CHECK=false \
--build-arg INSTALL_RUBIN_PRERELEASE=true \
--build-arg TRITON_INSTALL_FROM_SOURCE_REPO=https://github.com/triton-lang/triton.git \
--build-arg TRITON_INSTALL_FROM_SOURCE_REVISION=3f6e41132b5edf639bfb872ad73d4688765e08b8 \
--build-arg CUDA_VERSION=13.5.0 \
--build-arg BUILD_BASE_IMAGE="<cuda-13.5-manylinux-devel-image-${ARCH}>" \
--build-arg FINAL_BASE_IMAGE="<cuda-13.5-ubuntu24.04-devel-image-${ARCH}>" \
--build-arg CUDA_VERSION=13.4 \
--build-arg BUILD_BASE_IMAGE="pytorch/manylinux2_28-builder:cuda13.4" \
--build-arg FINAL_BASE_IMAGE="nvcr.io/nvidia/cuda-dl-base:26.08-cuda13.4-devel-ubuntu24.04" \
.
```
CUDA 13.5 compiled-mode qualification passed with NVIDIA driver versions
615.62.03 and 620.05. Driver 610.47.04 failed the tested compiled CUDA 13.5
kernel. Validate the exact driver version on the target system.
!!! note
Keep the default explicit `torch_cuda_arch_list`. GPU-less BuildKit builds
cannot inspect the host GPU. R100 and VR200 report compute capability 10.7,