[CI/Build][Hardware][NVIDIA] Add public CUDA 13.4 Rubin build path (#54640)
Signed-off-by: Meenakshi Venkataraman <meenakshiv@nvidia.com> Signed-off-by: meena-at-work <80416898+meena-at-work@users.noreply.github.com> Signed-off-by: Shang Wang <shangw@nvidia.com> Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com> Co-authored-by: Shang Wang <shangw@nvidia.com> Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
This commit is contained in:
co-authored by
Shang Wang
Tyler Michael Smith
parent
bf7eee9d7b
commit
385dce36bc
@@ -425,12 +425,7 @@ For (G)B300, we recommend using CUDA 13, as shown in the following command.
|
||||
|
||||
#### [Preview] Building vLLM's Docker Image from Source for NVIDIA Rubin GPU Architecture
|
||||
|
||||
At this time, the Rubin preview is available only to NVIDIA engineers and
|
||||
partners with access to NVIDIA's internal prerequisites. Set
|
||||
`INSTALL_RUBIN_PRERELEASE=true` to enable the Rubin build path. It requires a
|
||||
`requirements/rubin-prerelease.txt` file containing pointers to NVIDIA's
|
||||
internal prerelease packages, plus NVIDIA-internal CUDA 13.4 or CUDA 13.5
|
||||
development images for `BUILD_BASE_IMAGE` and `FINAL_BASE_IMAGE`.
|
||||
Set `INSTALL_RUBIN_PRERELEASE=true` to enable the Rubin build path.
|
||||
|
||||
Triton must currently be installed from source for Rubin compatibility.
|
||||
Specify its repository with `TRITON_INSTALL_FROM_SOURCE_REPO`; an empty
|
||||
@@ -444,54 +439,53 @@ BuildKit does not automatically invalidate cached layers when a mutable Git
|
||||
ref changes. Use `--no-cache-filter extensions-build` to refresh an empty,
|
||||
branch, or tag revision.
|
||||
|
||||
Use `ARCH=arm64` on VR200 or `ARCH=amd64` on R100:
|
||||
For `FINAL_BASE_IMAGE`, use the public, multi-arch
|
||||
`nvcr.io/nvidia/cuda-dl-base:26.08-cuda13.4-devel-ubuntu24.04` image.
|
||||
For `BUILD_BASE_IMAGE`, use:
|
||||
|
||||
??? console "CUDA 13.4 command"
|
||||
- `pytorch/manylinux2_28-builder:cuda13.4` for x86_64 CPUs.
|
||||
- `pytorch/manylinuxaarch64-builder:cuda13.4` for ARM64/AArch64 CPUs.
|
||||
|
||||
??? console "ARM64/AArch64 build command"
|
||||
|
||||
```bash
|
||||
ARCH=arm64
|
||||
docker buildx build --progress=plain --load \
|
||||
--file docker/Dockerfile \
|
||||
--target vllm-openai \
|
||||
--platform "linux/${ARCH}" \
|
||||
--tag "vllm/vllm-rubin-openai:prerelease-cu134-${ARCH}" \
|
||||
--platform "linux/arm64" \
|
||||
--tag "vllm/vllm-rubin-openai:prerelease-cu134-public-arm64" \
|
||||
--build-arg max_jobs="$(nproc)" \
|
||||
--build-arg nvcc_threads=2 \
|
||||
--build-arg RUN_WHEEL_CHECK=false \
|
||||
--build-arg INSTALL_RUBIN_PRERELEASE=true \
|
||||
--build-arg TRITON_INSTALL_FROM_SOURCE_REPO=https://github.com/triton-lang/triton.git \
|
||||
--build-arg TRITON_INSTALL_FROM_SOURCE_REVISION=3f6e41132b5edf639bfb872ad73d4688765e08b8 \
|
||||
--build-arg CUDA_VERSION=13.4.1 \
|
||||
--build-arg BUILD_BASE_IMAGE="<cuda-13.4-manylinux-devel-image-${ARCH}>" \
|
||||
--build-arg FINAL_BASE_IMAGE="<cuda-13.4-ubuntu24.04-devel-image-${ARCH}>" \
|
||||
--build-arg CUDA_VERSION=13.4 \
|
||||
--build-arg BUILD_BASE_IMAGE="pytorch/manylinuxaarch64-builder:cuda13.4" \
|
||||
--build-arg FINAL_BASE_IMAGE="nvcr.io/nvidia/cuda-dl-base:26.08-cuda13.4-devel-ubuntu24.04" \
|
||||
.
|
||||
```
|
||||
|
||||
??? console "CUDA 13.5 command"
|
||||
??? console "x86_64 build command"
|
||||
|
||||
```bash
|
||||
ARCH=arm64
|
||||
docker buildx build --progress=plain --load \
|
||||
--file docker/Dockerfile \
|
||||
--target vllm-openai \
|
||||
--platform "linux/${ARCH}" \
|
||||
--tag "vllm/vllm-rubin-openai:prerelease-cu135-${ARCH}" \
|
||||
--platform "linux/amd64" \
|
||||
--tag "vllm/vllm-rubin-openai:prerelease-cu134-public-amd64" \
|
||||
--build-arg max_jobs="$(nproc)" \
|
||||
--build-arg nvcc_threads=2 \
|
||||
--build-arg RUN_WHEEL_CHECK=false \
|
||||
--build-arg INSTALL_RUBIN_PRERELEASE=true \
|
||||
--build-arg TRITON_INSTALL_FROM_SOURCE_REPO=https://github.com/triton-lang/triton.git \
|
||||
--build-arg TRITON_INSTALL_FROM_SOURCE_REVISION=3f6e41132b5edf639bfb872ad73d4688765e08b8 \
|
||||
--build-arg CUDA_VERSION=13.5.0 \
|
||||
--build-arg BUILD_BASE_IMAGE="<cuda-13.5-manylinux-devel-image-${ARCH}>" \
|
||||
--build-arg FINAL_BASE_IMAGE="<cuda-13.5-ubuntu24.04-devel-image-${ARCH}>" \
|
||||
--build-arg CUDA_VERSION=13.4 \
|
||||
--build-arg BUILD_BASE_IMAGE="pytorch/manylinux2_28-builder:cuda13.4" \
|
||||
--build-arg FINAL_BASE_IMAGE="nvcr.io/nvidia/cuda-dl-base:26.08-cuda13.4-devel-ubuntu24.04" \
|
||||
.
|
||||
```
|
||||
|
||||
CUDA 13.5 compiled-mode qualification passed with NVIDIA driver versions
|
||||
615.62.03 and 620.05. Driver 610.47.04 failed the tested compiled CUDA 13.5
|
||||
kernel. Validate the exact driver version on the target system.
|
||||
|
||||
!!! note
|
||||
Keep the default explicit `torch_cuda_arch_list`. GPU-less BuildKit builds
|
||||
cannot inspect the host GPU. R100 and VR200 report compute capability 10.7,
|
||||
|
||||
Reference in New Issue
Block a user