[XPU][CI/Release][3/N] Add xpu wheel release to release pipeline (#52108)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com> Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
This commit is contained in:
@@ -20,7 +20,26 @@ There is no extra information on creating a new Python environment for this devi
|
||||
--8<-- [end:set-up-using-python]
|
||||
--8<-- [start:pre-built-wheels]
|
||||
|
||||
Currently, there are no pre-built XPU wheels.
|
||||
Pre-built vLLM XPU wheels are published to `wheels.vllm.ai`. Each XPU wheel
|
||||
index also contains the `triton==3.7.2+xpu` shim described below. PyTorch XPU
|
||||
packages are served from the PyTorch XPU index, so both index URLs are needed.
|
||||
|
||||
#### Install the latest code
|
||||
|
||||
To install the wheel built from the latest main branch:
|
||||
|
||||
```bash
|
||||
uv pip install vllm --extra-index-url https://wheels.vllm.ai/nightly/xpu --extra-index-url https://download.pytorch.org/whl/xpu --index-strategy unsafe-best-match
|
||||
```
|
||||
|
||||
#### Install specific revisions
|
||||
|
||||
If you want to access the wheels for previous commits (e.g. to bisect the behavior change, performance regression), you can specify the commit hash in the URL:
|
||||
|
||||
```bash
|
||||
export VLLM_COMMIT=730bd35378bf2a5b56b6d3a45be28b3092d26519 # use full commit hash from the main branch
|
||||
uv pip install vllm --extra-index-url https://wheels.vllm.ai/${VLLM_COMMIT}/xpu --extra-index-url https://download.pytorch.org/whl/xpu --index-strategy unsafe-best-match
|
||||
```
|
||||
|
||||
--8<-- [end:pre-built-wheels]
|
||||
--8<-- [start:build-wheel-from-source]
|
||||
@@ -36,25 +55,24 @@ pip install --upgrade pip
|
||||
pip install -v -r requirements/xpu.txt
|
||||
```
|
||||
|
||||
- Then, install the correct Triton package for Intel XPU.
|
||||
|
||||
The default `triton` package (for NVIDIA GPUs) may be installed as a transitive dependency (e.g., via `xgrammar`). For Intel XPU, you must replace it with `triton-xpu`:
|
||||
|
||||
```bash
|
||||
pip uninstall -y triton triton-xpu
|
||||
pip install triton-xpu==3.7.2 --extra-index-url https://download.pytorch.org/whl/xpu
|
||||
```
|
||||
|
||||
!!! note
|
||||
- `triton` (without suffix) is for NVIDIA GPUs only. On XPU, using it instead of `triton-xpu` can cause correctness or runtime issues.
|
||||
- For torch 2.13 (the version used in `requirements/xpu.txt`), the matching package is `triton-xpu==3.7.2`. If you use a different version of torch, check the corresponding `triton-xpu` version in [docker/Dockerfile.xpu](https://github.com/vllm-project/vllm/blob/main/docker/Dockerfile.xpu).
|
||||
|
||||
- Finally, build and install vLLM XPU backend:
|
||||
- Then, install vLLM XPU backend:
|
||||
|
||||
```bash
|
||||
VLLM_TARGET_DEVICE=xpu pip install --no-build-isolation -e . -v
|
||||
```
|
||||
|
||||
!!! note
|
||||
`requirements/xpu.txt` pins `triton==3.7.2+xpu`, a compatibility shim
|
||||
hosted on `https://wheels.vllm.ai/xpu` that transparently resolves to
|
||||
the real Intel XPU implementation (`triton-xpu`). This exists because
|
||||
some transitive dependencies (e.g. `xgrammar`) unconditionally
|
||||
require a distribution literally named `triton`, which otherwise
|
||||
resolves to the NVIDIA-only PyPI `triton` package on XPU and can
|
||||
cause correctness or runtime issues. No manual uninstall/reinstall of
|
||||
`triton`/`triton-xpu` is needed; both `pip install` and `uv pip
|
||||
install --index-strategy unsafe-best-match` resolve the correct
|
||||
package automatically.
|
||||
|
||||
--8<-- [end:build-wheel-from-source]
|
||||
--8<-- [start:pre-built-images]
|
||||
|
||||
|
||||
Reference in New Issue
Block a user