From 8122a105361600b2c634824b09d96ff9176ee73e Mon Sep 17 00:00:00 2001 From: Fadi Arafeh <115173828+fadara01@users.noreply.github.com> Date: Thu, 30 Jul 2026 07:30:21 +0100 Subject: [PATCH] [DOC][CPU] remove tcmalloc warning from CPU docs (#50308) Signed-off-by: Fadi Arafeh --- docs/getting_started/installation/cpu.arm.inc.md | 14 -------------- docs/getting_started/installation/cpu.x86.inc.md | 13 ++++--------- 2 files changed, 4 insertions(+), 23 deletions(-) diff --git a/docs/getting_started/installation/cpu.arm.inc.md b/docs/getting_started/installation/cpu.arm.inc.md index 3950adc025..e719d65dd9 100644 --- a/docs/getting_started/installation/cpu.arm.inc.md +++ b/docs/getting_started/installation/cpu.arm.inc.md @@ -28,20 +28,6 @@ uv pip install https://github.com/vllm-project/vllm/releases/download/v${VLLM_VE pip install https://github.com/vllm-project/vllm/releases/download/v${VLLM_VERSION}/vllm-${VLLM_VERSION}+cpu-cp38-abi3-manylinux_2_34_aarch64.whl --extra-index-url https://download.pytorch.org/whl/cpu ``` -!!! warning "set `LD_PRELOAD`" - Before use vLLM CPU installed via wheels, make sure TCMalloc is installed and added to `LD_PRELOAD`: - ```bash - # install TCMalloc - sudo apt-get install -y --no-install-recommends libtcmalloc-minimal4 - - # manually find the path - sudo find / -iname *libtcmalloc_minimal.so.4 - TC_PATH=... - - # add them to LD_PRELOAD - export LD_PRELOAD="$TC_PATH:$LD_PRELOAD" - ``` - The `uv` approach works for vLLM `v0.6.6` and later. A unique feature of `uv` is that packages in `--extra-index-url` have [higher priority than the default index](https://docs.astral.sh/uv/pip/compatibility/#packages-that-exist-on-multiple-indexes). If the latest public release is `v0.6.6.post1`, `uv`'s behavior allows installing a commit before `v0.6.6.post1` by specifying the `--extra-index-url`. In contrast, `pip` combines packages from `--extra-index-url` and the default index, choosing only the latest version, which makes it difficult to install a development version prior to the released version. #### Install the latest code diff --git a/docs/getting_started/installation/cpu.x86.inc.md b/docs/getting_started/installation/cpu.x86.inc.md index 6ded3b5083..b2ef384bd9 100644 --- a/docs/getting_started/installation/cpu.x86.inc.md +++ b/docs/getting_started/installation/cpu.x86.inc.md @@ -33,19 +33,14 @@ uv pip install https://github.com/vllm-project/vllm/releases/download/v${VLLM_VE pip install https://github.com/vllm-project/vllm/releases/download/v${VLLM_VERSION}/vllm-${VLLM_VERSION}+cpu-cp38-abi3-manylinux_2_34_x86_64.whl --extra-index-url https://download.pytorch.org/whl/cpu ``` !!! warning "set `LD_PRELOAD`" - Before use vLLM CPU installed via wheels, make sure TCMalloc and Intel OpenMP are installed and added to `LD_PRELOAD`: + Before use vLLM CPU installed via wheels, make Intel OpenMP is added to `LD_PRELOAD`: ```bash - # install TCMalloc, Intel OpenMP is installed with vLLM CPU - sudo apt-get install -y --no-install-recommends libtcmalloc-minimal4 - # manually find the path - sudo find / -iname *libtcmalloc_minimal.so.4 sudo find / -iname *libiomp5.so - TC_PATH=... IOMP_PATH=... - # add them to LD_PRELOAD - export LD_PRELOAD="$TC_PATH:$IOMP_PATH:$LD_PRELOAD" + # add it to LD_PRELOAD + export LD_PRELOAD="$IOMP_PATH:$LD_PRELOAD" ``` #### Install the latest code @@ -131,7 +126,7 @@ uv pip install dist/*.whl ``` !!! warning "set `LD_PRELOAD`" - Before use vLLM CPU installed via wheels, make sure TCMalloc and Intel OpenMP are installed and added to `LD_PRELOAD`: + Before using vLLM CPU installed via wheels, make sure TCMalloc and Intel OpenMP are installed and added to `LD_PRELOAD`: ```bash # install TCMalloc, Intel OpenMP is installed with vLLM CPU sudo apt-get install -y --no-install-recommends libtcmalloc-minimal4