vllm cpu编译失败,因为 vLLM CPU backend requires AVX512, AVX2, Power9+ ISA, S390X ISA, ARMv8 or RISC-V

使用的cpu是:Intel(R) Xeon(R) CPU E5-2643 v2 ,这个cpu不支持avx512 

vLLM手册:CPU | vLLM 中文站

vLLM github:https://github.com/vllm-project/vllm

下载vLLM源代码

下载并进入目录

git clone https://gitcode.com/GitHub_Trending/vl/vllm
cd vllm

pip安装需要的包

pip install --upgrade pip
pip install "cmake>=3.26" wheel packaging ninja "setuptools-scm>=8" numpy
pip install -v -r requirements/cpu.txt --extra-index-url https://download.pytorch.org/whl/cpu

这里最后一句pip安装会报错,我是把 --extra-index-url https://download.pytorch.org/whl/cpu 这句去掉才运行成功的。

编译vLLM cpu后端

VLLM_TARGET_DEVICE=cpu python setup.py install

编译报错,cpu不支持,看来这台机器无法做实验了

-- Found Torch: /home/skywalk/py312/lib/python3.12/site-packages/torch/lib/libtorch.so
CMake Error at cmake/cpu_extension.cmake:188 (message):
  vLLM CPU backend requires AVX512, AVX2, Power9+ ISA, S390X ISA, ARMv8 or
  RISC-V support.
Call Stack (most recent call first):
  CMakeLists.txt:104 (include)

Logo

免费领 200 小时云算力,进群参与显卡、AI PC 幸运抽奖

更多推荐