vllm cpu编译失败,因为 vLLM CPU backend requires AVX512, AVX2, Power9+ ISA, S390X ISA, ARMv8 or RISC-V
·
vllm cpu编译失败,因为 vLLM CPU backend requires AVX512, AVX2, Power9+ ISA, S390X ISA, ARMv8 or RISC-V
使用的cpu是:Intel(R) Xeon(R) CPU E5-2643 v2 ,这个cpu不支持avx512
vLLM手册:CPU | vLLM 中文站
vLLM github:https://github.com/vllm-project/vllm
下载vLLM源代码
下载并进入目录
git clone https://gitcode.com/GitHub_Trending/vl/vllm
cd vllm
pip安装需要的包
pip install --upgrade pip
pip install "cmake>=3.26" wheel packaging ninja "setuptools-scm>=8" numpy
pip install -v -r requirements/cpu.txt --extra-index-url https://download.pytorch.org/whl/cpu
这里最后一句pip安装会报错,我是把 --extra-index-url https://download.pytorch.org/whl/cpu 这句去掉才运行成功的。
编译vLLM cpu后端
VLLM_TARGET_DEVICE=cpu python setup.py install
编译报错,cpu不支持,看来这台机器无法做实验了
-- Found Torch: /home/skywalk/py312/lib/python3.12/site-packages/torch/lib/libtorch.so
CMake Error at cmake/cpu_extension.cmake:188 (message):
vLLM CPU backend requires AVX512, AVX2, Power9+ ISA, S390X ISA, ARMv8 or
RISC-V support.
Call Stack (most recent call first):
CMakeLists.txt:104 (include)

更多推荐


所有评论(0)