ubutu docker容器部署ollama GPU问题总结
作者 伍增田 Tommy WU zxpns18@126.com
环境信息：
cat /etc/lsb-release
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=24.04
DISTRIB_CODENAME=noble
DISTRIB_DESCRIPTION=“Ubuntu 24.04 LTS”

snap 安装docker出现问题，Ubuntu Docker Unit docker.service could not be found。先snap卸载它，apt重新安装docker，参见：
https://blog.csdn.net/weixin_43181396/article/details/145854700
systemctl start docker，出错

docker.socket: Failed to resolve group docker: No such process A
dependency job for docker.service failed. See ‘journalctl -xe’ for
details.
需要增加docker用户组：
groupadd docker
usermod -aG docker root
newgrp docker
这里是引用

newgrp docker

docker pull ollama/ollama:latest
docker run -d --name ollama-container -p 11434:11434 --gpus all ollama/ollama
nvidia-container-cli: initialization error: load library failed: libnvidia-ml.so.1: cannot open shared object file: no such file or directory: unknown.

apt install libnvidia-ml-dev
ldconfig -p | grep -E ‘nvidia|cuda’|grep libnvidia-ml.so.1
nvidia-smi -pm ENABLED

docker部署大模型ollama, 没有使用GPU

vim /etc/nvidia-container-runtime/config.toml
no-cgroups=false
systemctl restart docker