Skip to content

NVIDIA docker

NVidia container toolkit enables GPU acceleration in docker container

  • Install Toolkit
  • Configure Docker
  • Run with GPU

Install

add nvidia toolkit repository
1
2
3
4
curl -fsSL https://nvidia.github.io/libnvidia-container/gpgkey | sudo gpg --dearmor -o /usr/share/keyrings/nvidia-container-toolkit-keyring.gpg \
  && curl -s -L https://nvidia.github.io/libnvidia-container/stable/deb/nvidia-container-toolkit.list | \
    sed 's#deb https://#deb [signed-by=/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://#g' | \
    sudo tee /etc/apt/sources.list.d/nvidia-container-toolkit.list
install
1
2
sudo apt update
sudo apt-get install -y nvidia-container-toolkit

Configure Docker

1
sudo nvidia-ctk runtime configure --runtime=docker

1
systemctl --user restart docker

Usage

run image form docker hub with cuda 

1
docker pull nvidia/cuda:12.2.2-devel-ubuntu22.04

Run container with --gps all to enable nvidia gpu in container

Run

1
docker run --gpus all -it nvidia/cuda:12.2.2-devel-ubuntu22.04

check

1
2
nvidia-smi
nvcc --version

Reference