报错信息

unable to locate package nvidia-container-toolkit

先确认CUDA安装无误

nvidia-smi

添加官方仓库

# 安装依赖
sudo apt-get update
sudo apt-get install -y curl

# 添加密钥和仓库
curl -fsSL https://nvidia.github.io/libnvidia-container/gpgkey | sudo gpg --dearmor -o /usr/share/keyrings/nvidia-container-toolkit-keyring.gpg
curl -s -L https://nvidia.github.io/libnvidia-container/stable/deb/nvidia-container-toolkit.list | \
  sed 's#deb https://#deb [signed-by=/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://#g' | \
  sudo tee /etc/apt/sources.list.d/nvidia-container-toolkit.list

再次执行apt-get update后执行安装命令

sudo apt-get update
sudo apt-get install -y nvidia-container-toolkit

指令验证

apt list --installed

起容器验证

docker run --rm --gpus all nvidia/cuda:12.6.0-base-ubuntu24.04 nvidia-smi

参考：

Installing the NVIDIA Container Toolkit — NVIDIA Container ToolkitUbuntu 24.04 安装 NVIDIA Container Toolkit 全指南：让Docker拥抱GPU_ubuntu安装nvidia-container-toolkit-CSDN博客