Stack Overflow
Stack Overflow

Questions tagged [nvidia-docker]

nvidia-docker is a thin wrapper on top of docker and act as a drop-in replacement for the docker command line interface. This is required as a convenience to automatically detect and setup GPU containers leveraging NVIDIA hardware. nvidia-docker calls docker and relies on the NVIDIA Docker plugin to discover driver files and GPU devices.

nvidia-docker is a thin wrapper on top of docker and act as a drop-in replacement for the docker command line interface. This is required as a convenience to automatically detect and setup GPU containers leveraging NVIDIA hardware. nvidia-docker calls docker and relies on the NVIDIA Docker plugin to discover driver files and GPU devices.

Source: Nvidia

264 questions
38
votes
3 answers

How do I specify nvidia runtime from docker-compose.yml?

I am able to run a tensorflow container w/ access to the GPU from the command line w/ the following command $ sudo docker run --runtime=nvidia --rm gcr.io/tensorflow/tensorflow:latest-gpu I would like to be able to run this container from…
rissem
  • 503
  • 1
  • 5
  • 11
33
votes
3 answers

docker build with nvidia runtime

I have a GPU application that does unit-testing during the image building stage. With Docker 19.03, one can specify nvidia runtime with docker run --gpus all but I also need access to the gpus for docker build because I do unit-testing. How can I…
danny
  • 1,101
  • 1
  • 12
  • 34
23
votes
2 answers

Credential saving error when connecting to service on docker

I am on a silicon chip Macbook Pro running macOS Monterey version 12.0.1 and the following error occurs on attempting to connect to the NGC service using sudo docker login ncvr.io. Error saving credentials: error storing credentials - err: exit…
Daemonique
  • 468
  • 2
  • 5
  • 15
22
votes
7 answers

nvidia-docker : Unknown runtime specified nvidia

I tried to install the nvidia-docker after installing docker-ce. I followed this : https://github.com/NVIDIA/nvidia-docker to install nvidia-docker. It seems to have installed correctly. I tried to run: $ sudo docker run --runtime=nvidia --rm…
mkuse
  • 2,250
  • 4
  • 32
  • 61
21
votes
2 answers

Add nvidia runtime to docker runtimes

I’m running a virtual vachine on GCP with a tesla GPU. And try to deploy a PyTorch-based app to accelerate it with GPU. I want to make docker use this GPU, have access to it from containers. I managed to install all drivers on host machine, and the…
evaleria
  • 1,281
  • 6
  • 23
  • 30
19
votes
5 answers

How to get Docker to recognize NVIDIA drivers?

I have a container that loads a Pytorch model. Every time I try to start it up, I get this error: Traceback (most recent call last): File "server/start.py", line 166, in start() File "server/start.py", line 94, in start …
infinitely_improbable
  • 389
  • 1
  • 2
  • 11
17
votes
4 answers

Docker build / docker compose up error: Unknown desc = failed to fetch anonymous token: unexpected status: 401 Unauthorized

When building a container (through docker build, docker run or docker-compose) using NVIDIA containers, I get the following error, somewhat randomly. When I usually start building the container, it works the first time. But next few times usually…
Ben Butterworth
  • 22,056
  • 10
  • 114
  • 167
17
votes
3 answers

running nvidia-docker on Windows 10 + WSL2

I saw several Q&As on this topic and tried both approaches. Any advice on how to proceed with either route are appreciated: Running nvidia-docker from within WSL2 I followed NVIDIA docs and this tutorial. Everything installs and docker command runs…
Dima Lituiev
  • 12,544
  • 10
  • 41
  • 58
17
votes
2 answers

Using GPU inside docker container - CUDA Version: N/A and torch.cuda.is_available returns False

I'm trying to use GPU from inside my docker container. I'm using docker with version 19.03 on Ubuntu 18.04. Outside the docker container if I run nvidia-smi I get the below…
Sai Chander
  • 829
  • 1
  • 6
  • 15
13
votes
1 answer

Can nvidia-docker be run without a GPU?

The official PyTorch Docker image is based on nvidia/cuda, which is able to run on Docker CE, without any GPU. It can also run on nvidia-docker, I presume with CUDA support enabled. Is it possible to run nvidia-docker itself on an x86 CPU, without…
breandan
  • 1,965
  • 26
  • 45
12
votes
2 answers

How can I mount a GCS bucket in a custom Docker image on AI Platform?

I'm using Google's AI Platform to train machine learning models using a custom Docker image. To run existing code without modifications, I would like to mount a GCS bucket inside the container. I think one way to achieve this is to install gcloud to…
danijar
  • 32,406
  • 45
  • 166
  • 297
11
votes
2 answers

Running docker desktop containers with --gpus tag hangs without any response in wsl

I used to use docker desktop with wsl2 integration and there was no problem running containers with gpu support. However, after a recent update to docker desktop v4.17.1 ( march 2023 ), any containers that I run specifically using the --gpus all tag…
Preetham Rakshith P
  • 153
  • 7
11
votes
5 answers

Failed to initialize NVML: Unknown Error in Docker after Few hours

I am having interesting and weird issue. When I start docker container with gpu it works fine and I see all the gpus in docker. However, few hours or few days later, I can't use gpus in docker. When I do nvidia-smi in docker machine. I see this…
Justin Song
  • 111
  • 1
  • 4
11
votes
1 answer

Is it possible to build an `nvidia/cuda`-based image on a server without a GPU?

I have a Dockerfile based on nvidia/cuda like so: FROM nvidia/cuda:11.0-base ... I want to be able to build this Dockerfile on our CI server that does not have a Nvidia GPU. When I try to do that, I get this error: ------ > [1/6] FROM…
Mario Ishac
  • 5,060
  • 3
  • 21
  • 52
11
votes
1 answer

nvidia-docker run vs docker run --runtime=nvidia

Is there a difference between: nvidia-docker run and docker run --runtime=nvidia ? In the official docs they use the latter but I've seen the former in other tutorials online.
Rutger Hofste
  • 4,073
  • 3
  • 33
  • 44
1
2 3
…
17 18