Using CUDA 11.x but getting error: Unknown CUDA arch (8.6) or GPU not supported

Question

I'm setting up a conda environment to use pytorch 1.4.0 (on Ubuntu 20.04.2), but getting the error message:

ValueError: Unknown CUDA arch (8.6) or GPU not supported

I know this has been asked before, but no answer fits my case. This answer suggests that the CUDA version is too old. However, I updated my CUDA version to the most recent, and get the same error message.

nvcc -V says I have CUDA 11 installed, and when I run nvidia-smi I get this info:

+-----------------------------------------------------------------------------+
| NVIDIA-SMI 460.84       Driver Version: 460.84       CUDA Version: 11.2     |
|-------------------------------+----------------------+----------------------+

which, according to the NVIDIA docs, should work be compatible:

Another auxilliary question: What does the "8.6" in CUDA arch (8.6) represent?

8.6 refers to specific members of the Ampere family of GPUs, such as any RTX 30xx card, for example. — Robert Crovella, Sep 23 '21 at 18:52

score 2 · Accepted Answer · answered Sep 23 '21 at 17:45

2

Specific versions of PyTorch work only with specific versions of CUDA.

If you are using CUDA-11.1, you'll need a fairly recent version of PyTorch. You need to either upgrade your PyTorch, or downgrade your CUDA.

answered Sep 23 '21 at 17:45

MWB

11,740
6
46
91

Is there a way to know which CUDA version will be compatible with my pytorch version? – jtb Sep 23 '21 at 18:08
1

@JoshBone Look at the link I gave below. – Ivan Sep 23 '21 at 18:09
1

@JoshBone Yes. pytorch.org lists them. Also see Ivan's link. – MWB Sep 23 '21 at 18:11

score 1 · Answer 2 · answered Sep 23 '21 at 17:18

1

It seems you can grab PyTorch v1.4 for CUDA 10.0 from here:

pip install torch==1.4.0+cu100 -f https://download.pytorch.org/whl/torch_stable.html

answered Sep 23 '21 at 17:18

Ivan

34,531
8
55
100

I have pytorch installed. This is not what I'm having trouble with. – jtb Sep 23 '21 at 17:26

Using CUDA 11.x but getting error: Unknown CUDA arch (8.6) or GPU not supported

2 Answers2