how to succesfully compile python 3.x

Question

Upon attempting to compile python 3.7 I hit Could not import runpy module:

jeremyr@b88:$ wget https://www.python.org/ftp/python/3.7.3/Python-3.7.3.tar.xz
....
jeremyr@b88:~/Python-3.7.3$ ./configure --enable-optimizations    
jeremyr@b88:~/Python-3.7.3$ make clean 
jeremyr@b88:~/Python-3.7.3$ make -j32 
.... 

gcc -pthread     -Xlinker -export-dynamic -o Programs/_testembed Programs/_testembed.o libpython3.7m.a -lcrypt -lpthread -ldl  -lutil   -lm  
./python -E -S -m sysconfig --generate-posix-vars ;\
if test $? -ne 0 ; then \
    echo "generate-posix-vars failed" ; \
    rm -f ./pybuilddir.txt ; \
    exit 1 ; \
fi
Could not import runpy module
Traceback (most recent call last):
  File "/home/jeremyr/Python-3.7.3/Lib/runpy.py", line 15, in <module>
    import importlib.util
  File "/home/jeremyr/Python-3.7.3/Lib/importlib/util.py", line 14, in <module>
    from contextlib import contextmanager
  File "/home/jeremyr/Python-3.7.3/Lib/contextlib.py", line 4, in <module>
    import _collections_abc
SystemError: <built-in function compile> returned NULL without setting an error
generate-posix-vars failed
Makefile:603: recipe for target 'pybuilddir.txt' failed
make[1]: *** [pybuilddir.txt] Error 1
make[1]: Leaving directory '/home/jeremyr/Python-3.7.3'
Makefile:531: recipe for target 'profile-opt' failed
make: *** [profile-opt] Error 2

jeremyr@88:~/Python-3.7.3$ lsb_release -a
No LSB modules are available.
Distributor ID: Debian
Description:    Debian GNU/Linux 8.11 (jessie)
Release:    8.11
Codename:   jessie

jeremyr@88:~/Python-3.7.3$ gcc --version 
gcc (Debian 4.9.2-10+deb8u2) 4.9.2
Copyright (C) 2014 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

jeremyr@88:~/Python-3.7.3$ sudo apt upgrade gcc
Reading package lists... Done
Building dependency tree       
Reading state information... Done
Calculating upgrade... gcc is already the newest version.

jeremyr@b88:~/Python-3.7.3$ echo $PYTHONPATH

Any advice on how to overcome this and install python3.7 appreciated.

Edit - the solution listed below seems to work for various other python versions, so I changed title to python 3.x from 3.7

iirc when I took out the --enable-optimizations that runpy error was overcome, then there was one more error, and then success. — jeremy_rutman, Jan 03 '20 at 19:02
ahhh ok, I ended up figuring out our gcc was also out of date but I found an old copy of python3 on that system which seems to work with the aws-cli I was trying to get working. (our python2 couldn't handle the new signaturev4) — Scott, Jan 06 '20 at 18:23
I think I'm in universe 1.0 but I suppose it depends on where you stand w.r.t. the anthropic principle. — jeremy_rutman, Jul 27 '20 at 10:34

score 44 · Accepted Answer · answered Mar 16 '20 at 20:19

44

It seems the enable-optimizations was the problem,

jeremyr@b88:~/Python-3.7.3$ ./configure   
jeremyr@b88:~/Python-3.7.3$ make clean

takes care of it in my case.

answered Mar 16 '20 at 20:19

jeremy_rutman

3,552
4
28
47

Thanks, I just came across this when compiling Python 3.5.9. – dgreene Jun 19 '20 at 00:00
I just came across this issue in python3.8.5 & centos7 and gcc 4.8.3. This fix in my case! Thanks,@jeremy_ruthan – fastisslow Nov 12 '20 at 05:53
4

Same here - this worked (without `enable-optimizations`) to compile a local/standalone Python 3.8.3 – geogeo Aug 21 '21 at 21:25

MicGer · Answer 2 · 2022-01-25T01:49:12.553

10

In case others come across this question: I encountered the same problem on Centos 7. I also had --enable-optimizations but didn't want to remove that flag. Updating my build dependencies and then re-running solved the problem. To do that I ran:

sudo yum groupinstall "Development Tools" -y

In case the yum group is not available, you can also install the pacakges individually using:

sudo yum install bison byacc cscope ctags cvs diffstat doxygen flex gcc gcc-c++ gcc-gfortran gettext git indent intltool libtool patch patchutils rcs redhat-rpm-config rpm-build subversion swig systemtap

edited Jan 25 '22 at 01:49

answered Jan 24 '22 at 21:20

MicGer

305
4
8

2

I think this is a very good answer too. I had to restart my (virtual) machine after the install, but it seems to work. And why not run optimized code? – Jiminion Feb 24 '22 at 19:33
But it is possible some other packages need to be added as well, as I still get a fail. – Jiminion Feb 25 '22 at 03:21

score 2 · Answer 3 · answered Oct 19 '22 at 14:12

2

For whomever MicGer's answer didn't work and would like to retain --enable-optimizations, check your gcc version. The error was solved for me on gcc 8.3.0.

answered Oct 19 '22 at 14:12

raghavj

23
3

score 1 · Answer 4 · answered Jan 04 '23 at 15:59

1

For me, CentOS 7, compiling Python3.9, the fix was updating the gcc and related packages.

answered Jan 04 '23 at 15:59

user1835157

124
4
6

score 0 · Answer 5 · answered Feb 16 '23 at 23:02

Removing --enable-optimizations didn't solved the issue here, neither upgrading GCC from gcc-7.5.0 to gcc-8.2.1 trying building Python 3.6.13 on opensuse-15.2.

Here for some reason the build is picking a local python installation, so before calling make I have updated the PATH env to include the build directory (were python file is generated), for instance: export PATH=$(pwd):$PATH

how to succesfully compile python 3.x

5 Answers5

Linked