Pip error installing cryptography on Big Sur

Question

Using pip version 20.2.4, Python 3.8.2 and Big Sur 11.0.1.

When I run pip install cryptography, I get this error:

  Building wheels for collected packages: cffi
    Building wheel for cffi (setup.py): started
    Building wheel for cffi (setup.py): finished with status 'error'
    ERROR: Command errored out with exit status 1:
     command: /Users/xxx/projects/xxx/venv/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/g8/nj6ghjhgj11j84rsjmqqb00000gn/T/pip-install-aufpkz3c/cffi/setup.py'"'"'; __file__='"'"'/private/var/folders/g8/nj6ghjhgj11j84rsjmqqb00000gn/T/pip-install-aufpkz3c/cffi/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /private/var/folders/g8/nj6ghjhgj11j84rsjmqqb00000gn/T/pip-wheel-asotxqfl
         cwd: /private/var/folders/g8/nj6ghjhgj11j84rsjmqqb00000gn/T/pip-install-aufpkz3c/cffi/
    Complete output (42 lines):
    running bdist_wheel
    running build
    running build_py
    creating build
    creating build/lib.macosx-10.14.6-x86_64-3.8
    creating build/lib.macosx-10.14.6-x86_64-3.8/cffi
    copying cffi/backend_ctypes.py -> build/lib.macosx-10.14.6-x86_64-3.8/cffi
    copying cffi/error.py -> build/lib.macosx-10.14.6-x86_64-3.8/cffi
    copying cffi/setuptools_ext.py -> build/lib.macosx-10.14.6-x86_64-3.8/cffi
    copying cffi/__init__.py -> build/lib.macosx-10.14.6-x86_64-3.8/cffi
    copying cffi/cffi_opcode.py -> build/lib.macosx-10.14.6-x86_64-3.8/cffi
    copying cffi/vengine_gen.py -> build/lib.macosx-10.14.6-x86_64-3.8/cffi
    copying cffi/pkgconfig.py -> build/lib.macosx-10.14.6-x86_64-3.8/cffi
    copying cffi/model.py -> build/lib.macosx-10.14.6-x86_64-3.8/cffi
    copying cffi/ffiplatform.py -> build/lib.macosx-10.14.6-x86_64-3.8/cffi
    copying cffi/api.py -> build/lib.macosx-10.14.6-x86_64-3.8/cffi
    copying cffi/vengine_cpy.py -> build/lib.macosx-10.14.6-x86_64-3.8/cffi
    copying cffi/commontypes.py -> build/lib.macosx-10.14.6-x86_64-3.8/cffi
    copying cffi/lock.py -> build/lib.macosx-10.14.6-x86_64-3.8/cffi
    copying cffi/recompiler.py -> build/lib.macosx-10.14.6-x86_64-3.8/cffi
    copying cffi/cparser.py -> build/lib.macosx-10.14.6-x86_64-3.8/cffi
    copying cffi/verifier.py -> build/lib.macosx-10.14.6-x86_64-3.8/cffi
    copying cffi/_cffi_include.h -> build/lib.macosx-10.14.6-x86_64-3.8/cffi
    copying cffi/parse_c_type.h -> build/lib.macosx-10.14.6-x86_64-3.8/cffi
    copying cffi/_embedding.h -> build/lib.macosx-10.14.6-x86_64-3.8/cffi
    copying cffi/_cffi_errors.h -> build/lib.macosx-10.14.6-x86_64-3.8/cffi
    running build_ext
    building '_cffi_backend' extension
    creating build/temp.macosx-10.14.6-x86_64-3.8
    creating build/temp.macosx-10.14.6-x86_64-3.8/c
    clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -iwithsysroot/System/Library/Frameworks/System.framework/PrivateHeaders -iwithsysroot/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.8/Headers -arch arm64 -arch x86_64 -DUSE__THREAD -DHAVE_SYNC_SYNCHRONIZE -I/usr/local/Cellar/libffi/3.3/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/ffi -I/Users/xxxx/projects/xxxx/venv/include -I/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.8/include/python3.8 -c c/_cffi_backend.c -o build/temp.macosx-10.14.6-x86_64-3.8/c/_cffi_backend.o
    c/_cffi_backend.c:5854:2: error: Apple Arm64 ABI requires ffi_prep_cif_var
    #error Apple Arm64 ABI requires ffi_prep_cif_var
     ^
    c/_cffi_backend.c:6304:9: warning: 'ffi_prep_closure' is deprecated [-Wdeprecated-declarations]
        if (ffi_prep_closure(closure, &cif_descr->cif,
            ^
    /usr/local/Cellar/libffi/3.3/include/ffi.h:341:18: note: 'ffi_prep_closure' has been explicitly marked deprecated here
      __attribute__((deprecated))
                     ^
    1 warning and 1 error generated.
    error: command 'clang' failed with exit status 1
    ----------------------------------------
    ERROR: Failed building wheel for cffi

I didn't ever encounter this before I upgraded MacOS. Any idea what I can try?

There were fixes in cffi since the latest release, which look related. Can you try `pip install hg+https://foss.heptapod.net/pypy/cffi`? — Armin Rigo, Nov 20 '20 at 10:17
Interesting. I get `ERROR: Error [Errno 2] No such file or directory: 'hg' while executing command hg clone --noupdate -q https://foss.heptapod.net/pypy/cffi /private/var/folders/g8/nj61c9fhhbjdvbhhbmqqb00000gn/T/pip-req-build-e3dcg2vf ERROR: Cannot find command 'hg' - do you have 'hg' installed and in your PATH?` — MDalt, Nov 20 '20 at 10:26
I am able to install `cffi` from the latest commit as suggested (and importing the module works), but then when I try to install `cryptography` or `argon2-cffi`, pip apparently tries to reinstall `cffi` which of course fails. This is in a fresh virtual environment. Any ideas why? — Julian Panetta, Nov 22 '20 at 01:09
It claims to be trying to install `cffi` "Using cached cffi-1.14.3.tar.gz", even if I use the `--no-cache-dir` flag... — Julian Panetta, Nov 22 '20 at 01:12
I guess it's probably because installing `cffi` this way doesn't associate a version number with it, so the `cryptography` package thinks the dependency is unmet? `pip freeze` shows: `cffi @ hg+https://foss.heptapod.net/pypy/cffi/@3440` instead of `cffi==1.14.3`. — Julian Panetta, Nov 22 '20 at 01:21
Actually, it seems this is being caused by bugs in pip on Big Sur: https://github.com/pypa/pip/issues/9138 https://github.com/nolze/msoffcrypto-tool/issues/54 — Julian Panetta, Nov 22 '20 at 01:55
You can try this solution, I've described here: https://stackoverflow.com/a/66422219/9521312 — paveldroo, Mar 01 '21 at 12:36

score 23 · Answer 1 · answered Dec 15 '20 at 15:51

23

First install openssl

brew install openssl

Then export compiler options:

export CRYPTOGRAPHY_SUPPRESS_LINK_FLAGS="1" 
export LDFLAGS="-L/usr/local/opt/openssl@1.1/lib"
export CPPFLAGS="-I/usr/local/opt/openssl@1.1/include"

and now you can use pip install

pip3 install cryptography==2.8

answered Dec 15 '20 at 15:51

serge-g

253
1
6

2

On Big Sur 11.1 brew install openssl gives you "already installed" but I did the exports and pip install worked. Thanks for the tip. – tacan Dec 23 '20 at 00:26
1

@tacan Yes but exporting the compiler options does the trick! – Lars Bilke Jan 16 '21 at 20:00
On Big Sur, the `export` lines were insufficient. Even though openssl was already installed, I reinstalled it to see if it would help. It still failed for older (1.11.5) versions of cffi – hamx0r Jun 18 '21 at 17:37

Simeon Aleksov · Answer 2 · 2021-01-20T21:58:28.367

13

env LDFLAGS="-L$(brew --prefix openssl@1.1)/lib" CFLAGS="-I$(brew --prefix openssl@1.1)/include" pip install cryptography

edited Jan 20 '21 at 21:58

answered Jan 20 '21 at 21:40

Simeon Aleksov

1,275
1
13
25

1

This should be the top answer! It still is correct on M1 Arm Mac with Big Sur 11.6 – Bernd Verst Oct 06 '21 at 19:42
On my system, brew install openssl gave me openssl@3. Needed to run brew install openssl@1.1, then this worked. – J. Kevin Corcoran Jun 14 '22 at 19:30
This worked for me for M1 Arm Mac with Big Sur 11.6. I am using Python 2.7 pip 19.3 and cryptography 3.1.1 – pass-by-ref Jun 29 '22 at 16:53
This worked on M1 os pip but it still cant install cryptography inside virtualenv python 3.8.9. The version cryptography installed on os pip is 38.0.1. – Tan Hoo Chuan Nickson Oct 25 '22 at 07:50

score 3 · Answer 3 · answered Oct 06 '21 at 19:39

The answer from @serge-g above worked well on M1 Mac / ARM64 with Homebrew and Big Sur 11.6.

I had to make the following changes:

brew install openssl

export CRYPTOGRAPHY_SUPPRESS_LINK_FLAGS="1" 
export LDFLAGS="-L/opt/homebrew/opt/openssl@1.1/lib"
export CPPFLAGS="-I/opt/homebrew/opt/openssl@1.1/include"

At that point installing cryptography worked for me via pip3 install cryptography==2.8

FYI, in my case cryptography was a dependency of the Azure CLI Python package (pip3 install azure-cli). Thanks to @serge-g for pointing me in the right direction!

The answer from @Simeon Aleksov is the best answer because it will work regardless of where homebrew is installed! — Bernd Verst, Oct 06 '21 at 19:41

score 2 · Answer 4 · answered Mar 22 '21 at 06:22

2

According to this issue on cryptography's GitHub, as of November 2020, simply upgrading pip to the latest version allows this to work correctly. I was running into this error myself on pip 19 and upgrading to pip 21.0.1 fixed the issue for me.

answered Mar 22 '21 at 06:22

HirdayGupta

408
4
16

score 0 · Answer 5 · answered Dec 19 '20 at 06:13

0

You should try poetry shell and pip install cryptography

answered Dec 19 '20 at 06:13

koooh99

1

Pip error installing cryptography on Big Sur

5 Answers5