38

I use Python extensively on my Mac OS X, for both numerical applications and web development (roughly equally). I checked the number of Python installations I had on my laptop recently, and was shocked to find four:

Came with Mac OS X:
/usr/bin/python
Python 2.7.6 (default, Sep  9 2014, 15:04:36)
[GCC 4.2.1 Compatible Apple LLVM 6.0 (clang-600.0.39)] on darwin

Installed via Homebrew
/usr/local/bin/python
Python 2.7.10 (default, Jul 13 2015, 12:05:58)
[GCC 4.2.1 Compatible Apple LLVM 6.1.0 (clang-602.0.53)] on darwin

Installed via Anaconda/Miniconda
~/anaconda/bin/python
Python 2.7.10 |Anaconda 2.3.0 (x86_64)| (default, Oct 19 2015, 18:31:17)
[GCC 4.2.1 (Apple Inc. build 5577)] on darwin
Anaconda is brought to you by Continuum Analytics.
Please check out: http://continuum.io/thanks and https://anaconda.org

Came with the downloaded .pkg from python.org
/System/Library/Frameworks/Python.framework/Versions/Current/bin/python
Python 2.7.6 (default, Sep  9 2014, 15:04:36)
[GCC 4.2.1 Compatible Apple LLVM 6.0 (clang-600.0.39)] on darwin

I decided to unify all of this, and use conda. I removed the Homebrew version and the Python.org download (kept the main system one). Conda is great for numerical computing, because I can install Jupyter/Numpy/Pandas in the root environment, and not have to bother install virtualenvs for every project.

But now my entire web development workflow is messed up. None of my virtualenvs work, since apparently one's not supposed to use conda and virtualenv together. I tried to create conda environments from the requirements.txt file. One package I was using with django was "markdown_deux", which is not available in the Conda repo. I looked at ways of building it, but creating a recipe takes a lot of effort (create YAML file, etc..)

Has anyone found a good compromise for this? I'm thinking of going back to the homebrew version for general use, and writing an alias for changing the path back to the conda version as necessary. Though this will also require tracking which one I'm using now..

user1496984
  • 10,957
  • 8
  • 37
  • 46

2 Answers2

31

I use Homebrew Python for all my projects (data science, some web dev).

Conda is nothing fancy, you can have the same packages by hand with a combination of pip and Homebrew science. Actually, it is even better because you have more control on what you install.

You can use your virtualenvs only when you do web development. For the numerical applications you will probably want to have the latest versions of your packages at all times.

If you want to update all your packages at once with pip, you can use this command:

sudo -H pip freeze --local | grep -v '^\-e' | cut -d = -f 1  | xargs -n1 sudo -H pip install -U

EDIT: This answer is old, if you want a more up-to-date comparison, I found this nice blog article which compares the two approaches:

https://towardsdatascience.com/pipenv-vs-conda-for-data-scientists-b9a372faf9d9

I still use Homebrew Python, and pip / pipenv over conda.

Kirell
  • 9,228
  • 4
  • 46
  • 61
  • 3
    What do you mean by "You can use your virtualenvs only when you do web development."? I use it for scikit-learn, that works fine. – henrikstroem Nov 19 '15 at 16:51
  • 1
    @henrikstroem I meant that you only need to really use virtualenvs when you need a specific version of your packages as you would do for a webapp. For science you probably want to use the latest packages because they are compatible – Kirell Nov 19 '15 at 23:13
  • 1
    Why would you have more control using homebrew and pip compared to using conda? – K.-Michael Aye Dec 17 '15 at 02:35
  • 2
    Conda comes with more than 300 packages. I doubt all are useful for one's domain of expertise. Another point is that brew packages requires brew python. It is a pain to change it to anaconda (I tried). – Kirell Dec 17 '15 at 19:44
  • @Kikohs I've installed both and only use homebrew python because some apps need it to install but i like anaconda, the package dependencies tool is great at figuring out compatible versions, homebrew is very lacking. i'd to find a way to force homebrew to recognize anaconda python and those packages instead of having duplicate. – μολὼν.λαβέ Jan 10 '16 at 04:47
  • 1
    I disagree. I'm "doing science" and I need to have both python2 and python3 at the same time, to be compatible with different people. I love conda's solution (which I am using on my office computer), and am yet to have found a proper way to handle the different iPython versions on my Mac OS computer with homebrew. – FooBar Mar 01 '16 at 18:11
  • 5
    I totally agree with you, Anaconda is nothing but a pip + virtualenv (+ virtualenvwrapper). However recently I have discovered one limit to the built-in Python (which is not "because of" Python): some libraries can only be installed on Anaconda, and not with Python. My example is Gurobi (a linear optimizer). – Edouard Berthe Dec 16 '16 at 07:30
  • 9
    Homebrew science is deprecated. This question and answer needs updating -- the whole issue of installing Python on Mac has changed. Caveat Emptor! – stonecanyon Apr 06 '18 at 18:44
  • 3
    What's the/a new way we're supposed to use now @stonecanyon ? – WillC Jul 22 '18 at 09:59
  • 1
    Conda is different that pip. Pip can only install python package but conda can install other kind of package. – gagarine Jan 06 '19 at 17:37
  • Conda is absolutely not just pip + virtualenv. If you believe this, you really need to do some deeper digging into what conda actually does. – PMende Jul 28 '21 at 16:38
  • @PMende The answer is 6 years old.. Conda changed :) – Kirell Jul 28 '21 at 18:45
  • @Kirell Sorry, should have tagged who I was speaking to. Was directed at one of the comments. Anyway, I think it's important context for people who come here: conda is a full-blown environment solver, and handles non-Python dependencies. Both of these capabilities are missing from pip/venv. – PMende Jul 29 '21 at 18:01
21

Workflow that I've found the best:

  • Use conda for virtual environment management. Never use / install into system python.

  • Use pip to install into the active virtual environment, just like normal.

  • Use conda packages only for hard to install software, such as Qt.

Automation / extras

  • Use autoenv or direnv and automatically activate virtual environments when you enter a directory by putting the conda command inside the .env or .envsrc file.
Rebs
  • 4,169
  • 2
  • 30
  • 34