How can I install packages using pip according to the requirements.txt file from a local directory?

Question

Here is the problem:

I have a requirements.txt file that looks like:

BeautifulSoup==3.2.0
Django==1.3
Fabric==1.2.0
Jinja2==2.5.5
PyYAML==3.09
Pygments==1.4
SQLAlchemy==0.7.1
South==0.7.3
amqplib==0.6.1
anyjson==0.3
...

I have a local archive directory containing all the packages + others.

I have created a new virtualenv with

bin/virtualenv testing

Upon activating it, I tried to install the packages according to requirements.txt from the local archive directory.

source bin/activate
pip install -r /path/to/requirements.txt -f file:///path/to/archive/

I got some output that seems to indicate that the installation is fine:

Downloading/unpacking Fabric==1.2.0 (from -r ../testing/requirements.txt (line 3))
  Running setup.py egg_info for package Fabric
    warning: no previously-included files matching '*' found under directory 'docs/_build'
    warning: no files found matching 'fabfile.py'
Downloading/unpacking South==0.7.3 (from -r ../testing/requirements.txt (line 8))
  Running setup.py egg_info for package South
....

But a later check revealed that none of the packages are installed properly. I cannot import the packages, and none are found in the site-packages directory of my virtualenv. So what went wrong?

Answer 1

This works for everyone:

pip install -r /path/to/requirements.txt

Explanation:

-r, --requirement < filename >

Install from the given requirements file. This option can be used multiple times.

Answer 2

This works for me:

$ pip install -r requirements.txt --no-index --find-links file:///tmp/packages

--no-index - Ignore package index (only looking at --find-links URLs instead).

-f, --find-links <URL> - If a URL or path to an HTML file, then parse for links to archives.

If a local path or file:// URL that's a directory, then look for archives in the directory listing.

Answer 3

For virtualenv to install all files in the requirements.txt file.

1. cd to the directory where requirements.txt is located
2. activate your virtualenv
3. run: pip install -r requirements.txt in your shell

Answer 4

I had a similar problem. I tried this:

    pip install -U -r requirements.txt

(-U = update if it had already installed)

But the problem continued. I realized that some of generic libraries for development were missed.

    sudo apt-get install libtiff5-dev libjpeg8-dev zlib1g-dev liblcms2-dev libwebp-dev tcl8.6-dev tk8.6-dev python-tk

I don't know if this would help you.

Answer 5

Use:

pip install -r requirements.txt

For further details, please check the help option:

pip install --help

We can find the option '-r' -

-r, --requirement Install from the given requirements file. This option can be used multiple times.

Further information on some commonly used pip install options (this is the help option on the pip install command):

Also the above is the complete set of options. Please use pip install --help for the complete list of options.

Answer 6

Short answer

pip install -r /path/to/requirements.txt

or in another form:

python -m pip install -r /path/to/requirements.txt

Explanation

Here, -r is short form of --requirement and it asks the pip to install from the given requirements file.

pip will start installation only after checking the availability of all listed items in the requirements file and it won't start installation even if one requirement is unavailable.

One workaround to install the available packages is installing listed packages one by one. Use the following command for that. A red color warning will be shown to notify you about the unavailable packages.

cat requirements.txt | xargs -n 1 pip install

To ignore comments (lines starting with a #) and blank lines, use:

cat requirements.txt | cut -f1 -d"#" | sed '/^\s*$/d' | xargs -n 1 pip install

Answer 7

First of all, create a virtual environment.

In Python 3.6

virtualenv --python=/usr/bin/python3.6 <path/to/new/virtualenv/>

In Python 2.7

virtualenv --python=/usr/bin/python2.7 <path/to/new/virtualenv/>

Then activate the environment and install all the packages available in the requirement.txt file.

source <path/to/new/virtualenv>/bin/activate
pip install -r <path/to/requirement.txt>

Answer 8

Often, you will want a fast install from local archives, without probing PyPI.

First, download the archives that fulfill your requirements:

$ pip install --download <DIR> -r requirements.txt

Then, install using –find-links and –no-index:

$ pip install --no-index --find-links=[file://]<DIR> -r requirements.txt

Answer 9

Try this:

python -m pip install -r requirements.txt

Answer 10

I work with a lot of systems that have been mucked by developers "following directions they found on the Internet". It is extremely common that your pip and your python are not looking at the same paths/site-packages. For this reason, when I encounter oddness I start by doing this:

$ python -c 'import sys; print(sys.path)'
['', '/usr/lib/python2.7', '/usr/lib/python2.7/plat-x86_64-linux-gnu',
'/usr/lib/python2.7/lib-tk', '/usr/lib/python2.7/lib-old',
'/usr/lib/python2.7/lib-dynload', '/usr/local/lib/python2.7/dist-packages',
'/usr/lib/python2.7/dist-packages']

$ pip --version
pip 9.0.1 from /usr/local/lib/python2.7/dist-packages (python 2.7)

That is a happy system.

Below is an unhappy system. (Or at least it's a blissfully ignorant system that causes others to be unhappy.)

$ pip --version
pip 9.0.1 from /usr/local/lib/python3.6/site-packages (python 3.6)

$ python -c 'import sys; print(sys.path)'
['', '/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python27.zip',
'/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python2.7',
'/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python2.7/plat-darwin',
'/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python2.7/plat-mac',
'/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python2.7/plat-mac/lib-scriptpackages',
'/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python2.7/lib-tk',
'/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python2.7/lib-old',
'/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python2.7/lib-dynload',
'/usr/local/lib/python2.7/site-packages']

$ which pip pip2 pip3
/usr/local/bin/pip
/usr/local/bin/pip3

It is unhappy because pip is (python3.6 and) using /usr/local/lib/python3.6/site-packages while python is (python2.7 and) using /usr/local/lib/python2.7/site-packages

When I want to make sure I'm installing requirements to the right python, I do this:

$ which -a python python2 python3
/usr/local/bin/python
/usr/bin/python
/usr/local/bin/python2
/usr/local/bin/python3

$ /usr/bin/python -m pip install -r requirements.txt

You've heard, "If it ain't broke, don't try to fix it." The DevOps version of that is, "If you didn't break it and you can work around it, don't try to fix it."

Answer 11

Installing requirements.txt file inside virtual env with Python 3:

I had the same issue. I was trying to install the requirements.txt file inside a virtual environment. I found the solution.

Initially, I created my virtualenv in this way:

virtualenv -p python3 myenv

Activate the environment using:

source myenv/bin/activate

Now I installed the requirements.txt file using:

pip3 install -r requirements.txt

Installation was successful and I was able to import the modules.

Answer 12

• Create virtual environment python3 -m venv virtual-env (For windows use python instead of python3)
• Activate your virtual environment source virtual-env/bin/activate
• Now install requirements pip install -r requirements.txt

Answer 13

pip install --user -r requirements.txt 

OR

pip3 install --user -r requirements.txt 

Answer 14

Use pip3 install -r requirements.txt But make sure the requirements.txt file has been pulled from origin and not added to .gitignore

Answer 15

In Windows, this can lead to less format-related path issues, if you have

c:\folder\subfolder\requirements.txt

cd c:\folder\subfolder 
pip install -r requirements.txt

Answer 16

On windows Using this

pip install -r /path/to/requirements.txt 

On linux pc we have python2 and also python3 so most time pip is regarded as

Python2

pip install -r /path/to/requirements.txt 

Python 3

pip3 install -r /path/to/requirements.txt

Answer 17

Almost all the previous answers are correct, but I will suggest something new. The fact is that packages can be installed not only at the stage before launching the program, but also directly in runtime. I wrote a small library called instld for this.

Try installing it:

pip install instld

Now insert a similar code directly into your program:

import installed

with installed(r='requirements.txt'):
    import some_module

What are the advantages and disadvantages of this approach? Let's start with the disadvantages, they are the most obvious:

• This creates delays when executing the program every time. It needs time to create a temporary directory, download the library there and install it, and then "clean up the garbage behind it".
• This creates more load on the disk (since the package is downloaded to the disk in the temporary directory every time the program is started, and then deleted) and on the network. This may not play a special role in the private use of this method, but this kind of overhead will definitely be noticeable if a large organization starts using this method.

It would seem that if this method has so many disadvantages, why might it be necessary to use it? There may be several reasons for this, here are some of them:

• This speeds up the work. Imagine that you need to quickly try 20 different libraries that are similar to each other. You do this in REPL. To install each of them, you need to exit the interpreter session, install the desired library via pip, then open a new session and try the library in the code. After all these actions, you should exit the interpreter again and delete the installed libraries. Sounds slow, right? And if you use instld, you don't need to exit the interpreter and your work becomes very fast. After exiting the interpreter, there will be no garbage left in the system.
• You want to share your short script with a friend who is not familiar with Python. In this case, you just need to send him just one file. You describe the entire installation of dependencies in this file.
• You can simultaneously use 2 different versions of the same library in the same program. It is rarely useful, but when it is needed, there are simply no other ways.
• You can use conflicting libraries inside the same program. To do this, it is enough to install each of them in a separate context and import it directly from there.

As you can see, this approach has both pros and cons, so choose wisely.

Answer 18

I have solved with running the below command:

py -m pip install ./requirements.txt

the above command will install all dependencies and libraries for the Django project.