Module installed returning ModuleNotFoundError

Question

I'm using virtualenvwrapper to manage a project where I'm just running this for now

import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions

with beam.Pipeline(options=PipelineOptions()) as p:
    pass

This is returning the following error

Traceback (most recent call last):
  File "path/to/pipeline.py", line 1, in <module>
    import apache_beam as beam
ModuleNotFoundError: No module named 'apache_beam'

I have run pip install apache-beam. Running pip list returns

➜ pip list  
Package                        Version
------------------------------ ---------
apache-beam                    2.23.0
avro-python3                   1.9.2.1
...

I'll add the following outputs as suggested in a similar question.

pip freeze

➜ pip freeze
apache-beam==2.23.0
avro-python3==1.9.2.1
...

pip -V

➜ pip -V    
pip 20.2.2 from /Users/miguel/.virtualenvs/myenv/lib/python3.7/site-packages/pip (python 3.7)

python -V

➜ python -V        
Python 3.7.3

which python

➜ which python
/Users/miguel/.virtualenvs/myenv/bin/python

which pip

➜ which pip   
/Users/miguel/.virtualenvs/myenv/bin/pip

I don't know if this is relevant but I'm using VSCode and I have selected my python interpreter according to VSCode instructions here. Additionally, I installed python following the instructions here.

Any idea why this is happening?

Answer 1

First test if your installed Python modules work outside of an ide like VSCode. We can do this by opening the terminal/command prompt and activating our virtual enviornment. In this case, as you're using virtualenvwrapper you need to use the command:

workon myenv

Documentation for the virtualenvwrapper can be found here. Once activated, we can open the Python interpreter in our terminal by using the command:

python

Once running, try and import apache_beam as before using:

import apache_beam as beam

If this works we now know it's a virtual environment set up issue using VSCode. For setting up Virtual Environments for Python in VSCode, use the official documentation Using Python environments in VS Code. This should allow you to specify the virtual environment.

If this fails to work, another option is to create a new virtual environment in VSCode and install your modules. Installing modules to a environment in VSCode can be found in the VSCode instructions you linked to in your post.

I tried to re-create your issue as above using the following:

• Python 3.7.7
• VSCode 1.48.0
• apache-beam 2.23.0

My virtual environment was named 'stack'. Once I had created it the only module I installed was apache-beam using:

pip install apache-beam

When creating the project I made the directory and launched via terminal using:

 - mkdir hello
 - cd hello
 - code .

And then added the Python interpreter via the command:

Python: Select Interpreter

One additional step I needed (as I usually use PyCharm for Python) was to install:

Shell Command: Install 'code' command in PATH** command.

To allow the launch of code via terminal. Below is a screenshot of the project after following these steps and running the same commands as posted in your question for reference.

My .vscode/settings.json is as follows:

{
    "python.pythonPath": "/Users/robertyoung/envs/stack/bin/python"
}