ImportError: No module named 'spacy.en'

Question

I'm working on a codebase that uses Spacy. I installed spacy using:

sudo pip3 install spacy

and then

sudo python3 -m spacy download en

At the end of this last command, I got a message:

    Linking successful
/home/rayabhik/.local/lib/python3.5/site-packages/en_core_web_sm -->
/home/rayabhik/.local/lib/python3.5/site-packages/spacy/data/en

You can now load the model via spacy.load('en')

Now, when I try running my code, on the line:

    from spacy.en import English

it gives me the following error:

ImportError: No module named 'spacy.en'

I've looked on Stackexchange and the closest is: Import error with spacy: "No module named en" which does not solve my problem.

Any help would be appreciated. Thanks.

Edit: I might have solved this by doing the following:

 Python 3.5.2 (default, Sep 14 2017, 22:51:06) 
[GCC 5.4.0 20160609] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import spacy
>>> spacy.load('en')
<spacy.lang.en.English object at 0x7ff414e1e0b8>

and then using:

from spacy.lang.en import English

I'm still keeping this open in case there are any other answers.

Thanks, changing the line solved my problem too! How did you figure it out? — yuqli, Nov 27 '17 at 15:12
@yuqli: I don't exactly remember, but I think I was going through the source. — rayabhik, Nov 27 '17 at 18:22
Also works for german with `sudo python3 -m spacy download de` — nik, Mar 02 '18 at 15:23
I have same problem with spacy 2.0.Therfore I changed spacy version. pip uninstall spacy pip install spacy==1.6.0 — Nadeeshani William, Apr 24 '18 at 00:39

Ines Montani · Accepted Answer · 2019-04-26T11:57:51.567

Yes, I can confirm that your solution is correct. The version of spaCy you downloaded from pip is v2.0, which includes a lot of new features, but also a few changes to the API. One of them is that all language data has been moved to a submodule spacy.lang to keep thing cleaner and better organised. So instead of using spacy.en, you now import from spacy.lang.en.

- from spacy.en import English
+ from spacy.lang.en import English

However, it's also worth mentioning that what you download when you run spacy download en is not the same as spacy.lang.en. The language data shipped with spaCy includes the static data like tokenization rules, stop words or lemmatization tables. The en package that you can download is a shortcut for the statistical model en_core_web_sm. It includes the language data, as well as binary weight to enable spaCy to make predictions for part-of-speech tags, dependencies and named entities.

Instead of just downloading en, I'd actually recommend using the full model name, which makes it much more obvious what's going on:

python -m spacy download en_core_web_sm

nlp = spacy.load("en_core_web_sm")

When you call spacy.load, spaCy does the following:

Find the installed model named "en_core_web_sm" (a package or shortcut link).
Read its meta.json and check which language it's using (in this case, spacy.lang.en), and how its processing pipeline should look (in this case, tagger, parser and ner).
Initialise the language class and add the pipeline to it.
Load in the binary weights from the model data so pipeline components (like the tagger, parser or entity recognizer) can make predictions.

See this section in the docs for more details.

Thanks a bunch Ines. Yes, I did see that there was no need to import English. This is code written by someone else, and I don't have the time to clean it up right now, but can hopefully later. — rayabhik, Nov 15 '17 at 02:35
I've spacy '2.0.12' and above does not work. @gdaras solution of `from spacy.lang.en import English` does work. — Anil_M, Sep 10 '18 at 21:09
@Anil_M you should make this an answer! It works while the accepted answer doesn't for later versions of 2.0.x — duhaime, Apr 25 '19 at 10:43
I've updated my reply to include more info on the model packages to prevent the confusion! — Ines Montani, Apr 26 '19 at 11:58
Even after i did **python -m spacy download en_core_web_sm**, Jupyter **throws error** when i try to execute this code **nlp = spacy.load("en_core_web_sm")**. The **error** is **"[E050] Can't find model 'en_core_web_sm'. It doesn't seem to be a shortcut link, a Python package or a valid path to a data directory."** . — fuat, May 10 '20 at 09:24
@InesMontani does spacy 3.0 has wordnet? It seems that wordnet only supports 'en' model. — the_learning_child, Apr 30 '21 at 18:19

score 15 · Answer 2 · answered Apr 17 '18 at 12:27

15

I used the following command for installing spacy from anaconda distribution.

conda install -c conda-forge spacy

and after that, I was able to download English using the following command without any error.

 python -m spacy download en

answered Apr 17 '18 at 12:27

anees ahmed

151
1
3

2

this helped for a conda + venv setup. – Van Peer Apr 01 '19 at 14:12

score 9 · Answer 3 · answered Feb 13 '18 at 21:55

9

I had to use en_core_web_sm instead of en to make that work. It is complaining about permission problem. The following works perfectly:

import spacy
spacy.load('en_core_web_sm')
from spacy.lang.en import English

answered Feb 13 '18 at 21:55

Elham

163
2
5

score 4 · Answer 4 · answered May 24 '18 at 12:07

I think that there is a confusion in the answers provided. Correct things mentioned:

you should import from spacy.lang.en
spacy.load('en') is indeed a shortcut for loading models.

But: the file en_core_web_sm is not the same file as the one you import from spacy.lang.en. Actually, the first file is produced from the second after training with spacy train in a dataset and then packaging the result. spacy.lang.en contains the model definition: lemmas lookup table, stop_words, lexical attributes (and more). But that and only that. It is not trained with a dataset so that the dependency graph and other functionalities can work.

I think this should be clear enough when working with spaCy.

score 3 · Answer 5 · answered Feb 20 '21 at 14:11

3

pip install spacy
python -m spacy download en

This works for me

answered Feb 20 '21 at 14:11

User

1,460
14
11

score 2 · Answer 6 · answered Jun 01 '20 at 23:52

Anaconda Users

If you're using a conda virtual environment, be sure that its the same version of Python as that in your base environment. To verify this, run python --version in each environment. If not the same, create a new virtual environment with that version of Python (Ex. conda create --name myenv python=x.x.x).
Activate the virtual environment (conda activate myenv)
conda install -c conda-forge spacy
python -m spacy download en_core_web_sm

I just ran into this issue, and the above worked for me. This addresses the issue of the download occurring in an area that is not accessible to your current virtual environment.

You should then be able to run the following:

import spacy
nlp = spacy.load("en_core_web_sm")

score 1 · Answer 7 · answered Mar 20 '18 at 10:02

1

the en_core_web_sm folder was downloaded outside the spacy folder. I copied it into the spacy/data folder and could run the code as documented in spacy

answered Mar 20 '18 at 10:02

Sujay DSa

1,172
2
22
37

score 1 · Answer 8 · answered Feb 19 '19 at 08:26

Anyone facing this issue on Windows 10 and Anaconda installation , look for your conda python executable using where python on command line before running the script.

In my case, the python on the PATH was

C:\Users\XXX\.windows-build-tools\python27\python.exe

whereas what I needed was from

c:\Users\XXX\AppData\Local\Continuum\anaconda3\python.exe

Just add the correct python on the path , or go to this location and run

python -m spacy download en

and it should work.

score 1 · Answer 9 · answered Nov 04 '19 at 12:15

1

According to the official website you should do as follow:

python -m spacy download en

However, this surprisingly does NOT work for me.
As you may interst, my env is based on OSX 10.15 with python 3.8, pip 19.3.1
try:

spacy download en

answered Nov 04 '19 at 12:15

QIAN KEQIAO

541
1
4
7

works for me on linux mint – Stuck Jan 11 '22 at 17:19

score 1 · Answer 10 · answered May 15 '20 at 06:07

1

For me what worked are these steps:

import sys
!{sys.executable} -m pip install spacy
!{sys.executable} -m spacy download en

I run these steps at my spyder console (installed through anaconda)

answered May 15 '20 at 06:07

msh855

1,493
1
15
36

score 1 · Answer 11 · edited Feb 07 '22 at 08:48

1

For me the below steps worked in my Jupyter:

pip install spacy


import spacy

from spacy.cli import download

print(download('en_core_web_sm'))

edited Feb 07 '22 at 08:48

Ihor Konovalenko

1,298
2
16
21

answered Feb 06 '22 at 17:04

Desalakshmi

21
2

Hi and thanks for the answer. Could you explain what your code does and how does it build on the previous 12 answers to the question? – Simas Joneliunas Feb 12 '22 at 00:13

score 1 · Answer 12 · answered Jun 10 '22 at 20:46

1

I solved it by:

import spacy.cli
spacy.cli.download("en_core_web_lg")

Hope it helps

answered Jun 10 '22 at 20:46

xackobo

261
2
4

score 0 · Answer 13 · answered Feb 08 '20 at 05:33

0

from spacy.lang.en import English instead of from spacy.en import English

answered Feb 08 '20 at 05:33

gobind agarwal

1
2

score 0 · Answer 14 · answered Jan 12 '21 at 13:45

0

my solutions for en and fr and it

!pip install spacy
!python -m spacy download en
!python -m spacy download it
!python -m spacy download fr

then

import spacy
spacy.load('en')
spacy.load('it')
spacy.load('fr')

answered Jan 12 '21 at 13:45

venergiac

7,469
2
48
70

ImportError: No module named 'spacy.en'

14 Answers14

Linked

Related