Scrapy: ImportError: No module named items

Question

When I try to run scrapy I get this error ImportError: No module named items

I just added in items.py the list of things I want to scrape and in the spider.py I have imported the class with from spider.items import SpiderItem

Dont know why its not loading it...

Package layout is...

./spider
./spider/pipelines.py
./spider/settings.py
./spider/spiders
./spider/spiders/spider_spider.py
./spider/spiders/test.py
./spider/spiders/__init__.py
./spider/middlewares.py
./spider/__init__.py
./spider/items.py

your middle sencence makes no sense. you probably have a problem with (relative) imports. you should post your package layout, then maybe someone can help you. — mata, May 13 '12 at 09:48

score 28 · Accepted Answer · edited Sep 24 '18 at 20:00

28

From this message on google groups:

Your spider module is named the same as your scrapy project module, so python is trying to import items relative to byub.py spider.

You are facing a common regret of python imports, see http://www.python.org/dev/peps/pep-0328

quicks fixes:

rename your spider module to byub_org.py or similar.
or use from __future__ import absolute_import in byub.py spider.
or rename your project to something like byubbot.

edited Sep 24 '18 at 20:00

Kul-Tigin

16,728
1
35
64

answered May 13 '12 at 10:01

Nick Craig-Wood

52,955
12
126
132

1

Thanks Nick but I have already found that and tried to solve it... and that was not the issue or at least I am not getting a solution... – jsjc May 13 '12 at 13:24

score 4 · Answer 2 · answered Jan 15 '14 at 10:35

4

I happend to face this problem because my spider name is the same with the scrapy project.

Just rename the spider name will make it.

answered Jan 15 '14 at 10:35

hahakubile

6,978
4
28
18

Had the same issue, I renamed the spider name file different than the project and it worked – delpo Apr 02 '18 at 17:59

score 2 · Answer 3 · answered Feb 24 '14 at 09:00

2

Without renaming any files, change from spider.items import SpiderItem to from .. import items and refer to the item as items.SpiderItem in your code.

answered Feb 24 '14 at 09:00

Fan Jin

400
5
12

score 2 · Answer 4 · answered Jun 13 '17 at 06:48

2

It's a good solution to rename your spider module.

But don't forget to delete the related *.pyc file after renaming, considering that the *.pyc file plays a role like cache.

answered Jun 13 '17 at 06:48

henry zhu

561
4
6

score 1 · Answer 5 · answered May 15 '16 at 11:37

1

Sorry for necroposting. Try put in file ./spider/__init__.py

that

 import items

answered May 15 '16 at 11:37

while1pass

340
5
15

score 0 · Answer 6 · answered Jan 15 '14 at 19:57

0

You are missing the following line after your import statements in your spider.py file.

class ProjectnamegoeshereSpider(BaseSpider):

answered Jan 15 '14 at 19:57

Theodis Butler

136
2
9

Scrapy: ImportError: No module named items

6 Answers6

Linked