UnicodeDecodeError in CSV readiring in Python

Asked Jun 18 '17 at 05:16

Active Jun 18 '17 at 05:42

Viewed 769 times

I have a CSV file and when I try to read it in Python 2.7, it makes following error.

UnicodeDecodeError: 'ascii' codec can't decode byte 0x8b in position 10: ordinal not in range(128)

This is my code so far,

with open('train.csv', 'rb') as csvfile:
reader = csv.DictReader(csvfile)
for row in reader:
    text=(row['Descript'])
    emotion = (row['Category'])

I found many solution from this site like How to fix: "UnicodeDecodeError: 'ascii' codec can't decode byte", UnicodeDecodeError: 'ascii' codec can't decode byte 0xef in position 1 But they are not able to fix my error. Can anyone help me.

edited Jun 18 '17 at 05:42

asked Jun 18 '17 at 05:16

Chathuri Fernando

1

Why are you reading the file in binary mode? – Burhan Khalid Jun 18 '17 at 05:19
If i used 'r' instead of 'rb', it also make the same error. – Chathuri Fernando Jun 18 '17 at 05:20
this might help: https://stackoverflow.com/questions/23917729/switching-to-python-3-causing-unicodedecodeerror and: python2 or python3? then one or two of your offending input-lines might be helpful for people wanting to help. – hiro protagonist Jun 18 '17 at 05:36
1

could have been easier if you wrote the csv with `str.encode('utf-8')` – Joseph D. Jun 18 '17 at 05:45
2

Use Python 3, if possible. If not possible, use it anyways. Or [unicodecsv](https://pypi.python.org/pypi/unicodecsv/0.14.1) – Antti Haapala -- Слава Україні Jun 18 '17 at 05:46
@ChathurikaJayawardana it would, the code is Python 2 – Antti Haapala -- Слава Україні Jun 18 '17 at 05:47
I can't reproduce your error. Character 0x8b is ‹ (left angle quotation mark) in the Latin-1 encoding, but from what you report there is no way to tell what encoding your file is in. Edit your question to include the line of data where the program reports the error. If you don't know where that is, put a temporary `print` statement inside your loop to identify it. – BoarGules Jun 18 '17 at 10:35

UnicodeDecodeError in CSV readiring in Python

0 Answers0