Python when reading csv file get error: _csv.Error: line contains NULL byte

Asked Jun 23 '21 at 16:19

Active Jun 23 '21 at 16:22

Viewed 182 times

I keep receiving the following error message "csv.Error: line contains NULL byte " when trying to read my gzip file contains NULLs at the header and end of file and I'm trying to figure out a way to skip these but cannot get past the error message. Has anyone come across this and has a solution?

from gzip import GzipFile
import csv
import codecs

gzipped = GzipFile(None, 'rb', fileobj=response['Body'])
lines = csv.reader(codecs.iterdecode(gzipped, 'utf-8'))
print (lines, "lines")

next(lines) #to skip header

Error: _csv.Error: line contains NULL byte

I can't also use pandas lib as this lib is not available within the platform I am working on. Only basic python libs are available.

edited Jun 23 '21 at 16:22

Barmar

741,623
53
500
612

asked Jun 23 '21 at 16:19

freshtojava

I think that might be of some help https://stackoverflow.com/questions/7894856/line-contains-null-byte-in-csv-reader-python – Vinay Kumar Jun 23 '21 at 16:29
I have also tried using csv.reader( (line.replace('\0','') for line in l) ) but still end up with the same error – freshtojava Jun 23 '21 at 16:36
Are you sure it's UTF-8 encoded? – Mark Adler Jun 23 '21 at 17:43

Python when reading csv file get error: _csv.Error: line contains NULL byte

0 Answers0