Python adding extra text and braces while reading from CSV file

Question

I wanted to read data from a csv file using python but after using the following code there are some extra characters and braces in the text which is not in the original data. Please help to remove it.

import csv

with open("data.csv",encoding="utf8") as csvDataFile:
    csvReader = csv.reader(csvDataFile)

    for row in csvReader:
        print(row)

What is displayed after reading is:- ['\ufeffwww.aslteramo.it']

This is a duplicate question of this: https://stackoverflow.com/questions/17912307/u-ufeff-in-python-string/17912811#17912811 — yakutsa, Nov 28 '21 at 23:09
Does this answer your question? [u'\ufeff' in Python string](https://stackoverflow.com/questions/17912307/u-ufeff-in-python-string) — yakutsa, Nov 28 '21 at 23:09
What are you using to view the file? Also, how are you running Python? Not everything can display utf-8 encoding — Martin Evans, Nov 29 '21 at 12:34

score 1 · Answer 1 · answered Nov 28 '21 at 23:10

1

This is utf-8 encoding with a Byte Order Mark (BOM) - which is used as a signature in windows.

Open the file using the utf-8-sig encoding instead of utf8

answered Nov 28 '21 at 23:10

HPringles

1,042
6
15

wovano · Answer 2 · 2021-11-28T23:14:44.500

\ufeff is a UTF-8 BOM (also known as 'ZERO WIDTH NO-BREAK SPACE' character).

It's sometimes used to indicate that the file is in UTF-8 format.

You could use str.replace('\ufeff', '') in your code to get rid of it. Like this:

import csv

with open("data.csv",encoding="utf8") as csvDataFile:
    csvReader = csv.reader(csvDataFile)
    for row in csvReader:
        print([col.replace('\ufeff', '') for col in row])

Another solution is to open the file with 'utf-8-sig' encoding instead of 'utf-8' encoding.

By the way, the braces are a added because row is a list. If your CSV file only has one column, you could select the first item from each row like this:

print(row[0].replace('\ufeff', ''))

Python adding extra text and braces while reading from CSV file

2 Answers2