Load CSV file over URL which contains utf-8 symbol (German Umlaut ä,ü,ö)

Asked Aug 16 '21 at 17:44

Active Aug 16 '21 at 17:52

Viewed 19 times

In order to load tsv/csv files from an API I used:

url = "https://www.dwds.de/r/?q=Angst&limit=15&view=tsv"
pd.read_csv(url ,sep='\t', encoding = "utf-8")

This works perfectly fine with urls which are suitable for ascii and returns an expected csv file. But if the url contains Umlaut (such as ä,ü,ö) it throws an error.

For instance:

url = "https://www.dwds.de/r/?q=Angstgefühl&limit=15&view=tsv"
pd.read_csv(url ,sep='\t', encoding = "utf-8")

>>> UnicodeEncodeError: 'ascii' codec can't encode character '\xfc' in position 18: ordinal not in range(128)

Here I used an url with Angstgefühl inside it, which contains an Ü. I think read_csv can not handle that. Is there an alternative or a way to use read_csv in that case?

edited Aug 16 '21 at 17:52

asked Aug 16 '21 at 17:44

Oweys

1

You need to URL-encode the ü character, like `Angstgef%C3%BChl` – tripleee Aug 16 '21 at 17:48
1

The code in the question isn't valid Python (the URL should probably be a string). – tripleee Aug 16 '21 at 17:49
Thank you for the answer. You right. This was a typo tho – Oweys Aug 16 '21 at 17:52

Load CSV file over URL which contains utf-8 symbol (German Umlaut ä,ü,ö)

0 Answers0