Change ' into normal character

Question

I'm having trouble displaying content, my program:

#! /usr/bin/python

import urllib
import re

url = "http://yahoo.com"
pattern = '''<span class="medium item-label".*?>(.*)</span>'''

website = urllib.urlopen(url)
pageContent = website.read()
result = re.findall(pattern, pageContent)

for record in result:
    print record

output:

Masked teen killed by dad
First look in &#39;Hotel of Doom&#39;
Ex-NFL QB&#39;s sad condition
Reporter ignores warning
Romney&#39;s low bar for debates

So the question is what should I include in my code in order to transform &#39 into characters

maybe duplicated with http://stackoverflow.com/questions/57708/convert-xml-html-entities-into-unicode-string-in-python — charlee, Sep 28 '12 at 19:31

score 18 · Accepted Answer · answered Sep 28 '12 at 19:30

18

In Python2:

In [16]: text = 'Ex-NFL QB&#39;s sad condition'

In [17]: import HTMLParser

In [18]: parser = HTMLParser.HTMLParser()

In [19]: parser.unescape(text)
Out[19]: u"Ex-NFL QB's sad condition"

In Python3:

import html.parser as htmlparser
parser = htmlparser.HTMLParser()
parser.unescape(text)

answered Sep 28 '12 at 19:30

unutbu

842,883
184
1,785
1,677

3

`html.parser.HTMLParser.unescape` is deprecated, and `html.unescape` should be used instead. Abhishek's answer is more up-to-date. – Willie Chalmers III Jul 02 '20 at 15:53

score 11 · Answer 2 · edited Oct 26 '20 at 04:08

11

The solution for Python 3,

import html
html.unescape(text)

edited Oct 26 '20 at 04:08

TAbdiukov

1,185
3
12
25

answered Feb 13 '19 at 18:34

Abhishek

3,337
4
32
51

Change ' into normal character

2 Answers2