While using pandas got error urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed

Question

This is my code in python3 :

import pandas as pd

tables = pd.read_html("http://http.com/")

print(tables)

And I got this error :

Traceback (most recent call last):
  File "/usr/local/Cellar/python3/3.6.1/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 1318, in do_open
    encode_chunked=req.has_header('Transfer-encoding'))
  File "/usr/local/Cellar/python3/3.6.1/Frameworks/Python.framework/Versions/3.6/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/Cellar/python3/3.6.1/Frameworks/Python.framework/Versions/3.6/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/local/Cellar/python3/3.6.1/Frameworks/Python.framework/Versions/3.6/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/Cellar/python3/3.6.1/Frameworks/Python.framework/Versions/3.6/lib/python3.6/http/client.py", line 1026, in _send_output
    self.send(msg)
  File "/usr/local/Cellar/python3/3.6.1/Frameworks/Python.framework/Versions/3.6/lib/python3.6/http/client.py", line 964, in send
    self.connect()
  File "/usr/local/Cellar/python3/3.6.1/Frameworks/Python.framework/Versions/3.6/lib/python3.6/http/client.py", line 1400, in connect
    server_hostname=server_hostname)
  File "/usr/local/Cellar/python3/3.6.1/Frameworks/Python.framework/Versions/3.6/lib/python3.6/ssl.py", line 401, in wrap_socket
    _context=self, _session=session)
  File "/usr/local/Cellar/python3/3.6.1/Frameworks/Python.framework/Versions/3.6/lib/python3.6/ssl.py", line 808, in __init__
    self.do_handshake()
  File "/usr/local/Cellar/python3/3.6.1/Frameworks/Python.framework/Versions/3.6/lib/python3.6/ssl.py", line 1061, in do_handshake
    self._sslobj.do_handshake()
  File "/usr/local/Cellar/python3/3.6.1/Frameworks/Python.framework/Versions/3.6/lib/python3.6/ssl.py", line 683, in do_handshake
    self._sslobj.do_handshake()
ssl.SSLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:749)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/local/lib/python3.6/site-packages/pandas/io/html.py", line 906, in read_html
    keep_default_na=keep_default_na)
  File "/usr/local/lib/python3.6/site-packages/pandas/io/html.py", line 743, in _parse
    raise_with_traceback(retained)
  File "/usr/local/lib/python3.6/site-packages/pandas/compat/__init__.py", line 344, in raise_with_traceback
    raise exc.with_traceback(traceback)
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:749)>

This have been working very well till now, but I have this problem on this particular website. Also, I am new in this and don't know much about SSL Certificate, I searched it on google and still do not have much knowledge about it.

score 60 · Answer 1 · answered May 21 '19 at 03:16

60

use -

import ssl

ssl._create_default_https_context = ssl._create_unverified_context

answered May 21 '19 at 03:16

markroxor

5,928
2
34
43

10

What is this black magic? It fixed my problem too. – O.rka Dec 14 '20 at 19:31
This worked for me on windows, conda python 3.9.7. Pandas read_csv() was failing on a url and the above fixed it. – BenCaldwell Oct 15 '21 at 05:52
changed the error to `HTTPError: HTTP Error 403: Errodeconfiguracaodobrowser` – neves Nov 23 '21 at 19:41
how can i use ssl then to bypass verification? – swordlordswamplord Dec 27 '21 at 04:50
5

good quick fix. It would have been better if there was some explanation – Green Jun 05 '22 at 07:31

score 20 · Answer 2 · answered Jun 20 '17 at 12:47

20

For MAC
Click Applications => Python then double-click Install Certificates.command.

answered Jun 20 '17 at 12:47

Mayank Khullar

441
3
3

3

But there is no Python in Applications...can you tell where exactly in Applications. I assumed Finder => Applications. – as2d3 Jun 20 '17 at 14:27
See answer here https://stackoverflow.com/a/42098127/778533 and here https://stackoverflow.com/a/41692664/778533. – tommy.carstensen Feb 16 '18 at 01:06
very simple solution, specially after having found so many complex alternatives. Thank you very much! – 42piratas Jul 31 '20 at 17:07
for students answer by @markroxor is simple BUT for real life usage Mayank's answer IS THE RIGHT WAY – Srinath Ganesh Jan 24 '21 at 05:58
This should be the verified answer here. Thank you! – Adam Stevenson Feb 07 '21 at 18:41

While using pandas got error urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed

2 Answers2

Linked