HTTPS connection Python

Question

I am trying to verify the that target exposes a https web service. I have code to connect via HTTP but I am not sure how to connect via HTTPS. I have read you use SSL but I have also read that it did not support certificate errors. The code I have got is from the python docs:

import httplib
conn = httplib.HTTPConnection("www.python.org")
conn.request("GET", "/index.html")
r1 = conn.getresponse()
print r1.status, r1.reason

Does anyone know how to connect to HTTPS?

I already tried the HTTPSConenction but it responds with an error code claiming httplib does not have attribute HTTPSConnection. I also don't have socket.ssl available.

I have installed Python 2.6.4 and I don't think it has SSL support compiled into it. Is there a way to integrate this suppot into the newer python without having to install it again.

I have installed OpenSSL and pyOpenSsl and I have tried the below code from one of the answers:

import urllib2
from OpenSSL import SSL
try: 
    response = urllib2.urlopen('https://example.com')  
    print 'response headers: "%s"' % response.info() 
except IOError, e: 
    if hasattr(e, 'code'): # HTTPError 
        print 'http error code: ', e.code 
    elif hasattr(e, 'reason'): # URLError 
        print "can't connect, reason: ", e.reason 
    else: 
        raise

I have got an error:

    Traceback (most recent call last):
  File "<stdin>", line 2, in <module>
  File "/home/build/workspace/downloads/Python-2.6.4/Lib/urllib.py", line 87, in urlopen
    return opener.open(url)
  File "/home/build/workspace/downloads/Python-2.6.4/Lib/urllib.py", line 203, in open
    return self.open_unknown(fullurl, data)
  File "/home/build/workspace/downloads/Python-2.6.4/Lib/urllib.py", line 215, in open_unknown
    raise IOError, ('url error', 'unknown url type', type)
IOError: [Errno url error] unknown url type: 'https'

Does anyone know how to get this working?

-- UPDATE

I have found out what the problem was, the Python version I was using did not have support for SSL. I have found this solution currently at: http://www.webtop.com.au/compiling-python-with-ssl-support.

The code will now work after this solution which is very good. When I import ssl and HTTPSConnection I know don't get an error.

Thanks for the help all.

score 69 · Accepted Answer · edited Oct 27 '17 at 13:28

69

Python 2.x: docs.python.org/2/library/httplib.html:

Note: HTTPS support is only available if the socket module was compiled with SSL support.

Python 3.x: docs.python.org/3/library/http.client.html:

Note HTTPS support is only available if Python was compiled with SSL support (through the ssl module).

#!/usr/bin/env python

import httplib
c = httplib.HTTPSConnection("ccc.de")
c.request("GET", "/")
response = c.getresponse()
print response.status, response.reason
data = response.read()
print data
# => 
# 200 OK
# <!DOCTYPE html ....

To verify if SSL is enabled, try:

>>> import socket
>>> socket.ssl
<function ssl at 0x4038b0>

edited Oct 27 '17 at 13:28

z80crew

1,150
1
11
20

answered Jan 27 '10 at 11:33

miku

181,842
47
306
310

11

Note that this doesn't verify the remote certificate, therefore you don't really get security this way (as you don't really know which server you're really talking to). – Bruno Sep 13 '10 at 23:29
Wrong url in tequest – stark Apr 18 '19 at 11:37
how to check IP with this response ? – mahshid.r Apr 25 '19 at 08:24

score 14 · Answer 2 · edited May 23 '17 at 12:25

To check for ssl support in Python 2.6+:

try:
    import ssl
except ImportError:
    print "error: no ssl support"

To connect via https:

import urllib2

try:
    response = urllib2.urlopen('https://example.com') 
    print 'response headers: "%s"' % response.info()
except IOError, e:
    if hasattr(e, 'code'): # HTTPError
        print 'http error code: ', e.code
    elif hasattr(e, 'reason'): # URLError
        print "can't connect, reason: ", e.reason
    else:
        raise

score 11 · Answer 3 · edited Nov 08 '15 at 07:39

11

import requests
r = requests.get("https://stackoverflow.com") 
data = r.content  # Content of response

print r.status_code  # Status code of response
print data

edited Nov 08 '15 at 07:39

tsec

7
3

answered May 22 '15 at 14:50

1

@notilas, this code does work. If you just print `r`, you will get a string version of the response object itself rather than the content of the response, which is what you typed above, ``. That is simply saying that the request was successful (200 is the HTTP code for success). Try looking at `r.content` or `r.text` (or `r.json()` if you're content is JSON) to get the actual result of the request. – bjg222 Mar 27 '19 at 16:43
1

@bjg222 Thanks for kind explanation. – notilas Mar 27 '19 at 20:40

score 9 · Answer 4 · answered Jan 27 '10 at 11:23

9

using

class httplib.HTTPSConnection

http://docs.python.org/library/httplib.html#httplib.HTTPSConnection

answered Jan 27 '10 at 11:23

bluszcz

4,054
4
33
52

gogasca · Answer 5 · 2019-12-01T04:59:13.040

If using httplib.HTTPSConnection:

Please take a look at:

Changed in version 2.7.9:

This class now performs all the necessary certificate and hostname checks by default. To revert to the previous, unverified, behavior ssl._create_unverified_context() can be passed to the context parameter. You can use:

if hasattr(ssl, '_create_unverified_context'):
  ssl._create_default_https_context = ssl._create_unverified_context

score 5 · Answer 6 · answered Jan 27 '10 at 11:27

Why haven't you tried httplib.HTTPSConnection? It doesn't do SSL validation but this isn't required to connect over https. Your code works fine with https connection:

>>> import httplib
>>> conn = httplib.HTTPSConnection("mail.google.com")
>>> conn.request("GET", "/")
>>> r1 = conn.getresponse()
>>> print r1.status, r1.reason
200 OK

Tendayi Mawushe · Answer 7 · 2010-01-27T12:01:18.913

4

Assuming SSL support is enabled for the socket module.

connection1 = httplib.HTTPSConnection('www.somesecuresite.com')

edited Jan 27 '10 at 12:01

answered Jan 27 '10 at 11:55

Tendayi Mawushe

25,562
6
51
57

score -1 · Answer 8 · edited Nov 14 '16 at 20:17

-1

I had some code that was failing with an HTTPConnection (MOVED_PERMANENTLY error), but as soon as I switched to HTTPS it worked perfectly again with no other changes needed. That's a very simple fix!

edited Nov 14 '16 at 20:17

mpaskov

1,234
2
11
21

answered Nov 14 '16 at 19:10

user3014653

735
2
8
13

How is this different compared to other answers? Maybe try to elaborate a bit more. – mpaskov Nov 14 '16 at 19:35

HTTPS connection Python

8 Answers8

Linked