urllib2.URLError:

Question

Basically ,I'm trying to use python's urllib2. I want to connect and fetch the data from a site. The problem is that I get the error

urllib2.URLError: <urlopen error Tunnel connection failed: 403 Tunnel or SSL Forbidden>

After repeating my experiments with this library , I found that the code I had written worked well with https:// sites but not with http:// sites. I read a few earlier questions on stack overflow suggesting to add the header User-Agent:Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.7) Gecko/2009021910 Firefox/3.0.7 (to spoof the header).

I did that but still it failed.

After that I read this urllib2.HTTPError: HTTP Error 403: Forbidden

I tried that as well but that didn't work.

Here's my code

import urllib2
url = "http://the_site_i_want_to_connect"
hdr = {'User-Agent':'Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.7) Gecko/2009021910 Firefox/3.0.7','Accept':'text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8'
req = urllib2.Request(url , headers=hdr)
p = urllib2.urlopen(req).read()
print p

PS: As I said , this works fine with https

Please help! Thanks in advance!

what site are you trying to access? I would also recommend using requests — Padraic Cunningham, Apr 20 '15 at 09:48
Tried a few sites with http:// for eg. http://www.nseindia.com — Punit Dhoot, Apr 20 '15 at 09:50
where are you running it from? FWIW I cannot replicate. try `import requests;requests.get(url)` if you have requests installed. — Padraic Cunningham, Apr 20 '15 at 09:55
yep , but it shows the same problem. Basically , I need help to understand the reason behind the error. PS: the error message `requests.exceptions.ProxyError: Cannot connect to proxy. Socket error: Tunnel connection failed: 403 Tunnel or SSL Forbidden.` — Punit Dhoot, Apr 21 '15 at 13:56
Have you tried setting `proxies = { "http": "http://10.10.1.10:3128", "https": "http://10.10.1.10:1080", }` and `requests.get(url,proxies=proxies)`, replacing with appropriate values? — Padraic Cunningham, Apr 21 '15 at 20:15
yes , proxy was the real culrprit! Thanks for the help Padriac! (Also tried adding proxy settings to urllib2. That worked as well!) — Punit Dhoot, Apr 22 '15 at 04:51
Not sure really, must have something to do with how the proxy is set up — Padraic Cunningham, Apr 23 '15 at 20:29
@PadraicCunningham please consider adding as answer. I came across this problem and almost miss your answer — ealfonso, Jun 15 '16 at 06:38

score 4 · Answer 1 · answered Apr 29 '15 at 09:14

4

This error looks like issue with your proxy settings please refer this blog

answered Apr 29 '15 at 09:14

Krishna

198
2
2
12

urllib2.URLError:

1 Answers1