My aim is to extract the html from all the links in the first page after entering the google search term. I work behind a proxy so this is my approach.
1.I first used mechanize to enter the search term in the form , ive set the proxies and robots correctly.
2.After extracting the links , Ive used an opener using urllib2.ProxyHandler globally , to open the urls individually.
However this gives me this error. Not able to figure it out.
urlopen error [Errno 8] _ssl.c:504: EOF occurred in violation of protocol