0

I want to download some images (<10000) from a website.

I can't directly use the following python to directly download since the website requires username/password, it will give a 'HTTP Error 401: Unauthorized' error.

f = open(output_path, 'wb')
f.write(request.urlopen(full_image_url).read())
f.close()

So my current work around is to

  1. log in to the website in Chrome - Easily Done
  2. use python to parse (I manually copied the page source) and open lots of image links in chrome using webbrowser.get(chrome_path).open(full_image_url) - This is Done
  3. save the image from browser to local hard drive.

For step 3, I can manually right click each chrome tab to 'save image as'. But is there an automatic way to do so?

Any suggestion, help link, or other work around solution would be appreciated.

Tianyun Ling
  • 1,045
  • 1
  • 9
  • 24

1 Answers1

-2

Have you tried logging into the site using python? Take a look at this: How can I login to a website with Python?

Matt Salzman
  • 265
  • 2
  • 13