How to Download PDFs from Scraped Links [Python]?
After working on this I was stuck with the following issues Is it possible to download if my college portal has a login page and if yes what should be added to this... Can this be fixed
Asked
Active
Viewed 51 times
0
-
You can try logging in using requests, selenium or something similar – Pythonista Jul 22 '16 at 16:57
1 Answers
0
It is possible, but you should use something like Selenium. This library will allow you to run a browser and navigate through coding, just like you would. You will be able to fill out the username and password forms and click the submit button, and log in to the website. Check out this guide about web scraping and the Selenium library
If you find Selenium too slow, a faster alternative is Mechanize. The problem is that it does not process Javascript, and this will break some webpages.
Community
- 1
- 1
Fernando Irarrázaval G
- 903
- 6
- 18