I have a scraper made in python2 using requests and beautifulsoup. We do not want to use selenium. Now the website we are scraping has changed its some page. The page is now building the elements on the page using javascript. I want to scrape the page in which the source code is getting generated with javascript - how can this be done?
Asked
Active
Viewed 66 times
1
DisappointedByUnaccountableMod
- 6,656
- 4
- 18
- 22
Gulshan Kumar
- 74
- 8
-
Indeed, check [this](https://stackoverflow.com/a/66107893/11380795) example how to use Beautifulsoup with Selenium. – RJ Adriaansen Jun 04 '21 at 20:19
-
Please use Python3. https://pythonclock.org/ – OneCricketeer Jun 04 '21 at 20:20
-
@baduker sorry i forgot to mentioned that we are not allow to use selenium. – Gulshan Kumar Jun 04 '21 at 20:26
-
@GulshanKumar, well, that's too bad. :,( – baduker Jun 04 '21 at 20:55