is there a way to scrape a JavaScript page without selenium in python

Question

is there a way to scrape JS-rendered web page with python beautifulsoup or lxml without selenium?

thanx

Does this help? : https://stackoverflow.com/questions/8049520/web-scraping-javascript-page-with-python — Grayrigel, Sep 29 '20 at 12:08

score -1 · Answer 1 · answered Sep 29 '20 at 12:17

-1

you can use requests_html module as alternative, it is pretty simple

from bs4 import BeautifulSoup
import requests

resp = requests.get("https://stackexchange.com/sites")

html = resp.content
soup = BeautifulSoup(html)

option_tags = soup.find_all("option")

in case you want to get deeper into it, just google the module

answered Sep 29 '20 at 12:17

Moncif Mo

9
8

4

Won't help with a Javascript-rendered page. – AKX Sep 29 '20 at 12:21

is there a way to scrape a JavaScript page without selenium in python

1 Answers1