Python Requests-HTML() unable to load css

Question

I'd like to download the css of a page and achieve the same appearance as in the browser. The problem is that the scraped result looks different.

For example, I want to download the landing page of google.

That's the code I have used:

import requests
from requests_html import HTMLSession

session = HTMLSession()

r = session.get('https://www.google.com')

r.html.render()

file = open("start.html", "w")
file.write(r.text)
file.close()

Does this answer your question? [How can I download full webpage by a Python program?](https://stackoverflow.com/questions/31205497/how-can-i-download-full-webpage-by-a-python-program) — glotchimo, Feb 01 '20 at 23:03

score 0 · Answer 1 · answered Feb 02 '20 at 00:24

The css is usually in a tag.

Try to parse the page in bs4

from bs4 import BeautifulSoup as BS
from requests_html import HTMLSession

session = HTMLSession()

r = session.get('https://www.google.com')

r.html.render()

soup=BS(r.text)

css = [link.get("href") for link in soup.findAll("link") if "stylesheet" in link.get("rel")]

Now css should be a list of links to the css used

Python Requests-HTML() unable to load css

1 Answers1