Use local storage with beautiful soup

Asked Feb 18 '18 at 10:01

Active Feb 18 '18 at 10:01

Viewed 394 times

I need to crawl a website, which stores its cookies in the users local HTML5 storage. Is there a simple way to set that using beautiful soup?

asked Feb 18 '18 at 10:01

David Schumann

2

Yes there is a simple way. The page probably uses JavaScript to control the HTML5 storage so use a technology like Selenium, PyQt or Dryscrape which can handle rendering of JavaScript for examples see my answer to https://stackoverflow.com/questions/45259232/scraping-google-finance-beautifulsoup/45259523#45259523 – Dan-Dev Feb 18 '18 at 12:51

0 Answers0