1

I am trying to scrape a website which seems to generate cookies from js somehow, therefore I can not automate scraping. Any help is really appreciated.

I am checking cookies of Firefox with SQLLite, and I see 5 cookies. But when I check in Firefox Developer Tools Inspect I see that 7 cookies are used in each request.

It turns out these 2 cookies are very important and the website doesn't respond to my Python scraper unless I provide all of the cookies.

These cookies are created by Incapsula - a security third party application, and both of them are incap_ses.

My question is? Where I can access those cookies or is it possible to generate them on my own? Should I keep digging js files to find some function that generates those cookies, or it is meaningless?

Jake Green
  • 11
  • 2

0 Answers0