Questions tagged [incapsula]

Incapsula Inc. is a cloud-based application delivery platform. It uses a global content delivery network to provide website security, DDoS protection, load balancing and failover services to clients.

Incapsula Inc. is a cloud-based application delivery platform. It uses a global content delivery network to provide website security, DDoS protection, load balancing and failover services to clients.

35 questions
20
votes
2 answers

How to bypass Incapsula with Python

I use Scrapy and I try to scrape this site that uses Incapsula I had already asked a Question about this issue …
parik
  • 2,313
  • 12
  • 39
  • 67
13
votes
3 answers

POST request works in Postman, but not in Python Requests (200 response with robot detection)

I have a POST request that works perfectly with both Postman an cURL (it returns a JSON blob of data). However, when I perform the exact same request with Python's Requests library, I get a 200 success response, but instead of my JSON blob, I get…
woodenstick
  • 143
  • 1
  • 1
  • 6
9
votes
4 answers

How Incapsula works and how to beat it

Incapsula is a web application delivery platform that can be used to prevent scraping. I am working in Python and Scrapy and I found this, but it seems to be out-of-date and not working with current Incapsula. I tested the Scrapy middleware with my…
fpghost
  • 2,834
  • 4
  • 32
  • 61
8
votes
4 answers

Cloudflare or Incapsula CDN without changing DNS

I'm looking for a low cost/free CDN that can serve my static files. (I will serve dynamic files from my own server) From the plans it seems like free plan includes…
trante
  • 33,518
  • 47
  • 192
  • 272
8
votes
1 answer

Android http request blocked by incapsula

In my app i have been using DefaultHttpClient to send HttpRequest with a user agent (to get full site) to a news website. It seems recently the website started using Incapsula, and i get this now:
user1912383
  • 359
  • 2
  • 6
  • 16
5
votes
2 answers

Do services like Cloudflare and Incapsula actually improve the performance of websites hosted on Windows Azure?

I'm running an image-heavy website hosted on Windows Azure. Back-end performance is great but response times for image thumbnails, which make the bulk of page sizes, are quite volatile. I'm using the Azure CDN for serving all images but their…
tishon
  • 650
  • 6
  • 14
5
votes
2 answers

With Incapsula, Application Insights Availability failing with The server committed a protocol violation

I'm trying to setup an availability test for one of my web app using URL ping test. The problem is it keeps failing with error below. The site is publicly available and when I just use the IP it get resolved and directed to the correct url but with…
CKelly
  • 71
  • 5
4
votes
1 answer

Python - Extract information from dataframe (JSON)

I'm a begginer and it's been a long time I didn't code anything :-) I'm using requests library to retrieve JSON data from the Incapsula(Cloud web security service) API to get some stats about a website. What I want in the end is to write the "type…
3
votes
3 answers

Terraform Incapsula provider fails to create custom certificate resource

We are trying to use Terraform Incapsula privider to manage Imperva site and custom certificate resources. We are able to create Imperva site resources but certificate resource creation fails. Our use-case is to get the certificate from Azure…
2
votes
2 answers

Is memcache(d) necessary when using Cloudflare/Incapsula

If you need caching in your website to make database use lower, do you have to do it using memcache or memcached (in PHP, for example) or can you achieve this by using professional services like CloudFlare, Incapsula or others like that do some…
federico-t
  • 12,014
  • 19
  • 67
  • 111
2
votes
1 answer

Trestle Request unsuccessful. Incapsula incident WebApi error

I'm working with Trestle which is real estate MLS service to get property data etc. I have followed their WebApi docs but I'm getting this error whenever I hit their api it looks like their server thinks that request is from some BOT. Even they…
Zayn
  • 741
  • 1
  • 5
  • 22
2
votes
1 answer

Incapsula Rate Limit Per Second

I'm looking at the rate limiting on Incapsula, which limits requests etc. based on per minute. Rate >= {api-rate;4} Is there a way to rate limit based on per second? So if an ip exceeds 1 request per second, then block it. Cheers
2
votes
1 answer

HttpClient - Different content returned than browser

I'm trying to make a request to kicksusa.com. If I make the request from any browser, I get the full expected HTML, however, I cannot seem to simulate the request in a way that returns the same HTML, instead I get a 'Request unsuccessful.'…
Dave Bish
  • 19,263
  • 7
  • 46
  • 63
1
vote
0 answers

Is it possible to generate cookie which seems to be generated by js file - scraping problem

I am trying to scrape a website which seems to generate cookies from js somehow, therefore I can not automate scraping. Any help is really appreciated. I am checking cookies of Firefox with SQLLite, and I see 5 cookies. But when I check in Firefox…
Jake Green
  • 11
  • 2
1
vote
0 answers

Problem via calling REST API Magento 2 from Google App Script - ROBOTS Exception

Can we do something like this using Google App Script? -> Pushing orders into magento 2 using REST API, order will be fetched by Google Sheet. -> When I try to do it gives
Nyutkarsh
  • 11
  • 1
1
2 3