To get FB to scrape data from a URL, I'm calling https://graph.facebook.com and posting id=url_encoded_url_to_scrape&scrape=true
as post data via the PHP curl extension. I have a 1 second sleep between calls and have never made more than at most about 35 calls in a 600 second period (and usually it's more like just a few calls). However, I'm getting rate limited with the following message:
{
"error":{
"message":"(#4) Application request limit reached",
"type":"OAuthException",
"is_transient":true,
"code":4
}
}
From reading the following SO posts, I think I'm well within the rate limit (600 calls in 600 seconds per IP), and there's nothing else running on this VM so it's not like another site is causing the limit to be hit. Facebook api: (#4) Application request limit reached and What's the Facebook's Graph API call limit?
Does anyone have any tips on how to solve this or what I'm doing wrong? I had it work for about 20 calls yesterday, but other than that, I think I've always gotten the rate limiting message when working on developing this, even when starting out.