AJAX vs cURL for crawling

Asked May 17 '16 at 08:05

Active May 17 '16 at 08:05

Viewed 16 times

I trying to "get" a URL of www.gsmarena.com for scraping. The underlying HTTP GET request is working alright with PHP CURL code:

$curl = curl_init();
curl_setopt ($curl, CURLOPT_URL, "http://www.gsmarena.com/lg_nexus_5-5705.php");
curl_setopt($curl, CURLOPT_RETURNTRANSFER, 1);

$result = curl_exec ($curl);
curl_close ($curl);

But I don't want to use PHP CURL. I want to do the same thing using JQUERY AJAX following codepen I created:

http://codepen.io/amigoo/pen/qZGmqq?editors=1111

But I am getting this error:

asked May 17 '16 at 08:05

Faisal Ashfaq

2,545
4
28
41

What you want to do will be extremely unreliable to the point of not being achievable in JS due to the Same Origin Policy - see the question I marked as a duplicate for a full explanation of the issue and workarounds. I would strongly suggest you stick with using cURL. – Rory McCrossan May 17 '16 at 08:07
Any links where I can clarify the fact that I am getting Same Origin Policy in AJAX while not in cURL? – Faisal Ashfaq May 17 '16 at 08:09
Your error is making that clear already. – Rory McCrossan May 17 '16 at 08:10
So how does cURL bypass this fact? – Faisal Ashfaq May 17 '16 at 08:11
1

It's not that cURL bypasses it, it's that JS is blocked by security restrictions in place in all browsers. – Rory McCrossan May 17 '16 at 08:12
No problem, glad to help – Rory McCrossan May 17 '16 at 08:13

AJAX vs cURL for crawling

0 Answers0