Cannot load a specific URL with file_get_contents()

Question

I am scraping http://www.beautyinzone.net/.

I am using simple file_get_contents() to load this URL.

Its working perfectly on my localhost. But it does not work when I upload on my live server.

Warning: file_get_contents(http://www.beautyinzone.net/): failed to open stream: Connection timed out in script.php on line 36 page

If I open some other URL it works fine.

URL

I have tried with cURL as well but that shows empty page, returns nothing.

One thought came in my mind that maybe I am blocked, but it should not be like that that said website using my servers.

What possible issue can be preventing me loading that URL?

[cURL works for me](https://requestable.pieterhordijk.com/xVd7o) — PeeHaa, Feb 05 '16 at 21:51
Yeah it does on localhost as well ... but see .. I placed scraper here on my server ... it does not scrape http://www.coszi.com/crawl/beautyinzone.php — Umair Ayub, Feb 05 '16 at 21:59
I can't think of any other reason than the server being blocked. — Barmar, Feb 05 '16 at 22:22
@Barmar I cant think too ... its kind of weird situation ... — Umair Ayub, Feb 05 '16 at 22:24
Have you tried `stream_get_contents()` ? http://stackoverflow.com/questions/34834038/php-find-and-get-value-based-on-another-one-from-html-table-parsed-file/34835046#34835046 — Steve, Feb 06 '16 at 06:29

score 1 · Answer 1 · answered Feb 05 '16 at 22:07

1

Its working for me. Try to get the error by below code

if (!$content = file_get_contents("http://www.beautyinzone.net/")) {
    $error = error_get_last();
    echo $error['message'];
} else {
    echo "working fine";
}

answered Feb 05 '16 at 22:07

Ravinder Reddy

3,869
1
13
22

score 1 · Answer 2 · answered Feb 05 '16 at 22:09

1

Because the remote server is delaying to reply you've re received a http timeout error. it's just normal.

TCP sockets has timeout set and when this timeout is reached a timeout error is raised. Generally the timeout is 30 seconds (By default the default_socket_timeout php.ini setting is used).

Maybe you want set (increase) a custom timeout yourself:

<?php

$http_context = stream_context_create(array(
    'http' => array(
        'timeout' => 60.0 # 60 seconds
    )
));
$url = 'http://www.beautyinzone.net';
$content = file_get_contents($url, false, $http_context);

Via cURL just use:

curl_setopt($ch, CURLOPT_CONNECTTIMEOUT, 60);

answered Feb 05 '16 at 22:09

felipsmartins

13,269
4
48
56

tried it too ... getting same error ... and getting nothing returned from cURL – Umair Ayub Feb 05 '16 at 22:19
Well, have you been tested with other URLs? – felipsmartins Feb 05 '16 at 22:30
Yes, I have tested with some other URLs and those are loading fine – Umair Ayub Feb 05 '16 at 22:31
it looks like I am banned from there ... even I have never scraped that site using my servers :( – Umair Ayub Feb 05 '16 at 22:33
hmm how about set a `User-agent` header? – felipsmartins Feb 05 '16 at 22:35
I have done everything man :P I am scraping with user-agents with file_get_contents and cURL as welll ... but it does not work :( – Umair Ayub Feb 05 '16 at 22:37

score 0 · Answer 3 · edited May 23 '17 at 12:07

0

Try this cURL snippet

function retrieve_curl_info() {
     $ch = curl_init();
     curl_setopt_array($ch, array(
         CURLOPT_URL => 'http://www.beautyinzone.net/',
         CURLOPT_RETURNTRANSFER => true
     ));
     $output = curl_exec($ch);
     curl_close($ch);
     return $output
}

Also, check out this thread

edited May 23 '17 at 12:07

Community

1
1

answered Feb 05 '16 at 22:04

Amous

534
5
18

Cannot load a specific URL with file_get_contents()

3 Answers3

Linked