PHP - file_get_contents failed to open stream: Connection closed?

Question

Implementation (url is a valid and running url):

$html = file_get_contents($url);

I am programming a crawler in php and sometimes file_get_contents returns the following error:

failed to open stream: Connection closed

This doesn't always occur, so when it does it confuses me a tad. Would this be an error on my side or the website I am crawling side? Either way is it sensible to keep retrying until an error doesn't occur or is there a better way?

You should have to check this link http://stackoverflow.com/questions/25368057/file-get-contentsurl-failed-to-open-stream — Nipun Tyagi, Jun 17 '15 at 11:26
I had a look around and that is a different error i'm afraid :( — Grushton94, Jun 17 '15 at 11:33

score 1 · Answer 1 · answered Jun 17 '15 at 11:26

1

You need to create a stream for this

Read stream_context_create

<?php
// Create a stream 
$opts = array(
                'http'=>array(
                 'method'=>"GET",
                'header'=>"Accept-language: en\r\n" .
                "Cookie: foo=bar\r\n"
             )
       );

 $context = stream_context_create($opts);

 // Open the file using the HTTP headers set above
  $file = file_get_contents($url, false, $context);
?>

answered Jun 17 '15 at 11:26

Meenesh Jain

2,532
2
19
29

I think this might help – Meenesh Jain Jun 17 '15 at 11:26
why do you think that will help? – Jasonw Jan 20 '20 at 09:13

score 1 · Accepted Answer · answered Jun 17 '15 at 11:29

1

Try this way...

function url_get_contents ($Url) {
    if (!function_exists('curl_init')){ 
        die('CURL is not installed!');
    }
    $ch = curl_init();
    curl_setopt($ch, CURLOPT_URL, $Url);
    curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
    $output = curl_exec($ch);
    curl_close($ch);
    return $output;
}

answered Jun 17 '15 at 11:29

Gnanadurai A

278
1
2
15

Thanks, I should have used cURL earlier. I was using Google app engine so wasn't sure it was available. all warnings have stopped for the time being at least. – Grushton94 Jun 17 '15 at 11:58

score 0 · Answer 3 · answered Jun 17 '15 at 11:28

0

Use php CURL library http://php.net/manual/en/book.curl.php for better management of client requests.. file_get_contents() functions fails due to security restrictions on host server

answered Jun 17 '15 at 11:28

Innam Hunzai

442
1
6
17

PHP - file_get_contents failed to open stream: Connection closed?

3 Answers3