1

Hi I am trying to crawl a website, specifically www.cvedetails.com and all the CVEs and after about 600 CVEs I got this error:

Maximum execution time of 30 seconds exceeded in phar:///root/PHP/VULDRONE/goutte.phar/vendor/symfony/dom-crawler/Symfony/Component/DomCrawler/Crawler.php on line 173

I have changed the max_execution_time value in the php.ini to 900 seconds but apparently it doesn't work fine.

I am using also a sleep after X requests but no success, have tried to change the user-agent and the same.

I have no idea what can I do not for being blocked from the crawling.

Thank you in advance

aDoN
  • 1,877
  • 4
  • 39
  • 55
  • 1
    try this function at the beginning of your php file set_time_limit ( int $seconds ) ,it will definitely work !! – kishan May 28 '15 at 11:26
  • possible duplicate of [Fatal error: Maximum execution time of 30 seconds exceeded](http://stackoverflow.com/questions/5164930/fatal-error-maximum-execution-time-of-30-seconds-exceeded) – Luís Cruz May 28 '15 at 11:55
  • It worked, solved thank you very much – aDoN May 29 '15 at 07:53

0 Answers0