0

I need to create a script that goes through a few thousand websites and fetch data such as headers, ips, response code and also some other stuff for fingerprinting (college schoolwork).

How does multithreading or multiple http requests work if the script needs to go through all the thousands of website, this would take ages and ages.

Can anyone share their knowledge?

Thanks

David Garcia
  • 3,056
  • 18
  • 55
  • 90
  • Multithreading kinda requires skills. – sybear Feb 20 '13 at 12:20
  • 1
    http://stackoverflow.com/questions/70855/how-can-one-use-multi-threading-in-php-applications – sybear Feb 20 '13 at 12:23
  • You're question is vague and/or badly worded. 'How does multithreading or multiple http requests work....' Do you mean how should go abou implementing it or do you realyl want an explanation of something which should be covered within the first week of any course on computers? – symcbean Feb 20 '13 at 12:26
  • Is it possible yes/no does it require alot of skill. thats all, no need to get out of topic – David Garcia Feb 20 '13 at 12:30
  • 1
    Why do you need multiple threads for it ? You can send HTTP HEAD requests which are faster than GET , despite your script going over 'thousands' of websites I don't see how this takes ages! – Joel Blum Feb 20 '13 at 12:39

0 Answers0