0

Can someone put a list of open source software of each of these components included in the question "Building a web search engine"?

That will save many people's time in the search for high quality open source components.

Component List:

  1. Crawler
  2. Parser
  3. Indexer
  4. Ranking Engine
  5. Front End
Community
  • 1
  • 1
Gabriel Chung
  • 1,527
  • 1
  • 18
  • 30

4 Answers4

1

For the Java world:

Parsers

Indexer

Ranking Engine

Front End

  • whatever lightweight MVC framework
Vladimir
  • 6,853
  • 2
  • 26
  • 25
1

Lucene is also available for .NET http://incubator.apache.org/lucene.net/

thijs
  • 3,445
  • 1
  • 27
  • 46
1

It looks like Apache Nutch does everything you need out of the box.

Kariem
  • 4,398
  • 3
  • 44
  • 73
Vladimir
  • 6,853
  • 2
  • 26
  • 25
1

Nutch + Lucene + Mapreduce/Apache is your solution.

Sumit Ghosh
  • 3,264
  • 4
  • 40
  • 59