5

I would like to setup the crawler to crawl a website, let say blog, and fetch me only the links in the website and paste the links inside a text file. Can you guide me step by step for setup the crawler? I am using Eclipse.

tshepang
  • 12,111
  • 21
  • 91
  • 136
Wai Loon II
  • 259
  • 3
  • 7
  • 19

1 Answers1

0

Jsoup will do everything you need wrt html parsing. Jsoup is a java api for handling html source code. You can get

  1. Table, with which you can parse each and every row or column.
  2. List of all the links and source imports to that html(imports like css and js files).
  3. Data of particular tag.

and more.

For your purpose, here is the example code.

Hope this will help you.

Ahamed
  • 39,245
  • 13
  • 40
  • 68