How to grab data off a website

Question

I am building a database of images and would like to automate the process. I am somewhat familiar with HTML, and my core program is built in C#. What would be a good library to use that could help me download a page as HTML, and grab the URL links on the page to the desired image? I am familiar with how to download images from URL already, so that does not need to be addressed.

(Library or other language. The database building and the program do not need to be combined.)

Please research before asking questions. – Jeremy Thompson Mar 08 '17 at 07:01 — Jeremy Thompson, Mar 08 '17 at 07:01

score 0 · Answer 1 · edited May 23 '17 at 10:30

0

You wanted to build a crawler or website spider which will grab the stuff from websites. There is a parsing library called HtmlAgilityPack which will help you to do that very easily. This post will tell you how to use this library.

Hope it helps!

edited May 23 '17 at 10:30

Community

1
1

answered Mar 08 '17 at 04:15

M. Adeel Khalid

1,786
2
21
24

How to grab data off a website

1 Answers1