Easy way to get values from a website in C#

Question

I have the following problem! I want to get the shipping data from a website. They have the following structure:

enter image description here

The problem here is that there are multiple divs and in the divs there are more divs and tables. Due to the fact i am a total noob with regular expressions, i wanted to know if there is any easier solution for grabbing the data.

Oh [you don't want to use regex for HTML](http://stackoverflow.com/a/1732454/1864167). Instead use [HtmlAgilityPack](http://htmlagilitypack.codeplex.com/). — Jeroen Vannevel, Dec 28 '13 at 23:20
Some people, when confronted with a problem, think "I know, I'll use regular expressions." Now they have two problems. — Ahmet Kakıcı, Dec 28 '13 at 23:22
@JohnSaunders: for proper attribution, see [here](http://regex.info/blog/2006-09-15/247). — Jeroen Vannevel, Dec 28 '13 at 23:23
possible duplicate of [RegEx match open tags except XHTML self-contained tags](http://stackoverflow.com/questions/1732348/regex-match-open-tags-except-xhtml-self-contained-tags) — John Saunders, Dec 28 '13 at 23:23

score 4 · Accepted Answer · edited Nov 28 '17 at 02:43

I recommend walking the DOM using a framework like HTML Agility Pack rather than using regular expressions. Read here for more information: http://html-agility-pack.net

More specifically, when using HTML Agility Pack, as an alternative to manual DOM-traversal, you can use XPaths to define the elements you want to get the data from. You can write pretty resiliant XPaths that will identify the correct elements even when they're moved-around or formatted differently (e.g. attributes in a different order). Think of XPaths as being like CSS selectors but more powerful and with a steeper learning-curve.

As for regex, you have been warned.

If you'd rather use CSS selectors, you can always use CsQuery: https://github.com/jamietre/CsQuery — Arithmomaniac, Dec 29 '13 at 01:41

Easy way to get values from a website in C#

1 Answers1