Parsing HTML String

Question

Is there a way to parse HTML string in .Net code behind like DOM parsing...

i.e. GetElementByTagName("abc").GetElementByTagName("tag")

I've this code chunk...

private void LoadProfilePage()
{        
    string sURL;
    sURL = "http://www.abcd1234.com/abcd1234";

    WebRequest wrGETURL;
    wrGETURL = WebRequest.Create(sURL);

    //WebProxy myProxy = new WebProxy("myproxy",80);
    //myProxy.BypassProxyOnLocal = true;

    //wrGETURL.Proxy = WebProxy.GetDefaultProxy();

    Stream objStream;
    objStream = wrGETURL.GetResponse().GetResponseStream();

    if (objStream != null)
    {
        StreamReader objReader = new StreamReader(objStream);

        string sLine = objReader.ReadToEnd();

        if (String.IsNullOrEmpty(sLine) == false)
        {
            ....                   
        }
    }
}

if it is valid XHTML perhaps you can load it in `System.Xml.XDocument` — Bazzz, Feb 24 '11 at 13:39

score 11 · Accepted Answer · edited Jun 06 '17 at 18:54

11

You can use the excellent HTML Agility Pack.

This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you actually don't HAVE to understand XPATH nor XSLT to use it, don't worry...). It is a .NET code library that allows you to parse "out of the web" HTML files. The parser is very tolerant with "real world" malformed HTML. The object model is very similar to what proposes System.Xml, but for HTML documents (or streams).

edited Jun 06 '17 at 18:54

answered Feb 24 '11 at 13:39

Oded

489,969
99
883
1,009

dangit oded - I just posted this same thing only I'm slow and your a speed deamon! :) +1 from me. – phillip Feb 24 '11 at 13:42
@Downvoter - care to comment? – Oded Aug 09 '12 at 08:32

score 10 · Answer 2 · edited Oct 16 '19 at 11:36

10

Take a look at using the Html Agility Pack

Example of its use:

 HtmlDocument doc = new HtmlDocument();
 doc.Load("file.htm");
 foreach(HtmlNode link in doc.DocumentNode.SelectNodes("//a[@href]")
 {
    HtmlAttribute att = link["href"];
    att.Value = FixLink(att);
 }

edited Oct 16 '19 at 11:36

Hossein Hadi

1,229
15
20

answered Feb 24 '11 at 13:39

Mark Coleman

40,542
9
81
101

1

xpath string should be "//a[@href]" ? – Joachim Chapman Sep 15 '16 at 08:58

Kobi · Answer 3 · 2021-06-09T20:19:05.783

3

You can use the HTML Agility Pack and a little XPath (it can even download the document for you):

HtmlWeb web = new HtmlWeb();
HtmlDocument doc = web.Load("http://www.abcd1234.com/abcd1234");
HtmlNodeCollection tags = doc.DocumentNode.SelectNodes("//abc//tag");

edited Jun 09 '21 at 20:19

answered Feb 24 '11 at 13:40

Kobi

135,331
41
252
292

That link is outdated. They moved to http://html-agility-pack.net/?z=codeplex – William Herrmann Jun 09 '21 at 18:40

score 2 · Answer 4 · answered Feb 24 '11 at 13:41

2

I've used the HTML Agility Pack to do this exact thing and I think it's great. It has been really helpful to me.

answered Feb 24 '11 at 13:41

phillip

2,618
19
22

That link is outdated. They moved to http://html-agility-pack.net/?z=codeplex – William Herrmann Jun 09 '21 at 18:39

score 0 · Answer 5 · edited May 23 '17 at 11:33

0

maybe this can help: What is the best way to parse html in C#?

edited May 23 '17 at 11:33

Community

1
1

answered Feb 24 '11 at 13:40

alexl

6,841
3
24
29

Parsing HTML String

5 Answers5

Linked