1

I a m trying to pull links from a website, the HTML of what I want look like the below:

<div class="default-2-3">
<h4>
  <a href="/en/news/esports/esports-editorial/na-lcs-week-8-tease-tsm">NA LCS Week 8 Tease: TSM</a>
 </h4>

My test code looks like: 

string mainURL = "http://na.leagueoflegends.com/en/news/";
HtmlAgilityPack.HtmlWeb web = new HtmlAgilityPack.HtmlWeb();
HtmlAgilityPack.HtmlDocument doc = web.Load(mainURL);

var findClass = doc.DocumentNode.Descendants("div")
                   .Where(d => d.Attributes.Contains("class") && 
                               d.Attributes["class"].Value.Contains("default-2-3"));
MessageBox.Show(findClass.ElementAt(1).ToString());

Currently the message box shows:

HtmlAgilityPack.htmlNode

I based my code off of this finding specific link from website, I am new to using HTMLAgilityPack beyond just copying the XPath.

For reference, the site I am trying to extract information is: http://na.leagueoflegends.com/en/news/

Community
  • 1
  • 1
lostknight
  • 109
  • 6

2 Answers2

1

You are close to the final step. Just a little more.

var findClass = doc.DocumentNode.Descendants("div").Where(d => d.Attributes.Contains("class") && d.Attributes["class"].Value.Contains("default-2-3")).Select(_ => _.Descendants("a").FirstOrDefault()?.Attributes["href"]);
Hung Cao
  • 3,130
  • 3
  • 20
  • 29
  • Hello hung Cao, I used the code however when i do MessageBox.Show(findClass.ElementAt(1).ToString()); I still get htmlagilitypack in message box. – lostknight Mar 17 '17 at 12:04
  • It's an array of HtmlAttribute. If you want to get the first item then `findClass.ElementAt(1).Value` – Hung Cao Mar 17 '17 at 17:21
0

Actually there are more than one div with the same class=default-2-3 You are trying to fetch the very first which you can get by doing this:

var href = doc.DocumentNode.SelectNodes(".//div[@class='default-2-3']//h4//a[@href]").Select(x=>x.Attributes["href"].Value);
M. Adeel Khalid
  • 1,786
  • 2
  • 21
  • 24