how to scrape contents of another we site using web scraping

Question

I'm getting this below value while scraping , i just need only 28 from this string

<td colspan="2" class="invalid">
  28 Errors, 3 warning(s)


</td>

my code

string strurl = "http://validator.w3.org/check?uri=" + url + "";
StreamReader stream = objm.URLServerRequest(strurl)
 string myResponse = stream.ReadToEnd();
MatchCollection AltTag = Regex.Matches(myResponse, @"(?si)<td\b[^<]*?>(.*?)</td>", RegexOptions.IgnoreCase | RegexOptions.Multiline);

Also, be sure to read http://stackoverflow.com/a/1732454/76337 — John Saunders, May 14 '15 at 05:03
i just want inner content only of td , or i want to do substring and extract the errors value i.e 28 . @JohnSaunders — , May 14 '15 at 05:20

Wiktor Stribiżew · Answer 1 · 2015-05-17T18:59:18.383

0

In order to get the contents of TD node, you need to use td in the regex:

var myResponse = "<td class=\"att\">Text</td><td class=\"att\">Text2</td>";
var TdTag = Regex.Matches(myResponse, @"(?si)<td\b[^<]*?>(.*?)</td>");
var results = TdTag.Cast<Match>().Select(m => m.Groups[1].Value).ToList();

This should return all TD contents as a string list.

enter image description here

EDIT:

To capture 28 in the new input, you need to use a modified regex:

var myResponse = @"<td colspan=""2"" class=""invalid"">
28 Errors, 3 warning(s)


</td>";
var TdTag = Regex.Matches(myResponse, @"(?s)<td[^<]*>\s*(\d+)[^<]*</td>");
var result = TdTag[0].Groups[1].Value;
Console.WriteLine(result);

Output of the demo program:

edited May 17 '15 at 18:59

answered May 13 '15 at 13:49

Wiktor Stribiżew

607,720
39
448
563

Does the answer solve your problem? Please let me know if you need more assistance. – Wiktor Stribiżew May 13 '15 at 16:26
yes in this morning i tried , its worked for me , but i got 28 Errors, 3 warning(s) how to get only 28 from this string data? – May 14 '15 at 04:52
You can use `var myResponse = "\s*(\d+)[^<]*";` – Wiktor Stribiżew May 14 '15 at 05:22
im getting same value i just want inner data of td . not everything with td. or else can u tel me substring method to get my desired error value ?? @stribizhev – May 14 '15 at 05:27
Did you use MY code? The number is inside a capturing group, you need to access it using Groups [1].Value. to get the whole td contents just use var myResponse = "([^<]*)"; But you need to use Groups[1].Value – Wiktor Stribiżew May 14 '15 at 05:39
As an alternative, use `var myResponse = "(?<=)[^<]*(?=)";` it will work with Match.Value – Wiktor Stribiżew May 14 '15 at 05:44
I have added a demo to show how you can capture a number inside a `` tag text. – Wiktor Stribiżew May 17 '15 at 19:00

how to scrape contents of another we site using web scraping

1 Answers1