HtmlAgilityPack HtmlDocument.Load throws exception "object not set to an instance"

Question

var uri = new Uri("http://store.scrapbook.com/cos-pad825.html?t12-13=cosmo%20cricket&date=20110309");
var request = (HttpWebRequest)WebRequest.Create(url);
var cookieContainer = new CookieContainer();

request.CookieContainer = cookieContainer;
request.UserAgent = @"Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.5) Gecko/20091102 Firefox/3.5.5";
request.Method = "GET";
request.AllowAutoRedirect = true;
request.Timeout = 15000;

var response = (HttpWebResponse)request.GetResponse();
var page = new HtmlDocument();
var stream = response.GetResponseStream();
page.Load(stream);

Causes an error. on the Load(stream) call. Any ideas?

Here is the stack trace at HtmlAgilityPack.HtmlDocument.ReadDocumentEncoding(HtmlNode node) at HtmlAgilityPack.HtmlDocument.PushNodeEnd(Int32 index, Boolean close) at HtmlAgilityPack.HtmlDocument.Parse() at HtmlAgilityPack.HtmlDocument.Load(TextReader reader) — Adrian Adkison, Mar 18 '11 at 09:19
I think the best option for you is to debug this code. Get source code from codeplex and debug. — Rafal Spacjer, Mar 18 '11 at 09:40

Simon Mourier · Accepted Answer · 2011-03-18T12:54:26.997

3

The error I get when I run your code is:

System.ArgumentException: 'ISO-8559-1' is not a supported encoding name.

It's thrown by the standard .NET Framework encoding classes. It means the page declares an encoding not supported by .NET. I fixed it like this:

var page = new HtmlDocument();
page.OptionReadEncoding = false;

PS: I'm using the Html Agility Pack version 1.3

edited Mar 18 '11 at 12:54

answered Mar 18 '11 at 11:14

Simon Mourier

132,049
21
248
298

Last question for you, Simon, I promise, take a look if you have a second. http://stackoverflow.com/questions/5385010/can-htmlagilitypack-handle-an-xml-file-that-comes-with-an-xsl-file-to-render-html – Adrian Adkison Mar 21 '11 at 23:40
@Adrian adkison - I answered it. – Simon Mourier Mar 22 '11 at 11:01

score 0 · Answer 2 · answered Mar 18 '11 at 11:29

Maybe not a the answer you need, but the stack trace indicates the exception occurred after you past the response stream type to the page's load method.
It might be worth adding a TextReader in before the htmldocument assignment, and pass off the stream object to that. Then pass the textreader var to htmldoc's Load method.

Before you debug the source code for latest htmlagility, I think you should first edit your question to include the states of all types/props of interest, for clarity.

HtmlAgilityPack HtmlDocument.Load throws exception "object not set to an instance"

2 Answers2