Characters replaced by question mark when parsing html

Question

I am using HtmlAgilityPack to read a parse a html file and extract some text:

static void Main(string[] args)
        {
            var webGet = new HtmlWeb();
            var document = webGet.Load("http://port.ro/");

            var programs = from program in document.DocumentNode.Descendants()
                           where program.Name == "a" && program.Attributes["href"] != null && program.InnerText.Trim().Length > 0
                           select program.InnerText ;

            foreach (string s in programs)
            {
                Console.WriteLine(s);
            }

            Console.ReadLine();
        }

My problem is that the website contains characters like à and when I print them, they are replaced by ?.

What should I need to do so when I print the text the character à its replaced by a or print it like à ?

possible duplicate of [c# unicode string output](http://stackoverflow.com/questions/5055659/c-sharp-unicode-string-output) — CodeCaster, Nov 04 '11 at 08:29

score 1 · Accepted Answer · edited May 23 '17 at 11:55

1

Did you try using or set the encoding as required for the site. This should help you get the proper text

~~var document = webGet.Load("http://port.ro/", Encoding.UTF8);//check your encoding~~

Above one is for htmldocument

for HtmlWeb Try this:

var web = new HtmlWeb
{
    AutoDetectEncoding = false,
    OverrideEncoding = myEncoding,
};
var doc = web.Load(myUrl);

edited May 23 '17 at 11:55

Community

1
1

answered Nov 04 '11 at 08:32

V4Vendetta

37,194
9
78
82

can I use that for the second argument ? I get "invalid arguments" – Adrian Nov 04 '11 at 08:34
Now it doesn't know about OverrideEncoding, without it I get the same results – Adrian Nov 04 '11 at 08:45
seems to be an old version, check out the comments in the link and perhaps you should use the latest version – V4Vendetta Nov 04 '11 at 10:08
Yep the latest version its working, btw do you know what encoding should I use so I dont get 'à' characters, only 'a' ? – Adrian Nov 04 '11 at 10:10

score 1 · Answer 2 · answered Nov 04 '11 at 08:33

1

In HtmlAgility there is property to set stream encoding (normaly it should autodetect encoding ) but maybe not working for your page.. (wrong meta tags etc..)

answered Nov 04 '11 at 08:33

Kamil Lach

4,519
2
19
20

Characters replaced by question mark when parsing html

2 Answers2