Conversion of character set in C#

Question

Possible Duplicate:
How do I remove diacritics (accents) from a string in .NET?

Our project generates an string(Mērā nāma nitina hai) in web page and when we read it using Regex.match function then we get a string in which these special character are converted into some browser code like \&#\257(without backslash) in place of ā . So we want to convert it into 'a' or 'ā'. So that we can use it in further program. Thanks

Please explain: do you want a regex to convert those special character to Latin equivalent? — usr-local-ΕΨΗΕΛΩΝ, May 02 '11 at 13:16
@djechelon yeah, we want to convert it into 8-bit character set. — Sushant Jain, May 02 '11 at 13:18
@Hosam Actually when we read string from web page using regex.match function then it read those special character as \\257 in place of 'ā'. And i want to solution of it. — Sushant Jain, May 02 '11 at 13:32
@All: I don't see that this is a duplicate of the linked question. He doesn't want to get rid of the diacritics - he wants to convert the HTML entities into UTF-8. — John Saunders, May 02 '11 at 18:57
@All: John Saunders is right, I just wanna convert Html character entities to simple character set. Then why this post has closed...? :( — Sushant Jain, May 03 '11 at 04:22
OK, your wording is clearer now, so I'm nominating it to be reopened. But you should work on your language, because that was not what many people understood from the initial question. — Hosam Aly, May 03 '11 at 11:13

Anton Semenov · Accepted Answer · 2011-05-02T13:51:59.687

1

Im not sure that my method is absolutely right but it works for me:

[EDIT]

string first = @"M&#275;r&#257; n&#257;ma nitina hai";
first = System.Web.HttpUtility.HtmlDecode(first);

byte[] ansi = System.Text.Encoding.Convert(Encoding.Unicode, Encoding.GetEncoding(1252), Encoding.Unicode.GetBytes(first));
string output = Encoding.Unicode.GetString(System.Text.Encoding.Convert(Encoding.GetEncoding(1252), Encoding.Unicode, ansi));
MessageBox.Show(output);

The main idea of this code - you are converting your string to ANSI and back to UNICODE. After this action all diacritics is gone away.

edited May 02 '11 at 13:51

answered May 02 '11 at 13:34

Anton Semenov

6,227
5
41
69

@anton Actually we are not getting this string after regex.match function. we are getting "M\\275;r\\257; n\\257;ma nitina hai"(without \ ). and we want to convert it into original one. – Sushant Jain May 02 '11 at 13:39
@Sushant Jain: OK, Ive edit my answer – Anton Semenov May 02 '11 at 13:52
That's not a correct way to remove diacritics. – František Žiačik May 02 '11 at 13:54
@František Žiačik: Yes, I know. This is workaround way. But I dont know how to do this right. May be you can give me a right direction for solution. The question OP has asked is aslo interesting for me. – Anton Semenov May 02 '11 at 14:01
@Anton Semenov: As Paolo Tedesco suggested in his answer, with the help of `Normalize`. See, for example, http://blogs.msdn.com/b/michkap/archive/2005/02/19/376617.aspx – František Žiačik May 02 '11 at 14:05
But I think that's not what was asked here, it's all about the `HtmlDecode`. – František Žiačik May 02 '11 at 14:05
I think you should merge this code with `String.Normalize` as clarified in the question's possible duplicate (http://stackoverflow.com/questions/249087/how-do-i-remove-diacritics-accents-from-a-string-in-net). – Hosam Aly May 03 '11 at 11:16
@Hosam Aly: Actually I should replace my code with code from your link :) – Anton Semenov May 03 '11 at 11:18

score 1 · Answer 2 · answered May 02 '11 at 13:50

1

How about this:

var correctStr = HttpUtility.HtmlDecode(@"M&#275;r&#257; n&#257;ma nitina hai");

Explanation: ā is an html entity character representing the special accented char with unicode code 257.

answered May 02 '11 at 13:50

František Žiačik

7,511
1
34
59

score 0 · Answer 3 · answered May 02 '11 at 13:20

0

You need to use the String.Normalize method.

answered May 02 '11 at 13:20

Paolo Tedesco

55,237
33
144
193

Conversion of character set in C#

3 Answers3