Why are weird encoded characters in my string?

Asked Dec 11 '20 at 00:04

Active Dec 11 '20 at 00:04

Viewed 28 times

I am fetching a string from a website and it is returning the string with some sort of weird charachters in it

Pokémon & Magic the Gathering

How can I easily convert it to say Pokémon & in stead of using .replace('é', é) because there are other sorts of weird characters like it that aren't é.

Sorry if my question is worded poorly I don't really understand why this is happening to begin with, any help is appreciated

asked Dec 11 '20 at 00:04

Jeffrey Lim

It is a product name from a website I retrieve from a json. – Jeffrey Lim Dec 11 '20 at 00:06
`chr(233) == 'é'` looks like ascii codes – jkr Dec 11 '20 at 00:07
In any case, those look to be html "entities". See the linked duplicate for a built-in way to decode them – juanpa.arrivillaga Dec 11 '20 at 00:08
@jakub okay, how can I decode it? – Jeffrey Lim Dec 11 '20 at 00:08
1

@JeffreyLim again, look at the linked duplicate, but basically, `import html` then use `html.unescape(s)` – juanpa.arrivillaga Dec 11 '20 at 00:09
@juanpa.arrivillaga would you do that *before* or *after* the JSON decoding? I'm guessing before but I've never had to do it. – Mark Ransom Dec 11 '20 at 00:36
@MarkRansom probably after deserializing the json would be safer, but I don't really understand how the OP is getting the string. – juanpa.arrivillaga Dec 11 '20 at 01:10
@juanpa.arrivillaga just a guess, the source is generating the JSON then sending it to a generic output function that does HTML encoding. Then whatever OP is using to read it does *not* do decoding. – Mark Ransom Dec 11 '20 at 01:14
@MarkRansom ah, yes, that sounds likely – juanpa.arrivillaga Dec 11 '20 at 03:03

Why are weird encoded characters in my string?

0 Answers0