Converting \x escaped string to UTF-8

Question

How can convert a string that looks like '\xd0\xbf\xd1\x80\xd0\xb8\xd0\xb2\xd0\xb5\xd1\x82' to something readable?

Note that this is **not** a duplicate of https://stackoverflow.com/questions/4020539/; the input represents UTF-8 bytes which must be re-interpreted as UTF-8 *after* the backslash escape sequences have been unescaped. — Karl Knechtel, Aug 04 '22 at 23:46

falsetru · Answer 1 · 2018-03-09T03:19:21.657

21

In python 2.7

>>> print '\xd0\xbf\xd1\x80\xd0\xb8\xd0\xb2\xd0\xb5\xd1\x82'
привет

>>> print '\\xd0\\xbf\\xd1\\x80\\xd0\\xb8\\xd0\\xb2\\xd0\\xb5\\xd1\\x82'.decode('string-escape')
привет
>>> print r'\xd0\xbf\xd1\x80\xd0\xb8\xd0\xb2\xd0\xb5\xd1\x82'.decode('string-escape')
привет

In python 3.x

>>> br'\xd0\xbf\xd1\x80\xd0\xb8\xd0\xb2\xd0\xb5\xd1\x82'.decode('unicode-escape').encode('latin1').decode('utf-8')
'привет'

edited Mar 09 '18 at 03:19

answered Aug 08 '13 at 06:47

falsetru

357,413
63
732
636

2

>>> print '\xd0\xb6\xd0\xbe\xd0\xbf\xd0\xb0' жопа – eri Aug 08 '13 at 06:49
i suggest that @synapse has r'\xd0\xb6\xd0\xbe\xd0\xbf\xd0\xb0', i.e. string with slashes. – eri Aug 08 '13 at 06:51
@eri, I used '\\' instead of raw string intentionally because this question is not python-only question. – falsetru Aug 08 '13 at 06:53
4

@falsetru btw, this is rather rude word in Russian :) – alecxe Aug 08 '13 at 07:00
@alecxe, Oops, I will change the code, soon. – falsetru Aug 08 '13 at 07:01
finally find the solutation!! Where do the python doc specify this situation. – selfboot Jun 09 '18 at 14:13

score 0 · Answer 2 · answered Aug 08 '13 at 07:21

0

For file reading you may use this instead of open():

import codecs
with codecs.open('filename','r','string-escape') as f:
    data=f.read()

data will be reencoded while f reading.

answered Aug 08 '13 at 07:21

eri

3,133
1
23
35

Converting \x escaped string to UTF-8

2 Answers2

In python 2.7

In python 3.x

Linked