Emoticons in python string - \xF0\x9F\x92\x96 \xF0

Asked Jul 22 '15 at 21:15

Active Jul 22 '15 at 21:35

Viewed 1,173 times

_mysql_exceptions.Warning: Incorrect string value: '\xF0\x9F\x92\x96 \xF0...' for column 'title' at row 1

s = "This is my string. Über! 0\x9F\x92\x96 \xF0"

How can I remove only this value -> 0\x9F\x92\x96 \xF0 from this string?(or encode this)

EDIT:

>>> s = "So simple  google.com"
>>> s
'So simple \xf0\x9f\x98\x81 google.com'
>>> s.decode('utf-8')
u'So simple \U0001f601 google.com'
>>> print s.decode('utf-8')
So simple  google.com
>>>

edited Jul 22 '15 at 21:35

smci

32,567
20
113
146

asked Jul 22 '15 at 21:15

pawss

Whatever you have there is not valid UTF-8.. – Martijn Pieters Jul 22 '15 at 21:17
@MartijnPieters: What can I do with this? – pawss Jul 22 '15 at 21:18
1

Start with actually giving us a valid byte string; `\xF0\x9F\x92\x96` is a valid UTF-8 byte sequence (encoding aka [U+1F496 SPARKLING HEART](https://codepoints.net/U+1F496)), but the value of `s` is not. – Martijn Pieters Jul 22 '15 at 21:21
But MySQL cannot handle non-BMP codepoints unless you use the [utf8mb4 codec](https://dev.mysql.com/doc/refman/5.7/en/charset-unicode-utf8mb4.html) on the MySQL side. – Martijn Pieters Jul 22 '15 at 21:25
1

I duped you to [Warning raised by inserting 4-byte unicode to mysql](https://stackoverflow.com/q/10798605) because that does hold the solution (how to remove the codepoints MySQL utf8mb3 doesn't support) but you do need to decode your bytestring to Unicode first. – Martijn Pieters Jul 22 '15 at 21:28
@MartijnPieters: thanks. Is similar in postgres? – pawss Jul 22 '15 at 21:35
Postgres doesn't have a broken UTF-8 support like MySQL has. – Martijn Pieters Jul 22 '15 at 21:36
This may help you: https://stackoverflow.com/q/47716217/8100123 – Hussein Esmail Jul 31 '21 at 18:30

Emoticons in python string - \xF0\x9F\x92\x96 \xF0

0 Answers0