Write strings with mixed encoding to console [Python]

Question

Suppose I have a list of 4 songs (basically, in real life I don't know how many songs I have and how are they encoded):

OST Ходячий замок Хаула – Вальс "Карусель жизни"
Fäaschtbänkler – 22 Genres
Röyksopp – Running to the Sea (feat. Susanne Sundfor)
Omega – GyöngyhajúLány

These songs contain

Russian letters
ö, ä, ú

And this is example is far not the worst from what you might find in other cases

Basically, I need one encoding to rule them all, which one do I choose or how do I make it work in an other way?

UPD: Here is what I found on the site with this music

<meta http-equiv="content-type" content="text/html; charset=windows-1251">

Solution

I solved it by downloading win_unicode_console Still don't know how to do that in native python

What's you system, what's the current encoding in your console, what are the supported encodings of your console? What encoding do you use for Python strings? Do you use unicode or byte string? How on earth can we guess anything of that?! — Serge Ballesta, May 30 '16 at 11:58

noteness · Answer 1 · 2016-05-30T11:11:45.137

0

Use utf8 encoding. to write to stdout using utf8, use:

utf8stdout = open(1, mode='w', encoding='utf8',errors='replace', closefd=False)
print("something", file=utf8stdout)

edited May 30 '16 at 11:11

answered May 30 '16 at 11:08

noteness

2,440
1
15
15

output.encode('utf8', 'replace') should work as well, shouldn't it? – Denis Rozimovschii May 30 '16 at 11:10
@DenisRozimovschii `str.encode` functions are for changing them to bytes, if that is what you want, yes it would work – noteness May 30 '16 at 11:12
I want a normal string in the output. And I have checked your answer. I get "╨е╨╛╨┤╤П╤З╨╕╨╣ ╨╖╨░╨╝╨╛╨║ ╨е╨░╤Г╨╗╨░ - ╨Т╨░╨╗╤М╤Б "╨Ъ╨░╤А╤Г╤Б╨╡╨╗╤М ╨╢╨╕╨╖╨╜╨╕" instead of the song name writter in russian – Denis Rozimovschii May 30 '16 at 11:14
@DenisRozimovschii That might be your console`s problem – noteness May 30 '16 at 11:15
Replacing my code bits you yours - I get the wrong output for the song №1 listed in the question. – Denis Rozimovschii May 30 '16 at 11:16
@DenisRozimovschii maybe your console doesn't support utf8. can you change your console's encoding? – noteness May 30 '16 at 11:21
I'm running an untouched Windows PowerShell – Denis Rozimovschii May 30 '16 at 11:21
Windows console (cmd) returns the same output – Denis Rozimovschii May 30 '16 at 11:22
@DenisRozimovschii type `[Console]::OutputEncoding = [System.Text.Encoding]::UTF8` in the powershell and try again? – noteness May 30 '16 at 11:27
@DenisRozimovschii see this: http://stackoverflow.com/questions/22349139/utf-8-output-from-powershell – noteness May 30 '16 at 11:30
It gives a different output, but it is not correct as well – Denis Rozimovschii May 30 '16 at 11:31
@DenisRozimovschii In windows CMD, change the console font to Lucida and then type `chcp 65001`. Windows consoles doesn\t support utf8 by default, so it has problems with russian, etc. – noteness May 30 '16 at 11:34

Write strings with mixed encoding to console [Python]

1 Answers1