68

I am noticed in some python code that -u is used to start the python interpreter. I looked at the man page for python but I could not get much out of it. Please give me some examples.

goetz
  • 2,018
  • 2
  • 30
  • 33
Shraddha
  • 2,427
  • 5
  • 17
  • 21
  • 4
    I find this very useful when I am launching python from another process or batch and I want to monitor the output continuously instead of large chunks. See http://stackoverflow.com/questions/107705/python-output-buffering – Charles Beattie Jan 10 '13 at 13:07

2 Answers2

74

From python --help:

-u     : unbuffered binary stdout and stderr; also PYTHONUNBUFFERED=x
         see man page for details on internal buffering relating to '-u'

The manpage states:

-u     Force  stdin,  stdout and stderr to be totally unbuffered.  On systems where it matters, also put stdin,
       stdout and stderr in binary mode.  Note that there is internal buffering  in  xreadlines(),  readlines()
       and  file-object  iterators  ("for  line in sys.stdin") which is not influenced by this option.  To work
       around this, you will want to use "sys.stdin.readline()" inside a "while 1:" loop.

Python opens the stdin, -out and -error streams in a buffered mode; it'll read or write in larger chunks, keeping data in memory until a threshold is reached. -u disables those buffers.

Also, python can interpret newlines on open files and translate them from and to the native platform newlines (text mode). The -u option disables this translation, allowing you to process binary data without having to worry about what might happen to \r\n combinations. It is the equivalent of using rb or wb modes when opening files with the open() function.

Martijn Pieters
  • 1,048,767
  • 296
  • 4,058
  • 3,343
  • unbuffered binary stdout and stderr; ?? – Shraddha Jan 10 '13 at 13:00
  • For Python3.4, stdin is always buffered, regardless of '-u' usage. (from `python3.4 --help`) – Jonathan Hartley Jun 07 '16 at 20:09
  • @JonathanHartley: the manpage may well be incorrect here; note how the `--help` info (from Python 2.7, I'd say) doesn't mention stdin either. That's because stdin buffering is outside of Python's control. – Martijn Pieters Jun 07 '16 at 20:24
  • @JonathanHartley: the Python 3 manpages do away with `stdin` as well. See [Turn off buffering in pipe](http://unix.stackexchange.com/q/25372) for ways to make stdin unbuffered. – Martijn Pieters Jun 07 '16 at 20:26
28

Python is optimised for reading in and printing out lots of data. One of these optimisation is that the standard input and output of the Python interpreter are buffered. That means that whenever a program tries to use one of those streams, the interpreted will block up the usage into large chunks and then send the chunks all in one go. This is faster than sending each individual read/write through separately, but obviously has the disadvantage that data can get 'stopped up' in the middle.

The -u flag turns off this behaviour.

Katriel
  • 120,462
  • 19
  • 136
  • 170