C/C++ file output buffering/buffer handover to the OS

Question

I'm maintaining a single-threaded C++ app that has to write a large binary file from time to time. I'd like to minimize the time spent in { stream(fname); stream.write(largebuf}; }, so hand over the data to the OS (Linux) as fast as possible when writing/closing the stream. I'm not really concerned about when the data is actually written physically to the disk.

This could wery well be an OS tuning question (any pointers are welcome) - I'd just like to know if there's anything I can do within the C++ code to improve turnaround time from the block shown above.

thanks, T.

read here: http://stackoverflow.com/questions/11563963/writing-a-binary-file-in-c-very-fast — RichardPlunkett, Nov 29 '13 at 10:47

score 1 · Answer 1 · answered Nov 29 '13 at 10:56

1

You may consider using std::async if building C++11 is not an issue.

answered Nov 29 '13 at 10:56

Julien B.

88
6

score 0 · Answer 2 · answered Nov 29 '13 at 10:51

Is there any particular reason you can not use threads? If you don't care when the data is actually written to the disk you can just use threads so you don't block your main thread while writing that large bin file.

std::thread write_thread([&fname, &largebuf](){ stream(fname); stream.write(largebuf}; });

PS: the sample is using C++11 features (threads and lambda functions).

C/C++ file output buffering/buffer handover to the OS

2 Answers2