Streaming write into csv file

Question

I need generate report of some big amount of data into csv file. I want avoid loading all data into memory and flush them all. My preferable way is create csv header and next in sequence write data into csv.

I'm using csv printer of apache csv which can create csv line with some settings. But when I call after every write flush writing is too slow.

Do you have any advice how to solve that task?

What is wrong with streaming a certain number of bytes at a time, and then writing to file? — Tim Biegeleisen, Jun 24 '19 at 11:06
@TimBiegeleisen I am not sure if I can do that with csv printer of apache library. — Denis Stephanov, Jun 24 '19 at 11:19
Use a `new BufferedWriter(...)` or [`Files.newBufferedWriter(...)`](https://docs.oracle.com/javase/9/docs/api/java/nio/file/Files.html#newBufferedWriter-java.nio.file.Path-java.nio.charset.Charset-java.nio.file.OpenOption...-) — Joop Eggen, Jun 24 '19 at 11:24

Basil Bourque · Answer 1 · 2019-06-24T18:54:07.580

0

`BufferedWriter`

Java offers the BufferedWriter class to automatically handle efficient writing to storage. No need for you to call flush. You can set the size of the buffer, but I suggest you start by using the default size.

A convenient way to instantiate such a object is by calling Files.newBufferedWriter.

Base your CSVPrinter object on the BufferedWriter.

edited Jun 24 '19 at 18:54

answered Jun 24 '19 at 18:28

Basil Bourque

303,325
100
852
1,154

Streaming write into csv file

1 Answers1

BufferedWriter

`BufferedWriter`