Java: Files.readAllBytes....is there a method faster than this to get the byte arrays of a file

Asked Aug 11 '14 at 06:23

Active Aug 11 '14 at 06:23

Viewed 1,183 times

I maded a simple java server program that send files to client.

The program works fine but when i load a very big file (1 GB) it takes 2 or 3 minutes for this line of code:

byte[] data = Files.readAllBytes(path);

Is there a wat to bypass this or make it faster (maybe by using a library)?

Thank's!

asked Aug 11 '14 at 06:23

Jaeger

4

Why do you load it all into memory? Why don't you stream it? – Sotirios Delimanolis Aug 11 '14 at 06:24
more to the point, why not just http://wiki.nginx.org/XSendfile ? – Brenton Fletcher Aug 11 '14 at 06:25
see http://stackoverflow.com/questions/9093888/fastest-way-of-reading-relatively-huge-byte-files-in-java – Dhaval Kapil Aug 11 '14 at 06:27
I guess you could use NIO to read the file faster, but it'll take some effort to develop and test. – markspace Aug 11 '14 at 06:27
1

@markspace this method already uses nio. – JB Nizet Aug 11 '14 at 06:30
1

What makes you think it *can* be done faster? And why do it at all? Any file can be processed a piece at a time, even XML. – user207421 Aug 11 '14 at 06:39
You also need to note that you're halfway towards not being able to fit the file into memory at all due to 32-bit byte-array size limitations. This is a bad idea. – user207421 Aug 11 '14 at 07:13
1

...and, in many cases, loading the big file in chunks means that you can start processing the data while waiting for more to be delivered. – Martin James Aug 11 '14 at 07:50
@MartinJames Exactly, thus saving both time and space. – user207421 Aug 13 '14 at 01:50
Thank you guys, loading the files at pieces make a significant improvement! – Jaeger Aug 18 '14 at 06:47

0 Answers0