How to slice the chunk from one variable in Java?

Question

Say, I have a List<Entity> to be stored into Google Memcache. But Google Memcache has size limitation to store 1 object, the maximum size is 1MB. But my List<Entity> is about 20MB or more. How do I slice them down from List<Entity> and reconnect them back into one later?

There is a method to overcome this in Python - Avoiding Memcache "1000000 bytes in length" limit on values. But I don't find a way to do this in Java. Please help if you know anything to do with this.

How about storing the single `Entity` objects separately? Are they still bigger than 1MB? — Raibaz, Jun 27 '13 at 07:42
@Raibaz: Well, by doing that way is not an issue. I am asking how to overcome this matter when the object is more than 1MB size? — lannyboy, Jun 27 '13 at 07:45

score 1 · Accepted Answer · edited May 23 '17 at 12:11

1

You could write your List<Entity> to a File, and break that file up into multiple files, send the files and put them back together on the receiving end. Here's a tutorial; this may also be helpful. You can use SequenceInputSteam to assist in the deserialization of an object from multiple files.

edited May 23 '17 at 12:11

Community

1
1

answered Jun 27 '13 at 07:53

Steve P.

14,489
8
42
72

Is there a guide to serialize a variable? All I know how to serialize an input stream and an output stream in file format. – lannyboy Jun 27 '13 at 07:59
Thanks! I will try that... It seems logic to me. – lannyboy Jun 27 '13 at 08:04
No problem. [This](http://stackoverflow.com/questions/1387954/how-to-serialize-a-list-in-java) may also be helpful. – Steve P. Jun 27 '13 at 08:07

How to slice the chunk from one variable in Java?

1 Answers1