Outofbound memory exception while downloading data from server in android

Question

I have to download around 6000 records into the sqlite database from a server. The records are present as JSON objects. While retrieving them using a BufferedReader, i get an error as out of memory bound exception. I have searched many sites but could not find an appropriate answer. Please suggest some best solution.

My code is:

URL url = new URL("myurl");
BufferedReader in = new BufferedReader(new InputStreamReader(url.openStream()));
//getting error here
line = in.readLine();
System.out.println(line);
JSONArray outerArray = (JSONArray) JSONSerializer.toJSON(line);
System.out.println("size : " + outerArray.size());

I got this Fatal Exception -

                 E/AndroidRuntime(616): java.lang.OutOfMemoryError: [memory exhausted]

task is calling in main thread or you have create `Asyn` class to call data in background ? — Chintan Khetiya, May 10 '13 at 06:44
Where exactly are you getting this OutOfMemoryError? How much memory do you have? — Peter Lawrey, May 10 '13 at 06:49
I am using emulator to run this code.. I am getting this error at BufferedReader in = new BufferedReader(new InputStreamReader(url.openStream())); — user2368920, May 10 '13 at 07:48

score 1 · Answer 1 · edited May 23 '17 at 12:29

1

Size of you downloading file is too much to hold in memory

Try doing like this

    // download the file
                InputStream input = new BufferedInputStream(url.openStream());
                OutputStream output = new FileOutputStream();

                byte data[] = new byte[1024];
                long total = 0;
                int count;
                while ((count = input.read(data)) != -1) {
                    total += count;
                    // publishing the progress....

                    output.write(data, 0, count);
                }

                output.flush();
                output.close();
//

For more explanation see this

Also

You should use json streaming either with gson or jackson. With Jackson you can use a hybrid approach as well. This would reduce your memory consumption significantly as only the portion of json being parsed is loaded into memory.

https://sites.google.com/site/gson/gson-user-guide

edited May 23 '17 at 12:29

Community

1
1

answered May 10 '13 at 06:49

Arun C

9,035
2
28
42

Thanks for your reply.. But i am getting error as /sdcard/BarcodeScanner-debug.apk (Permission denied). I am a newbie to android.. Can u explain this issue.. – user2368920 May 10 '13 at 07:30
I am getting error as permission denied.. What i have to do for that?? – user2368920 May 10 '13 at 09:40
add in manifest – Arun C May 10 '13 at 09:44
Use FileOutputStream output=openFileOutput() ; – Arun C May 10 '13 at 09:50

score 0 · Answer 2 · answered May 10 '13 at 06:54

0

It seems you are trying to download the whole JSON Array in one go and that consume a lot of memory. Rather than doing readLine, try reading the input in a fixed amount chunk of buffer (eg: 1024), if that's enough to make one or more JSON Array, parse it. Then continue reading the next chunk. That way you're not blowing your memory space

Please note this method will only work if you can guarantee your JSON array element won't go past 1024 bytes. Otherwise try adjust this number accordingly / use adjustable data structure

answered May 10 '13 at 06:54

gerrytan

40,313
9
84
99

Thanks.. But i have all those 6000 records in a single array... Can you help me.. – user2368920 May 10 '13 at 07:28
That's fine. Where your program fail is when it tried to parse all 6000 items at once. Instead try processing them in small batches using method described in my answer – gerrytan May 11 '13 at 16:29

RBK · Answer 3 · 2014-08-14T03:55:22.357

0

the heap memory may low provided to your app,

you need to register app for larger heap by entry in manifest,

<application android:largeHeap="true"> </application>

http://developer.android.com/guide/topics/manifest/application-element.html#largeHeap

edited Aug 14 '14 at 03:55

answered Aug 12 '14 at 17:33

RBK

2,481
2
30
52

Hi and welcome to SO. please add more details in your answer. – Pratik Bhat Aug 12 '14 at 17:37

Outofbound memory exception while downloading data from server in android

3 Answers3