How to read a large image in chunks in python?

Question

I'm trying to compute the difference in pixel values of two images, but I'm running into memory problems because the images I have are quite large. Is there way in python that I can read an image lets say in 10x10 chunks at a time rather than try to read in the whole image? I was hoping to solve the memory problem by reading an image in small chunks, assigning those chunks to numpy arrays and then saving those numpy arrays using pytables for further processing. Any advice would be greatly appreciated.

Regards,

Berk

Images go up to 10 GB and I have 6GB of RAM. I want to avoid loading the images onto the RAM. — Brkk, Feb 13 '14 at 22:15
Another question, when you say that you want to compute the difference in pixel values, does it means that you want to compute the difference between every two pixels of two images of the same dimensions? — Alceu Costa, Feb 13 '14 at 22:52
Img1_pixel(x,y) - Img2_pixel(x,y) for every pixel of two images of the same dimensions. — Brkk, Feb 13 '14 at 23:08

score 4 · Accepted Answer · answered Feb 13 '14 at 21:28

4

You can use numpy.memmap and let the operating system decide which parts of the image file to page in or out of RAM. If you use 64-bit Python the virtual memory space is astronomic compared to the available RAM.

answered Feb 13 '14 at 21:28

Sturla Molden

1,124
7
7

score 2 · Answer 2 · edited May 23 '17 at 12:07

If you have time to preprocess the images you can convert them to bitmap files (which will be large, not compressed) and then read particular sections of the file via offset as detailed here:

Load just part of an image in python

Conversion from any file type to bitmap can be done in Python with this code:

from PIL import Image
file_in = "inputCompressedImage.png"

img = Image.open(file_in)

file_out = "largeOutputFile.bmp"

img.save(file_out)

How to read a large image in chunks in python?

2 Answers2

Linked