4

I am attempting to use machine learning (namely random forests) for image segmentation. The classifier utilizes a number of different pixel level features to classify pixels as either edge pixels or non edge pixels. I recently applied my classifier to a set of images that are pretty difficult to segment even manually (Image segmentation based on edge pixel map) and am still working on obtaining reasonable contours from the resulting probability map. I also applied the classifier to an easier set of images and am obtaining quite good predicted outlines (Rand index > 0.97) when I adjust the threshold to 0.95. I am interested in improving the segmentation result by filtering contours extracted from the probability map.

Here is the original image:

Original image

The expert outlines:

Expert Outlines

The probability map generated from my classifier:

enter image description here

This can be further refined when I convert the image to binary based on a threshold of 0.95:

enter image description here

I tried filling holes in the probability map, but that left me with a lot of noise and sometimes merged nearby cells. I also tried contour finding in openCV but this didn't work either as many of these contours are not completely connected - a few pixels will be missing here and there in the outlines.

Edit: I ended up using Canny edge detection on the probability map.

Community
  • 1
  • 1
eagle34
  • 1,424
  • 1
  • 15
  • 19

1 Answers1

5

The initial image seems to be well contrasted and I guess we can simply threshold to obtain a good estimate of the cells. Here is a morphological area based filtering of the thresholded image:

Threshold: Threshold at 10

Area based opening filter(this needs to be set based on your dataset of cells under study): Size smaller than 2500 pixels removed

Area based closing filter(this needs to be set based on your dataset of cells under study): enter image description here

Contours using I-Erosion(I): enter image description here

Code snippet:

C is input image
C10 = C>10; %threshold depends on the average contrast in your dataset
C10_areaopen = bwareaopen(C10,2500); %area filters average remove small components that are not cells
C10_areaopenclose = ~bwareaopen(~C10_areaopen,100); %area filter fills holes 
se = strel('disk',1);
figure, imshow(C10_areaopenclose-imerode(C10_areaopenclose,se)) %inner contour

To get smoother shapes I guess fine opening operations can be performed on the filtered images, thus removing any concave parts of the cells. Also for cells that are attached one could use the distance function and the watershed over the distance function to obtain segmentations of the cells: http://www.ias-iss.org/ojs/IAS/article/viewFile/862/765

I guess this can be also used on your probability/confidence maps to perform nonlinear area based filtering.

Community
  • 1
  • 1
beedot
  • 652
  • 5
  • 12
  • Thanks! Could you explain in more detail how I might use this approach on the probability maps? – eagle34 Nov 04 '13 at 12:32
  • 1
    You could try filling in contours of your probability map using _holefilling_: [imfill](http://www.mathworks.fr/fr/help/images/ref/imfill.html) with the area based filtering as seen in the original solution! – beedot Nov 05 '13 at 18:29