2

I have used gaussian mixture model explained in this link to seperate fingers from the back-ground. It works decently if the backgroud is plain as below examples.

Input Image: enter image description here

Output Image: enter image description here

Actually, in my project environment, the user will be sitting in front of the webcam with hand in foreground and face behind(in background).

Input Image ( User Sitting In front of Camera ): enter image description here

So i have to extract only the hand part and i am trying to do with Gaussian Mixture Model. But the implementation doesn't work well here.

Output After Applying Gaussian Mixture Model:

enter image description here

So how to extract only the fingers from the output like below:

enter image description here

Community
  • 1
  • 1
user2727765
  • 616
  • 1
  • 12
  • 28
  • I guess the problem is that GMM extracts the foreground/background, and your head will always be part of the foreground except if you fix it within the image or if you are able to track it (which wont be possible with the hand covering huge parts of the face). So foreground extraction might not work at all to extract the hand in that setting. Your setting is quite hard ;). – Micka Dec 20 '13 at 22:03
  • @Micka Is there any other method to apart from em + GMM to extract the finger? – user2727765 Dec 21 '13 at 05:27

1 Answers1

1

looking from the "press Esc to exit application" words, I am going to make an assumption that your application is real time? If so, have you considered real time background substraction?

More details about background subtraction can be found here: http://web.bii.a-star.edu.sg/~chengli/BkgSbt.htm.

To my knowledge, this should be sufficient to track and extract the hand. But it's not that robust, for instance, considering the user keep bobbing his head, or shifting it left and right. (the user head will be then considered a foreground object instead of background)

But if you are not going to do something so complicated like your question posed, then if the user just gonna sit there not moving while the hand comes into frame, then I believe you will find the background subtraction method extremely useful. Cheers.

rockinfresh
  • 2,068
  • 4
  • 28
  • 46