opencv does not detect mouth correctly...!

Question

I am trying to extract mouth(lips) from images. What I did is this. I first extract faces from images and tried to detect mouth using haarcascade_mcs_mouth.xml. However, It keeps detecting other parts instead detecting mouth from the face. Is there any other way to detect mouth from face images?

Answer 1

To correctly detect mouth regions, you can try more advanced methods like the following one:

• X. Zhu, D. Ramanan. Face Detection, Pose Estimation and Landmark Localization in the Wild Computer Vision and Pattern Recognition (CVPR) Providence, Rhode Island, June 2012. (Project page), (PDF Online available), (Source code)

Several real examples can be seen from here.

Answer 2

You can use some facial landmark detector such as Flandmark detector: http://cmp.felk.cvut.cz/~uricamic/flandmark/

Or STASM:

http://www.milbo.users.sonic.net/stasm/