Abstract
In this paper, as a new visual front end of audio-visual speech recognition systems, a simple method for lips region extraction is proposed. This method has robustness for varying shape and three-dimensional geometric changes by using only one image template. The image data is represented by x component (redness) of the Yxy colour space. The system environment is that a camera and human head run around separately for mobile devices. In our previous study, we tried to extract lips region, which has varying shape by speech, and the geometric changes of lips on two-dimension. Then, we extend this previous method to three-dimension by using projective geometry. In our simulations, we try to extract lips region from a face image with background, varying shape by speech, geometric changes, and face horizontal direction change. By this simulation, we can obtain high extraction accuracy.
