Feature Extraction and Analysis for Lip Reading in Continuous Image

Abstract

This paper proposes a new method for extracting the feature of lip motion. The proposed method was carried out without special conditions such as lipstick or lighting. The method consists of three steps. Four feature points are manually selected on the first frame. They are the upper, lower, left and right points on the outer lip contour. And then, the outer lip contour is approximated to a polygon with each point. Finally, four feature points are traced using optical flow in next frame. The temporal feature of lip motion is extracted by repeating second step and third step.
It is observed that proposed method is able to approximate the outer lip contour to a polygon. The proposed method is also able to trace automatically the feature points in continuous image. The experimental results indicate that the proposed method is the effective technique for extracting the feature of lip motion.