Phoneme Recognition by Using a Sequence of Color Lip Images

Abstract

In this paper, we propose a method for recognizing phoneme by using a sequence of color lip images. The mouth images are obtained in series by using the color camera set at the front of the face. First, among the sequence of the images, each object image for processing is detected by using mouth movement information. Next step, in each image, the mouth region is detected by the color information. Then, the four shapes which are outside line of lip, the inside line of lip, the tangue and the center line of lip are extracted by using the change in distribution of gray level. Finally, the recognition of phoneme is carried out by the method based on the subspace method. As the training, the subspace method needs the 20 features extracted from the above four shapes. In this paper, the authors describe the results of the experiments which were performed to demonstrate the effectiveness of the proposed method.