インテリジェントルームのためのDPマッチングを用いた口唇動作認識

抄録

An intelligent room which recognizes gestures and supports people is expected in various situations in recent years. This paper proposes a method to recognize mouth motion, i.e., a method of lip reading, to indicate an object like a home appliance in an intelligent room. The method first detects the operator's face. Then mouth region is extracted from the face region using the fact that inside of mouth is dark. Dynamic Programming (DP) matching is applied to a sequence of low-resolution images of the mouth region and the mouth motion of speaking a word is recognized. The proposed method overcomes the disadvantage of image-based methods that they are not robust to the change of distances between an operator and a camera. Additionally, the proposed method can cope with small displacement of mouth position while speaking by considering one-pixel offsets for low-resolution images and using nine shifted images to obtain the smallest distance. The effectiveness of the proposed method is evaluated by experiments to recognize four words that are typical names of home appliances.