Analysis of Lip Movement Fluctuation Due to Utterance Experience

Abstract

A command input interfaces based on lip motion features can be used with or without vocalization. In a previous study, it was revealed that the fluctuations of lip movement attributable to vocalization, and the difference of the command recognition accuracy of both utterance conditions. However, the change in lip motion due to utterance experience is not clear yet.  In this paper, we investigate the fluctuation of lip motion due to utterance experience for 7 participants among 10 days. The results of our investigation showed that the cumulative sum of the inter-frame difference of the lip motion features and utterance experience have negative correlation, and variation in lip motion due to utterance experience having differences among individuals.