The Proceedings of Design & Systems Conference
Online ISSN : 2424-3078
2012.22
Session ID : 1308
Conference information
1308 Development of an Embodied Entrainment Character System using Optical Flow of Lip Motion
Kazuaki NAKAMURATomio WATANABEMitsuru JINDAI
Author information
CONFERENCE PROCEEDINGS FREE ACCESS

Details
Abstract
Development of information technology spreads communication using CG characters at the virtual space. Humans communicate each other by not only using words but also sharing embodied rhythms based on body actions such as nodding and gestures. We have developed InterActor which is a CG embodied interaction character. InterActor can generate communicative motions and actions for entrained interaction by only speech input. However, InterActor is sensitive under noisy environment. In this paper, in order to support the avater-mediated communication under noisy environment, a CG embodied interaction character system is developed by using lip motion that depends on speech rhythms. Lip motion is measured by an optical-flow technique, and is used for the input of the developed system. This system can generate communicative motions and actions for entrained interaction by only lip motion.
Content from these authors
© 2012 The Japan Society of Mechanical Engineers
Previous article Next article
feedback
Top