Mechanical Engineering Journal
Online ISSN : 2187-9745
ISSN-L : 2187-9745
Design, Systems, and Manufacturing
Speech-driven embodied entrainment character system with pupillary response
Yoshihiro SEJIMAYoichiro SATOTomio WATANABEMitsuru JINDAI
Author information

2016 Volume 3 Issue 4 Pages 15-00314


We have developed a speech-driven embodied entrainment character called “InterActor” that has functions of both speaker and listener for supporting human interaction and communication. This character would generate communicative actions and movements such as nodding, body movements, and eyeball movements by using only speech input. In this study, we focus specifically on the pupillary responses related to human emotions in embodied interaction and communication. Pupillary responses in human face-to-face communication are analyzed using an embodied communication system with a line-of-sight measurement device. Based on the analysis results, we enhance the functions of the character and develop an advanced speech-driven embodied entrainment character system for conveying empathy. Using only speech input, this system changes the pupil size of characters based on the analysis. Through sensory evaluation, we perform experiments to determine the effects of the developed system. The results reveal that the system is effective in human interaction and communication.

Information related to the author
© 2016 The Japan Society of Mechanical Engineers
Previous article Next article