The Proceedings of Design & Systems Conference
Online ISSN : 2424-3078
2014.24
Session ID : 2207
Conference information
2207 Evaluation of a speech-driven embodied entrainment character system with emotional expressions and motions by speech recognition
Mizuki KOHARAHiraku SHIKATATomio WATANABEYutaka ISHII
Author information
CONFERENCE PROCEEDINGS FREE ACCESS

Details
Abstract
We have already developed a speech-driven embodied entrainment CG character system called "InterActor" which automatically generates communicative motions and actions such as nods for entrained interaction from speech rhythm based on only voice input. Furthermore, we have developed an advanced system using InterActor which includes the expressed function of motions and emotional expressions from the meaning of utterance by speech recognition, as well as the entrained function. In this system, talker's utterance is converted to text by speech recognition, and specific character strings are detected from the converted text by a database where 105 words for 434 motions and emotional expressions are registered. Then, the system automatically generates emotional expressions and motions that correspond to the detected character strings. In this paper, the effectiveness of the system is demonstrated by the sensory evaluation in the remote communication experiment for 12 pairs of 24 subjects, under three conditions: InterActor, a CG character with the expressed function, and InterActor with the expressed function (the developed system).
Content from these authors
© 2014 The Japan Society of Mechanical Engineers
Previous article Next article
feedback
Top