Development of a Video Chat System Superimposing a Pupil CG Model Synchronized with Burst-Pause of Utterance on the Speaker’s Pupil

Abstract

Pupil response plays an important role to express affect. Focusing on the pupil response in human communication, we analyzed the pupil response in an embodied interaction and demonstrated that the speaker’s pupil was clearly dilated during burst-pause of utterance. In addition, it was confirmed that the pupil response is effective for supporting the embodied interaction and communication by using the developed system in which an interactiove CG character generates pupil response based on the burst-pause of utterance. In this study, we develop a video chat system which superimposes a pupil CG model on the speaker’s pupil for enhancing affective conveyance. In this system, a pupil CG model consists of pupil and iris, whose response is synchronized with the burst-pause of utterance.