リアルタイムな表情変形フィードバックによる感情体験の操作

抄録

Our research goal is to manipulate human emotions and to virtually evoke various emotional experiences. It is challenging to directly manipulate human emotions within the conventional approach of human-computer interaction. To break through this difficulty, we propose a new method for virtually evoking emotions with an integration of the knowledge of cognitive science and virtual reality. Psychological studies have revealed that the recognition of changes within bodily responses unconsciously evokes an emotion.We therefore hypothesized emotion could be manipulated by having people recognize pseudo-generated bodily reactions as changes to their own bodily reactions. In this paper, we focus on the effect of facial expressions on evoked emotion. We developed a mirror-like system that manipulates emotional states by giving the feedback of deformed facial expressions in real time. The user studies clarified that the feedback of deformed facial expression can manipulate emotional experiences; not only positive and negative affect, but also preference decisions. Moreover, user's actual facial expressions were also changed corresponding to the feedback of deformed facial expressions.