Interaction Model Using Emotion Inference from Facial Expressions and Situations

Abstract

The conventional information processing usually deals with verbal and certain information. A computer needs to deal with non-verbal or ambiguity information as well as verbal and certain information in future. This paper considers a facial expression that is a kind of non-verbal information and expresses human emotion, and constructs an interaction model between the recognition model of emotion and the route decision system as an example of human-computer interaction using facial expressions and situations. The recognition model of emotion recognizes emotions from not only facial expressions but also human situations in which a person is placed. On the other hand, the route decision system reaches an instructed destination or sometimes takes a wrong way, where instructions are given by linguistic expressions. The route decision system also shows its emotions through facial expressions. This paper shows interactions between the recognition model of emotions and the route decision system, which are implemented on two computer systems. Interaction examples show the usefulness of the present model.