Emotion Analysis of Cooperative and Non-cooperative Behaviors in Iterated Prisoner's Dilemma Games Utilizing Facial Expression Sensing

Abstract

Agents in social simulations need to behave in a rule that reflects human behavior. While there has been much research in recent years on behavioral models of language-based agents using Large Language Model, there is still little research on model building using human nonverbal signals. To adopt non-verbal aspects of human into behavioral models, we focused on human facial expressions in dilemma situations. In this study, we used facial expression sensing to estimate human emotions during playing iterated prisoner's dilemma and investigated emotions toward choices and the observation of achievement or failure of cooperative behavior. We also compared the results of emotion estimation by facial expression sensing with a questionnaire-based social psychological index. This experiment revealed that the emotions in facial expressions in the dilemma state differed between cooperative and non-cooperative behaviors, and that there was a relationship between social psychological indices and facial expressions in response to the presentation of the outcome.