Heart Rate and Facial Expression Visualization Interface for Collaborative Online Games

Revised version in Feb. 2025

Abstract

This study proposes a system to facilitate smooth coordination in cooperative games by supplementing verbal communication. The system analyzes players' heart rates and facial expressions in real time to visualize internal states, such as "urgency" and "composure." Using an external interface distinct from the main gameplay, this information is presented to teammates as a supplementary UI element. The objective is to enhance mutual awareness and increase the frequency of cooperative actions.