System for Analyzing User Interest Based on Eye Gaze Responses to Enhance Empathy with Users

Abstract

Recently, robotic systems that offer practical services in everyday life, such as smart home systems, have been developed. The latest trend moves beyond user-controlled internal systems through traditional methods, such as remote controls, to systems that autonomously understand user contexts and evolve to provide a more comfortable living environment. Therefore, this research aims to advance this field by exploring the potential of a system capable of understanding human conditions and behavior, and by proposing or executing actions that align with an individual’s intended actions. To investigate a system capable of achieving this goal, we focused on analyzing the gazes of users and developed an eyeglass-type wearable device. The primary objective of this study was to track a specific user’s gaze, identify the object of focus, and analyze the user’s level of attention and interest in that object. Therefore, for the sensory configuration of the system, an analysis was performed using data collected from camera sensors for eye tracking and sensors for measuring environmental information. Based on the analysis results, we evaluated whether the system could accurately interpret and anticipate the actions that user intended to perform.