Attention Estimation Using Reconstructed User’s First Person View Image from Environmental Point Cloud Data

Abstract

By using multiple RGB-D cameras, the method for estimating a user’s attention based on the saliency using the distribution of visual acuity in the user’s estimated first person view has been proposed. However, in this method, the calculation does not take the human’s visual characteristics into account. It is considered that the human’s visual attention is affected by not only color but also distance and three-dimensional shape of the object. In this study, with the aim of estimating a user’s attention more accurately, we propose a system for converting information obtained by the RGB-D cameras to point cloud data and reconstructing the user’s first person view.