Constructing an evaluation space for smile intensity using reference images

Abstract

Traditional frameworks of smile detection mainly focus on identifying whether a smile is expressed or not. In contrast, the objective of our research is to determine the degree to which a smile is expressed. The previously developed method of the evaluation of smiling based on the ordinal scales has a limitation of being time consuming due to a large number of comparisons. To overcome the limitation, we propose a method using reference images chosen from an evaluation space of smiling. Once the evaluation space is constructed by a large dataset of smiling, reference images can be chosen based on consistency of its evaluation values with other images. With these reference images, we can evaluate new face images in a short time. We show an example of reference images and evaluated face images using the reference images.