Abstract
The use of non-contact information to estimate the psychological state is becoming popular as a new technology to support communication, particularly with the development of information devices and the impact of COVID-19. However, facial expressions and emotions are influenced by culture, situations, and individual differences. Therefore, it is difficult to estimate the emotional arousal interval using facial expressions alone. Hence, it is necessary to include physiological changes such as facial skin temperature. Previous studies have shown that changes in the skin temperature occur in the nose, right cheek, and left cheek during positive emotional arousal. Moreover, for estimating emotional arousal using thermal and visible images of faces, the facial thermal images evidently deliver better results than the visible images. However, for practical use, it is necessary to focus on time-series changes and conventional methods have not yet been developed. In addition, results combining thermal and visible images have not been presented to date. In this study, we propose a method for estimating the intervals between aroused and unaroused emotions using long short-term memory and chronological skin temperature changes in the nose, right cheek, left cheek, and mouth angle.
https://ror.org/03hv1ad10 
