Fatigue is an inevitable part of daily life, and as of 1999, 60 % of the working population in Japan was aware of fatigue. Furthermore, the use of electronic devices is increasing due to changes in lifestyle, starting with the COVID-19 in 2020, and the recent development of the information society. This is likely to cause additional fatigue in daily life and affect our lives. Therefore, we focus on facial expressions and speech utterances to estimate the degree of fatigue because they’re easily accessible features of the human body. Although fatigue estimation systems using speech recognition and image recognition have been studied and developed separately, those using both recognition results have not been developed yet. In this study, we aimed to develop a system that estimates the degree of fatigue of a user based on the results of each recognition technique, while using machine learning and both speech and image recognition techniques.
View full abstract