Proceedings of the Annual Conference of JSAI
Online ISSN : 2758-7347
37th (2023)
Session ID : 1N4-GS-10-05
Conference information

Exploring Objective Metrics for Measuring Concentration and Interest in Children's Online Communication using AI-Assisted Facial Expression Analysis
*Genta ITOKyohei NISHIMURAYuki NISHIMURAYoshitake KITANISHI
Author information
CONFERENCE PROCEEDINGS FREE ACCESS

Details
Abstract

Speech-language-hearing therapists sometimes provide therapy for children with speech and hearing difficulties to improve their communication skills. However, there can be problems such as the need to attend therapy sessions at an institution. The aim of this study is to explore an objective metrics that reflects the degree of concentration and interest during online communication, using videos. A total of 57 videos during online communication obtained from 19 children were input to a facial expression recognition AI model, and the proportion of emotions in each video was output. Additionally, we conducted a survey to assess the children's concentration and interest levels during communication. We compared the results of the AI model analysis and the results of the survey. The results showed a weak to moderate correlation between the proportion of time recognized as "Happiness" by the AI model and the proportion of time when faces were not detected, with the children's degree of concentration and interest. It is suggested that these outputs from the AI model can serve as objective metrics for measuring the degree of concentration and interest during online communication for children.

Content from these authors
© 2023 The Japanese Society for Artificial Intelligence
Previous article Next article
feedback
Top