Development of a Communication Support System for Non-verbal Information Using the Aura

Abstract

Building a system that supports enhancing communication understanding by presenting both verbal and non-verbal information accurately and in real-time through various tools is crucial for improving communication quality. Particularly for foreigners and individuals with disabilities, gestures and facial expressions containing non-verbal information can manifest uniquely, making them difficult to interpret. Therefore, this study examines the effects of conveying non-verbal information by displaying the emotions of the conversation partner as if an "aura" were emanating from them on devices such as tablets and wearable monitors. The results confirm that using the aura expression on a tablet is especially effective, and these findings are reported here.