Unified Protocol-Based Multimodal Data Collection in Group Discussion

Abstract

In this research, a consortium was formatted by 11 university including Tokyo Denki University to collect multimodal dataset in group discussion (GD) by the unified experimental protocol. So far, multimodal dataset, movies and, audio data were collected from two types GD: brain storming (BS) and GD aimed at consensus building. During GD, ECG; EMG; acceleration and angular velocity of user’s body and head; light of sight; pulse signal were measured as multimodal dataset. In addition, emotional annotation or classification tags were labeled for each utterance to analyze communication skills. Collected dataset will be able to be used for various purposes.