Multimodal Interaction Aware Integrated Platform to Support CSCL Systems Life-Cycle

Abstract

A number of studies in the research field of CSCL (computer supported collaborative learning) have proposed various systems in order to support collaborative learning process. In collaborative learning, participants exchange not only verbal but also non-verbal cues such as gaze and posture. In order to realize CSCL systems that can treat a form of multiparty multimodal interaction for different purposes accordingly to the learning objective, it is desirable to execute in a continuous and smooth way each activity in CSCL systems life-cycle. In this paper, we propose a novel integrated platform as the basis for multimodal interaction aware CSCL systems. Based on the CSCL system development environment in our previous research, we develop an analysis support environment to support multimodal interaction analysis activities. The environment allows analysts 1) to utilize basic functions that support multimodal interaction analysis without excessive burden, and 2) to analyze collaborative learning session data detected from CSCL systems on our proposed platform including verbal and non-verbal information in addition to developers’ defined learning messages in an integrated way.