Experimental Evaluation of Video Editing Based on Participants' Gaze for Face-to-face Multiparty Conversations

Abstract

This paper presents experiments conducted to evaluate a video editing rule based on participant's gaze for clearly conveying face-to-face multiparty conversations, such as meetings, to viewers. Systems that record meetings and those that support teleconferences are attracting considerable interest because of their potential for facilitating human communication, Conventional systems use a fixed-viewpoint camera and simple camera selection based on the participants utterances. Unfortunately, such systems fail to adequately convey who is talking to whom and nonverbal information about participants etc., to viewers. To solve these problems, we previously proposed a video editing rule that uses the majority decision of participants' gaze direction. This paper describes experiments in which videos of entire conversations with 3 participants were presented to viewers. The results confirm the effectiveness of our video editing rule.