Early Recognition and Prediction of Gestures for Embodied Proactive Human Interface

Abstract

This paper concerns three topics for realizing embodied“proactive”human interface, where a humanoid is used as an interface capable of making some reaction against to user's gesture input in advance to the termination of the gesture. The first topic is early recognition of gestures: the recognition result of a gesture is provided at the beginning part of the gesture. The second topic is motion prediction: the subsequent posture of the person who makes a gesture is predicted by using the result of early recognition. The third topic is a network model constructed for improving the performance of early recognition and motion prediction. The effectiveness of these methods was shown by experimental results.