Abstract
This paper introduced the system design on user interface which will be used for human robot interaction in kukanchi (Interactive Human Space Design and Intelligence). This work is going to solve interaction issues in real 3D space thus developing a natural user interface focusing on system design prototype. Hand gesture based interface using multiple Kinect XBoxes as sensory device is applied in this research. The aim of this study is to analyze and design the system requirements as well as feedback so that it can improve the task delivery process by service robot in our daily life by using gesture.