Abstract
We have been developing Assistive MObile Robot System (AMOS), which helps a daily life of physically handicapped persons. The aim of AMOS is to replace only simple tasks that to transport daily use objects in the indoor environment semi autonomously. If the operator chooses the object to be transported in the environment, then AMOS approaches to the objects, pick up it, and finally relocate it in the designed location. To allow the user to operate AMOS easily, we have been developing vision based user interface which accepts the gesture of the operator as a command. As a first step, only simple gesture clipping is implemented and evaluated.