Abstract
In recent years, introduction of autonomous mobile robots which support humans in environments close to our life is expected. Examples are shopping support robots and porter robots carrying the luggage while accompanying the person. To utilize these robots, real time movement directive to the robots is important. In this paper, we propose a mobile robot system which performs the actions by recognizing the number of fingers. The robot recognizes the number of fingers from images obtained with a stereo camera system. Also, as one of the actions, the mobile robot tracks human who is attaching the mark. We verified the validity of the system by using a wheel mobile robot in indoor environment.