Remote Control System Based on Omnidirectional Vision Extraction by Head Orientation Detection

Abstract

In recent years, Virtual Reality (VR) and Augmented Reality (AR) have provided the conve- nience to human life in various fields such as video, games, cars and education. In addition, the research is also being conducted to support the movement of the elderly and disabled person using VR and AR in the medical field. In our laboratory, we aim to develop the omni-directional visual field extraction by detecting the head direction using human’s biological information and the remote-control system of moving vehicle. In this research, a fish-eye camera is mounted on an omni-directional mobile robot as the first step of this system, and it is displayed on a PC as an image of a field of view extracted from the surrounding 360 degrees environment. At this time, the head direction is measured by a 9-axis sensor attached to the human head, and the extraction control of the camera field of view based on the tilt angle of the head is performed. Furthermore, the operator controls the moving direction of the omni-directional mobile robot by the direction of the head. In order to verify the usefulness of this research, an omni-directional visual field extraction experiment by the head orientation using a real fish-eye camera and a 9-axis sensor is conducted, and these results are also reported.