VST HMD system that instantly switches between rescue robot-mounted viewpoint and operator viewpoint

Abstract

3D stereoscopic viewing system using a stereo camera and a HMD (Head Mounted Display) has been proposed as an information presentation system for operating a rescue robot. However, the HMD needs to be removed when the operator records the situation of the victim and obstacles on a recording sheet, which may cause stress to the operator and reduce the sense of realism. In this study, we focused on the fact that the VST (Video See-Through) HMD can see through the hardware to the real world, and constructed a system that instantly switches between the rescue robot-mounted viewpoint and the operator’s viewpoint. Experiments were conducted to compare the VST HMD and the HMD without VST in a task simulating the work required at a disaster site, and data were collected and statistically analysed on questionnaires regarding the time required for the task, recording accuracy, realism, and the user’s feeling of use.