Video See-through MR System with Binocular Parallax Using Smart Phone

Abstract

Video see-through type head mount displays for mixed reality systems are generally large and expensive. Moreover, they aren’t suitable for outdoor use because they should be connected to personal computers. Therefore, we developed a new smartphone-based MR system, in which a 3D prism for taking a stereo video was attached to the camera of the smartphone, and the obtained video was projected on a plane in Unity’s scene. Two character models were placed in front of the plane to produce parallax. The scene was taken with a virtual camera and displayed on the LCD of the smartphone. When the smartphone was housed in VR goggles, the real world and the virtual world both of which had binocular parallax, looked mixed.