Generation Method of Augmented Reality Video based on the Estimation of Real Light Sources

Abstract

In Augmented Reality (AR), which is a technique to display virtual objects in the real space, the shadow of a virtual object cannot be displayed correctly unless real light sources are correctly estimated. In this paper, we propose a method that can estimate the directions of multi light sources by using pattern matching between the shadow of a 3D marker and shadow images in database even if the camera and the marker move. It can be possible to have AR optically correct by drawing the shadow of the virtual object based on the information of the position and the posture of the marker and the results estimated for the light source directions.