A Estimation method of light sorce enviroment in Augmented Reality by using range image

Abstract

In this paper, we propose a method to express the shade that be created on a virtual object placed in the environment by estimating the light source in the real environment using RGB-D sensor images. This method estimates albedo by performing clustering using the K-means method for the hue of color image and the normal map calculated from depth image. The virtual object is shaded by the irradiance map of the environment from this value, the diffuse components value, and the normal map. In this way, we aim to keep the optical consistency of virtual objects in augmented reality and improve the sense of reality without using objects or devices such as mirror spheres for estimating the light source near the observation target.