Recent years, MR (Mixed Reality) systems have been used for virtual reconstruction of cultural heritage assets. In outdoor environment, it's difficult to achive the geometric consistency because of illumination changes and a lot of obstacles (occlusions). If the portions of the buildings still remain, it is advantageous to use 3d models obtained from the remained objects to solve these issues. Therefore, we propose a robust method to achieve geometric consistency between real and virtul objects under various illumination conditions by using 3D geometric models. The experimental results in which the proposed method is applied to reconstruct the Roman cultural heritage site show the effectiveness of our method.
