A Simple Solution of Occlusion Problem in Augmented Reality and its Application for Interaction

Abstract

In this paper, we propose a simple solution of the occlusion problem in Augmented Reality(AR). In a desktop AR system, virtual objects are sometimes drawn on a user's hand even if the hand is closer to the user than the virtual objects. In interactive applications, this becomes a problem because the users cannot view their own hands during the interaction. Our method simply compares the input image with a pre-stored marker image and extracts the hand regions. We also implemented an interaction method by using the result of hand extraction. Experimental results show that this interaction method is more natural than the traditional GUI method in a desktop AR environment.