A Fundamental Study on Hidden Surface Removal for Interactions between User’s Bare Hands and Virtual Objects in Augmented Reality

抄録

Augmented reality (AR) technology is a technique of superimposing information generated by a computer on perceptual information that we receive from real space. Recently, much attention has been focused on interaction techniques between users and virtual objects, such as the user directly manipulating virtual objects with his/her bare hands. On the other hand, in AR technology, since the 3-dimensional (3D) model is superimposed on the image of the real space afterwards, it is always displayed on the front side than the hand. Thus, it becomes an unnatural scene in some cases (occlusion problem). In this study, this system considers the object-context relations between the user's hand and the virtual object by acquiring depth information of the user's finger. In the evaluation experiment, it is confirmed that the hidden surface removal in this study not only makes it possible to consider the object-context relations but also can distinguish between finger boundaries and to clarify and process finger contours.