2015 Volume 44 Issue 1 Pages 106-112
Previous work on virtual object manipulation by a real object in an augmented reality (AR) environment mainly focuses on a rigid object as the real object. If a human hand is considered as the real object, direct manipulation of virtual objects by the real human hand is realized. For virtual object manipulation by a human hand, its position and posture in the real environment need to be obtained. However, measurements of those position and posture often include some errors regardless of the measuring method. Moreover, the user often fails to grasp a virtual object properly even by his/her own hand especially when no haptic feedback is given. As the result, a non-negligible amount of geometric gap occurs between the human hand and the virtual object. In this article, we propose to replace the human hand with a virtual hand given by CG in an AR environment based on a video see-through display so that the position and the posture of the hand can be modified, while keeping the consistency between the virtual hand and the rest of the human body appearing in the AR environment by making their positions coincide with each other at the wrist.