Palmtop AR Interface That Enables Additional Manipulation of Displayed Objects by Finger Motion

Abstract

In this paper, we propose an AR interface that enables additional manipulation of displayed objects via finger motions while displaying the object based on palm posture. The palm posture is estimated by the proposed AR interface based on the feature-points that are robust against the variation of hand silhouettes depending on finger motion. By utilizing the difference of hand silhouettes depending on the motion of five fingers, we provide the additional manipulations of a displayed object for the AR interface. We evaluate the drawing accuracy and processing time of the proposed interface under the condition that a hand includes successive changes of its posture and finger motion. Additionally, to confirm the feasibility of the proposed AR interface, we evaluated the manipulation with two prototype applications that utilize the difference of hand silhouettes depending on finger motion. The experimental results show that the proposed AR interface has the abilities to switch objects displayed on a palm and to change the transparency of a displayed object.