Real time tracking of the fingertip for the manipulation of the virtual object

Abstract

There is a research for an augmented desk type interface system that offers the environment that manipulates both a virtual object projected and a real object on the desk with their own hands. As an application of this system, the tool drawing and moving figures on the desk with fingertips was suggested. In this paper, aiming at the construction of the above system, we propose a method for manipulating the virtual object on the monitor, while tracking the fingertip using local correlation matching between successive image frames. We consider the software algorithm for moving and rotating the virtual objects.