A Three Dimensional User Interface for Handling Virtual Objects

Abstract

This paper describes an interactive user interface method for handling and modeling virtual objects based on a user's finger motion, and a prototype user interface system, consisting of a binocular stereo display, a set of TV cameras, and two workstations. One of the workstations inputs the images of the user's fingers from the cameras, and estimates the three-dimensional finger motions. Based on the detection of the finger instructions, the other workstation interactively controls the three-dimensional motions and material and lighting properties of objects' geometric models, and presents them to the user through the binocular display. Experimental results using the system are also shown.