An Intuitive Gesture User Interface Using Natural Hand Motion

Abstract

To enable users to operate PCs naturally as if they communicated with human, we propose a novel hand gesture user interface (UI) that introduces natural sweeping hand motions for up/down/left/right commands. The natural sweeping hand motions differ among users in length and velocity, and consist not only of intentional movements in the direction desired but also unintentional movements in the direction not desired. To find similarities among users' natural sweeping hand motions, we analyzed them in a preliminary experiment and found that the velocity of an intentional movement is higher than that of an unintentional movement. Based on this knowledge, we developed a hand gesture UI that recognizes a movement whose velocity is higher than those of the movements occurring just before and just after it as an intentional movement, and introduces the direction of the intentional movement for commands. We had 20 novice users complete tasks by hand gestures without demonstrating a good example. Results of this experiment showed that our UI can recognize users' desired operations with the natural sweeping hand motions.