A Pointing Device Using Hand and Fingers Equipped with a Multi-color Tracker

Abstract

We have developed a pointing device that trtanslates a handicapped person's movements of hand into direct movements of a computer's cursors arranged in a rectangular pattern. The actual key press (click) is implemented by moving the fingers inward. It replaces the desktop mouse or even the keyboard for people who can not use them. For sensitivity tuning of the cursor movement, coordinate transformation using the neurofuzzy adaptive modeling is employed. The click motion is replaced by moving the fingers inward and recognized by the neurofuzzy projection pursuit learning. A color tracker system for measurement of the positions of the fingers is used. An experimental study reveals that target tracking speed using the proposed rectangular placed multiple cursors is faster and the error rate is lower than for horizontally placed multiple cursors and a single point cursor.