Evaluating Sensor Placement and Gesture Selection for Mobile Devices

Abstract

Mobile phones and video game controllers using gesture recognition technologies enable easy and intuitive operations, such as scrolling browser and drawing objects. However, usually only one of each kind of sensor is installed in a device, and the effect of multiple homogeneous sensors on recognition accuracy has not been investigated. Moreover, the effect of the differences in the motion of a gesture has not been examined. We have investigated the use of a test mobile device with nine accelerometers and nine gyroscopes. We captured data for 27 kinds of gestures for a mobile tablet. We experimentally investigated the effects on recognition accuracy of changing the number and positions of sensors and the number and kinds of gestures.