SICE Journal of Control, Measurement, and System Integration
Online ISSN : 1884-9970
Print ISSN : 1882-4889
ISSN-L : 1882-4889
Special Issue on SICE Annual Conference 2019
In-Vehicle Device Control System by Hand Posture Recognition with Movement Detection Using Infrared Array Sensor
Shigeyuki TATENOYiwei ZHUFanxing MENG
Author information

2020 Volume 13 Issue 3 Pages 148-156


Nowadays, with the development of automotive driving technologies, more and more functions and devices with control systems based on tactile, optical, and acoustic sensors are assembled into cars. However, these systems are faced with environmental limitations such as environmental noise and illumination conditions. Moreover, operations of these systems will cause lack of concentration on driving, which is a major cause of car accidents. In order to overcome these limitations, in this paper, an infrared array sensor is applied to construct a hand posture recognition system for in-vehicle device control. In the system, 10 kinds of target hand postures and posture movements toward four directions are combined to achieve the aim of the device selection and operations. The input images are separated into images with objects and without objects. Then, images in which object appears in boundary areas as well as blurred images are removed to improve the accuracy of the system. A convolutional neural network is applied as a classifier in order to realize the recognition of the 10 target hand postures and non-target postures for the in-vehicle device selection. After that, a detection method of the posture movement directions is applied for the device operations. Both indoor and in-vehicle experiments are conducted to verify the robustness of this system, and the results show that the proposed system can overcome the disadvantages of other systems and has a wide application with high accuracy.

Information related to the author
© 2020 The Society of Instrument and Control Engineers
Previous article Next article