On Joint Estimation of Head Posture and Hands Behavior of Car Driver from Video Images of Two Cameras for Detection of Non-Safety Behavior

Abstract

Non-safety behavior in car driving such as smartphone operation, mobile phone call, etc. are major concerns that lead to heavy traffic incidents where the number of such incidents is increasing recently. This research proposes a method that jointly estimates head posture as observation action and hands behavior as one of the operation actions in a form of joint probability distribution based on state space modeling formulation. Source of information consists of two videos captured by facial camera and steering operation camera, where the facial camera is set over the steering column to capture frontal face image of a car driver and the steering operation camera is set above seatbelt roller to capture steering area. Furthermore, utility of the estimation result to detect non-safety behavior in car driving such as smartphone operation has been considered.