Development of Failsafe Camera System for Fastening Work in Manufacturing Scene

Abstract

Human error prevention is one of the most important things as for improvement of product quality and productivity. In order to prevent human errors, it is necessary to detect them. In this paper, we propose a novel method based on image information as for detecting human errors. In proposed method, first, we segment a video sequence of work operation into basic motion elements by using changes of the motion speed and the motion direction distribution extracted from the video sequence. Specifically, we extract the motion scale and the motion direction histogram as the motion feature in a frame. And then we detect human errors by evaluating the number of operation and the order of operation from the sequence of basic motion elements. In experiments, we applied proposed strategy to fastening bolts works in the real process of assembling cars, and verified effectiveness of proposed method.