Recognition System of Hand Signals of a Police Officer for Automated Driving

Abstract

We developed a method to recognize such hand signals from on-vehicle camera, based on deep-learning technique. The skeleton coordinate of the performer is input to a deep learning method, to classify the signal state into Red/Green or Red/Green/Other. From the state and the continuation conditions, the instruction Stop/Go is determined. Our preliminary experiment proved that quite similar short actions are included both in Red and Green, and it is better to separate such actions as “Other”. In the final result, Stop/Go can be appropriately determined, and at the same time, the temporal difference of estimation between switching Stop/Go （Too-early Go and Too-late Stop） was less than 0.43 seconds.