Zero-shot high-risk situation detection based on object detection and pose estimation using fixed camera at construction site

Abstract

In this study, we propose a zero-shot high-risk situation detection method based on object detection and pose estimation using a fixed camera, aimed at preventing labor accidents at construction sites. By utilizing pre-trained object detection models and pose estimation models, our proposed method determines two high-risk situations: when a worker is unaware of an approaching vehicle, and when a worker is in the roadway. Our proposed method enables the detection of high-risk situations and is expected to enhance safety awareness among workers and managers by providing statistical information such as the time of occurrence and frequency of the detected high-risk situations. At the end of this paper, we verify the effectiveness of the proposed method through experiments using the videos taken at the entrance and exit of a construction site.