Detection of overhanging and dead branches from in-vehicle camera footage using object detection and image generation AI

Abstract

In this study, we focused on overhanging branches along mountain roads and dead branches caught in them, aiming to automate and improve the efficiency of inspection tasks by applying deep learning to vehicle-mounted camera footage. Specifically, overhanging branches were detected using the object detection model YOLO, followed by a two-stage process in which the presence of dead branches was determined using an image classification model. To address the lack of training data for dead branches, we employed image generation AI to produce images under various environmental conditions, thereby improving classification accuracy. Furthermore, the detection results were visualized on a map, enabling spatial recognition of hazardous locations and optimization of inspection planning. These results demonstrate that the proposed system, which integrates object detection, image classification, image generation AI, and map visualization, has the potential to reduce workload and enhance safety in future infrastructure maintenance operations.