In recent years, automation of construction and civil engineering industry sites is highly demanded. In particular, ``excavation and loading'' is an essential task that is achieved with a collaborative work between backhoes and dump trucks. For the automation of the work, backhoes need information of soil condition inside the truck bed such as volume, shape and position of the soil loaded in the bed. For example, overloaded soil causes collapse from the truck bed while moving. That is why these kinds of information is necessary for backhoes to achieve the loading task efficiently. In this paper, we propose a method to measure soil in the truck bed while the loading work to obtain the volume and the shape of loaded soil and to locate the position to load next. Especially, in order to measure the inside of the truck bed with high accuracy, we constructed a system to measure the loaded soil directly from a backhoe. We measure inside truck bed from multiple views while loading by mounting multiple sensors on the arm and on the cabin of the machinery. The performance of the proposed system is validated in an experiment with actual construction machineries at a test field.
View full abstract