Life support behavior based on understanding the relationship between situation change and sound using look-around motion for unknown sound

Abstract

In recent years, life support by robots is expected because aging is advancing. In order to perform object manipulation or action determination, situation recognition function that acquires information from the outside world is firstly required. In particular, when performing situation recognition, visual and auditory senses are very important factors. In this paper, we proposed the audio recognition system focusing on sound lengths and the visual recognition focusing on object states. In addition, we focused on learning the relationship autonomously between what robot is looking and what robot is hearing. We have introduced the system that robots can be looking for the cause when they are hearing an unknown sound, and have realized the life support behavior based on sound.