2P1-F20 Audiovisual Situated Recognition and Reasoning Based on Recognition History of Life Sound and Human Existence of Daily Supporting Humanoids

Abstract

Humanoid robots in daily supporting at home need to have not only behavior control system based on human instruction but also autonomous behavior selection system. To realize it, situation recognition capability is necessary. In this paper, we propose situation recognition system based on history of recognition of daily life sound and visual recognition of human existence. In this system, a key point for situation recognition is to use time series of recognition history. Also daily life sound represents environmental changes. So, humanoids can recognize robustly environmental situation through integrating comparatively long-term information obtained from real world. As an example of situation recognition, we show a case targeting a human in a kitchen.