The Proceedings of JSME annual Conference on Robotics and Mechatronics (Robomec)
Online ISSN : 2424-3124
2007
Session ID : 1P1-K06
Conference information
1P1-K06 Audio-Visual Speaker Detection in Human-Robot Interaction
Thatsaphan SUWANNATHATJun-ichi IMAIMasahide KANEKO
Author information
CONFERENCE PROCEEDINGS FREE ACCESS

Details
Abstract
Tracking humans' position is a useful skill for the coming generation of mobile robot. It is a challenging problem of planning and control in dynamic environment. We propose the omni-directional estimation method of speaker's position using the combination of audio and visual information. Estimation of the position of the sound is carried out to calculate the difference of arrival time from sound source to multi-channel microphones. The robust human template matching on the omni-directional image is employed to combine the result of sound source estimation to realize a highly accurate estimation of speaker's location. In our experiments, the systems were implemented and tested on an omni-directional robot at our laboratory. The results show that we are able to reliably detect and track moving objects in natural environment.
Content from these authors
© 2007 The Japan Society of Mechanical Engineers
Previous article Next article
feedback
Top