Cross-media retrieval system based on association between heterogeneous media

Abstract

Among the current information retrieval systems, generally the search query and the retrieval target are the same media type, such as using keyword query for retrieving documents, or using image query for retrieving similar images. In order to search and collect desired information between different kinds of media, it is necessary to retrieve across various media types, without being constrained by the media type of the search query and the retrieval target. The authors have developed a prototype system that is able to achieve cross-media retrieval by associating between different types of media via multimedia which composed text, image, or sound.