Supporting Cross-Modal Information Access to Facilitate Transience of Interest

Abstract

This paper proposes a system that intends to facilitate inducement of a user's interest by showing various types of information related to photographs. Our proposed system focuses on meta-data (e.g., date, place) attached to each information and uses them to link with another information. For instance, this system connects a news article and music with a photograph by using meta-data on "date." Similarly, the system connects two news articles in which a common named entity appears are connected each other, or two songs which the common singer has sung are connected each other. With the system, we conducted a user study to observe a user's behavior under unrestrained information exploration task. Based on the results obtained, we found that the user's knowledge and interests influence the difference in the frequency of access to information that has different modality, and that every user often access to information that has common date.