«Invited Lecture»Multi-sensory Displays and Cross-modal Interaction

Abstract

The display technologies to create realistic sensation by generating stimuli corresponding to each sensory organ as measured from target to duplicate have been studied over a long period. And main approach for creating high-realistic experience is a "multi-modal" technique which combines these technologies. This is because perception is traditionally regarded as an independent modular function. On the other hand, recent studies in cognitive science are suggesting that cross-modal interactions have an important role in our perception. In cross-modal interactions, the perception of a sensation through one sense is changed by other stimuli that are simultaneously received through other senses. Indeed, some studies have shown that the possibility of "cross-modal" approaches for presenting ultra-realistic experience. In this paper, we introduce some examples of displays using cross-modal interactions.