A Tool for Encouraging Embodied Perception by Sonification of Landscape in Cycling

Abstract

The present paper discusses how to encourage embodied perception of landscape, and advocates that real-time synaesthetic sonification is effective for promoting user's landscape comprehension. Embodied perception is known as one of the tacit knowledge, therefore exploring it is difficult. To solve this problem, in this paper we focused on the feature of auditory sense. For example, people can recognize the information automatically when they are hearing sound. Moreover, auditory information can provide us a minuter change than visual information. We constructed two systems named "ChariMusic" and "ChariMelody" that synthesis the music from scenery information based on image processing. A practical experiment in cycling shows that sonification makes participants deepen the spatial experience.