Human communication is inherently multisensory. This property has been applied to accessible
information systems via a human voice using the multimedia DAISY, and the information transmitted can be understood by many people. However, a part of persons with neuropsychological impairments with auditory-recognition difficulties cannot identifyreal voices. The clues for understanding the information remain unclear, and the true accessibility of transmitting information is not fully realized. I prepared parts of a picture book, sentences and illustrations of disaster-information, and combinations of both in a multimedia DAISY format, and asked if the persons could identify them. Although all subjects understood the book and the information combined, persons with non-impairments as well as those with heavy impairments used the sentences as clues to understand the information, and those with mild impairments used the illustrations. Most of the subjects understood speaking from a real person. The multisensory integration worked in a different manner between the multimedia DAISY and humans. It is important to understand the difference between the systems of the format and the human brain. However, the possibility of transmitted information in this format, being easy to control, is useful for improving the accessible-information transmission processes.
View full abstract