Humans and Nature
Online ISSN : 2185-4513
Print ISSN : 0918-1725
ISSN-L : 0918-1725
What audio-visual clues do persons with neuropsychological impairments understand in cases with auditory-recognition difficulties?
̶Experimental investigations by the multimedia DAISY using real human voices
JOURNAL FREE ACCESS

2017 Volume 28 Pages 11-19

Details
Abstract

Human communication is inherently multisensory. This property has been applied to accessible information systems via a human voice using the multimedia DAISY, and the information transmitted can be understood by many people. However, a part of persons with neuropsychological impairments with auditory-recognition difficulties cannot identifyreal voices. The clues for understanding the information remain unclear, and the true accessibility of transmitting information is not fully realized. I prepared parts of a picture book, sentences and illustrations of disaster-information, and combinations of both in a multimedia DAISY format, and asked if the persons could identify them. Although all subjects understood the book and the information combined, persons with non-impairments as well as those with heavy impairments used the sentences as clues to understand the information, and those with mild impairments used the illustrations. Most of the subjects understood speaking from a real person. The multisensory integration worked in a different manner between the multimedia DAISY and humans. It is important to understand the difference between the systems of the format and the human brain. However, the possibility of transmitted information in this format, being easy to control, is useful for improving the accessible-information transmission processes.

© 2017 Museum of Nature and Human Activities, Hyogo
Previous article Next article
feedback
Top