Cognitive Studies: Bulletin of the Japanese Cognitive Science Society
Online ISSN : 1881-5995
Print ISSN : 1341-7924
ISSN-L : 1341-7924
Research Papers
Sequential Integration of Graphical and Linguistic Representation Systems
Ichiro UmataAtsushi ShimojimaYasuhiro KatagiriNaomi Inoue
Author information
JOURNAL FREE ACCESS

2008 Volume 15 Issue 4 Pages 573-587

Details
Abstract
An empirical investigation was conducted on the characteristics of language use in graphics communication settings. Graphics communications, such as dialogues using maps, drawings, or pictures, provide people with two independent systems of representation, spoken language and graphics. Drawing on our dialogue data, we show that the presence of a graphical representation significantly changes the way the spoken language is used, extending its expressive capacity in most cases. As two remarkable uses of language affected in this way, we report the phenomena of mediated reference and dual description, illustrating them with actual examples from our data. Further, a quantitative analysis of our data shows that these special uses of language are indeed as common as conventional uses of language in the presence of graphical representations.
Content from these authors
© 2008 Japanese Cognitive Science Society
Previous article Next article
feedback
Top