テスト形式がテストパフォーマンスに与える影響 : 多肢選択式リスニングテストにおける質問文と選択肢の提示様式

抄録

This paper presents an analysis of whether performance in multiple-choice (MC) listening tests is influenced by the way in which questions and options are presented. We developed four test formats and analyzed the performance of our study participants-219 Japanese university students-having taken different formats of the tests. The results of the study demonstrated that the way in which questions were presented significantly affected test-taker performance-listeners performed better when questions were presented in writing rather than verbally. The second part of this study examined which characteristics of a test item (text, question, and options) were related to item difficulty in the context of our different test formats. Our results indicated that text-related variables (infrequent vocabulary, lexical diversity, word familiarity, grammatical complexity, text length, and speaker's role) were significantly correlated with item difficulty regardless of which test format was used and that task-processing variables (explicitness of question, necessary information, and lexical overlap between text and questions) were significantly correlated with specific formats. The implications of these findings on test validity are discussed.