Abstract
This study focuses on the validity of objective rating indices to an automated essay-scoring system for task-based writing tests. The relationship between the holistic ratings of Accuracy and Communicability tasks and their objective indices was examined. Independent variables to measure the holistic ratings were chosen from existing objective indices based on the constructs of each task: organizational skills, linguistic accuracy, communicative quality and effects. As a result of the correlation analyses, a moderately high correlation was found to exist between the holistic ratings of the Accuracy task and its indices (tokens and type levels). A moderately high correlation was also found between the holistic ratings of the Communicability task and its indices (type levels and relevant ideas). Through multiple regression analysis, the scores of each task could be predicted with moderately high dimensional accuracy. These findings were discussed with regard to the usefulness and improvement of the automated essay-scoring system.
