Abstract
A test should be reliable and valid enough for a test-taker to predict, assess, and/or judge his/her own test performance immediately after taking it. Based on this point of view, the present study investigated TOEIC[R]'s validity from the perspective of data on test-takers' post-test-taking psychological attitudes. The investigation involved the following three steps: (a) developing a self-assessment questionnaire as a tool for gathering data on participants' psychological attitudes, (b) conducting validation studies on the self-assessment questionnaire, and (c) examining the levels of matching; between TOEIC[R] test scores and test-takers' judgment on their test performance. Results indicated that both versions of the TOEIC[R] showed high reliability coefficients and the self-assessment questionnaire showed a high reliability coefficient. In order to examine the construct validity of the self-assessment questionnaires, principal component analyses were used. On the basis of the scree plot, a single factor solution was deemed appropriate for each of the two data, implying that the factor structure underlying each of the self-assessment questionnaires is unidimensional. Moreover, there are low to moderate correlations between each part of the TOEIC[R] and the item self-assessment questionnaire concerned, implying that the two self-assessment questionnaires are valid indicators of TOEIC[R] test scores.
