Advantages and Challenges of Introducing Computer-Based Testing Based on Item Response Theory for the National Medical Licensing Examination

Abstract

　In this paper, from the standpoint of an expert in educational measurement, I clarified the problems of the current National Medical Licensing Examination and discussed the advantages and challenges of introducing computer-based testing (CBT) based on item response theory (IRT). The CBT is expected to contribute to improving the validity of the measurement in terms of construct representation by using a variety of question formats that are not available in the paper-based testing (PBT). In addition, by operating the test using an item pool, including equated items within the IRT framework, it is possible to continuously create tests that meet a certain quality by controlling difficulty and measurement accuracy and to compare scores on the common scale, even when the implementation schedule, implementation site, and examinee groups are different. On the other hand, the biggest challenges are doing detailed test planning in advance and building and maintaining an item pool.