Aim: Despite the established reliability of multiple mini-interviews (MMIs), some studies have questioned the practicability of setting approximately seven or more stations and of administering them “all-at-once”. Besides, limited evidence exists of MMIs' reliability related to (a) interview time and (b) two interview question types: situational questions (SQs) and past-behavioral questions (PBQs). This study investigated reliability of a competency-based, applicant-centered, SQ/PBQ-based postgraduate MMI with fewer stations and longer interview time.
Methods: To recruit trainees into Japan's Basic Postgraduate Clinical Training at a local teaching hospital, 16 physician competencies were identified, and of those, six were selected using social science techniques. With these, a “three-station, two examiners per station” MMI was developed. The MMI was administered on a “first come, first serve” (“on-demand”) basis over six months annually. Analysis periods comprised 2013-2014 (Phase I), 2015 (Phase II), and 2016-2019 (Phase III), which represented the per-station question formats of “one PBQ then one SQ fixed order, each lasting eight minutes”, “one PBQ/one SQ alternated, each lasting eight minutes”, and “only one PBQ, lasting 12 minutes”, respectively. Generalizability studies were performed to determine reliability of the MMIs.
Results: The MMIs in Phase I and II exhibited a generalizability coefficient (G. Coef.) of 0.844 and 0.735, respectively. The PBQ and SQ formats in Phase I exhibited a G. Coef. of 0.870 and 0.868, respectively. The PBQ and SQ formats in Phase II exhibited a G. Coef. of 0.742 and 0.754, respectively, and the PBQ format in Phase III exhibited a G. Coef. of 0.889.
Conclusion: The present study demonstrated favorable reliability of a competency-based, applicant-centered, SQ/PBQ-based postgraduate MMI with fewer stations and longer interview time. Both SQ- and PBQ-based stations showed equal reliability. However, the highest reliability was found with the station format of single PBQ and longer interview time.
抄録全体を表示