Examining the Inter-rater Reliability of Recruitment Interview

Abstract

This report examines inter-rater reliability of recruiting interview for new graduates based on existing data of Japanese company A. Same organization and same grade: From low to high inter-rater reliability is shown at non-administrative staff grade, while less reliability is shown at manager grade. Different organization and same grade: From low to high reliability is shown at nonadministrative staff grade, while less reliability is shown at manager grade. Same organization and different grade: No reliability is shown at business department, while from slight to high reliability is shown at human resource department. Different organization and different grade: From slight to high reliability is shown at almost pairs. Inter-board members: From slight to high reliability is shown. Those reliability coefficients shown in this research are much lower than previous studies.

Also, this report examines the different between coefficients and methods for reliability, and notify advantages and risks to evaluate inter-rater reliability with each way.