Abstract
PURPOSE: We devised and examined the reliability and validity of a trial version of the TEAM-P2016v rubric
designed to evaluate the teaming process of university students participating in cooperative learning. METHODS: The subjects were 69 second-year nursing students, who were evaluated by three raters. The observational method using the trial rubric was implemented in group exploration-based cooperative learning settings in August 2016. The students were asked to complete an anonymous questionnaire. RESULTS: The inter-rater reliability intraclass correlation coefficient was 0.792, the generalizability coefficient (G coefficient) was 0.8197, the alpha coefficient of reliability found by categorical principal component analysis of internal consistency was 0.882, and the correlation matrix coefficient ranged from 0.473 to 0.840, all of which met reference values. The criterion-related validity was used as a reference value to confirm the correlation coefficient between student self-evaluation scores and other scales (0.241—0.413). CONCLUSIONS: Despite residual issues with criterion-related validity, the TEAM-P2016v trial version was considered applicable as an evaluation index of teaming process performance.
