Japan Journal of Educational Technology
Online ISSN : 2189-6453
Print ISSN : 1349-8290
ISSN-L : 1349-8290
The Development of the Method to Revise an Evaluated Score in Considering of the Evaluator's Characteristic for a Peer Evaluation with Many Missing Responses(<Special Issue> Application and Aggregation of Learning Objects and Learning Data)
Yasuhiro FUJIHARAHitoshi OHNISHIHiroshi KATO
Author information
JOURNAL FREE ACCESS

2007 Volume 31 Issue 3 Pages 373-381

Details
Abstract
We proposed the method of revising an evaluated score in considering of the evaluator's characteristic for an impartial feedback in a peer evaluation. Because it is difficult to evaluate all learners, peer evaluation data include many missing responses. In the proposal method, we assumed the evaluators' characteristic modeling based on the item response theory, and the evaluated score is revised by using the difference of estimated evaluator's characteristic and the evaluator of an average evaluation. In the proposal method, we assumed the evaluators' characteristic modeling based on the item response theory, and an evaluated score is revised by using the difference of estimated evaluator's characteristic and the evaluator of an average evaluation. It was confirmed that the revised score was appropriate evaluation by real data. We practiced peer evaluation five times in our class. As a result of practice, it was found that the evaluators received feedback with revised score improved the evaluation ability, but the evaluator received only evaluation value before revision did not improved. Because the above-mentioned result, it was shown that proposed revision method was effective to an impartial evaluation and the improvement of the evaluation ability.
Content from these authors
© 2007 Japan Society for Educational Technology
Previous article Next article
feedback
Top