The Japanese Journal of Psychology
Online ISSN : 1884-1082
Print ISSN : 0021-5236
ISSN-L : 0021-5236
Methodological Advancements
Psychological assessments of paired-comparison and Likert formats:
Comparing their reliability, validity, and ease of answering questions
Seito NonodaKensuke Okada
Author information
JOURNAL FREE ACCESS

2023 Volume 93 Issue 6 Pages 526-535

Details
Abstract

Despite the widespread use of Likert scales for psychological assessments, problems of response biases —such as response style and social desirability biases —have been associated with this format. Questionnaires employing the forced-choice format, of which paired comparison is one of the most popular methods, have been drawing researchers’ attention as an alternative that is resistant to response biases. In the current study, we compared the assessments of the paired comparison and Likert formats in terms of their reliability, validity, and ease in answering questions using two psychological questionnaires. The results revealed that the Likert format was superior in terms of reliability and ease in answering, while the paired-comparison format exhibited better factorial validity. The questionnaire that contained a few reverse items underperformed in the paired-comparison, which requires due attention during scale development.

Content from these authors
© 2023 The Japanese Psychological Association
Previous article Next article
feedback
Top