Japanese Journal for Research on Testing
Online ISSN : 2433-7447
Print ISSN : 1880-9618
Assessment of the reliability and validity of psychological scale items generated by the ChatGPT
Kenichi SasakiHideki Toyoda
Author information
JOURNAL FREE ACCESS

2024 Volume 20 Issue 1 Pages 111-133

Details
Abstract

Item creation in psychology is a critical factor that significantly influences the outcome of research. The task of creating appropriate and reliable scale items requires a substantial amount of time and effort, presenting a challenge for many researchers. In recent years, with the advancement of AI, its application has expanded across various fields. However, the utilization of AI in creating psychological scale items has not yet been fully explored. This study attempts to generate psychological scale items using ChatGPT, assessing their reliability and validity based on actual response data. The results indicate that item generation using ChatGPT is promising. Furthermore, considerations for designing prompts to generate high-quality items were also discussed. This research presents new possibilities for psychological measurement methods, offering directions to enhance both efficiency and quality in scale development.

Content from these authors
© 2024 The Japan Association for Research on Testing
Previous article Next article
feedback
Top