Development and validation of Japanese version of divergent association task

Translated Abstract

Divergent thinking (DT) has long been studied as a part of creative potentials; however, the extensive scoring process for DT poses issues. A recent solution gaining attention is automated scoring by calculating semantic distance. The divergent association task (DAT), a simplified version of the existing DT task, allows participants to engage in DT tasks within a shorter time, with immediate and automatic scoring. This study developed and validated the Japanese version of the DAT (DAT-J). Twelve candidate word vectors derived from the Japanese corpus were prepared to calculate DAT scores, and three surveys were conducted to examine the validity and reliability of the DAT-J. In Survey 1, 95 art majors completed an online questionnaire, including the DAT-J and creativity-related scales. Because Survey 1 revealed that the DAT-J may include inappropriate responses for automatic scoring, we modified the DAT-J instructions and developed a web application to validate inappropriate responses. In Survey 2, 358 students participated in the modified version of the DAT-J, the existing DT tasks, and the creativity-related questionnaire. The DAT-J was retested two weeks later. In Survey 3, an experiment was conducted comparing DAT-J responses by handwritten, web app, and web app with validation. Survey results demonstrate the basic validity and reliability of the DAT-J, underscoring its potential utility for assessing DT. Furthermore, the DAT-J answering format did not affect DAT scores. Finally, limitations of the DAT-J and future improvements for measurement accuracy were discussed.

References

•  Acar,  S., &  Runco , M. A. (2014). Assessing associative distance among ideas elicited by tests of divergent thinking. Creativity Research Journal, 26 (2), 229–238. https://doi.org/10.1080/10400419.2014.901095
•  Acar,  S., &  Runco , M. A. (2019). Divergent thinking: New methods, recent research, and extended theory. Psychology of Aesthetics, Creativity, and the Arts, 13 (2), 153–158. https://doi.org/10.1037/aca0000231
• 秋山 哲史・内海 彰(2010). 概念間の関係に関する単語の意味空間の性質：コーパス, 構築手法, 文章単位による影響　認知科学, 17 (1), 110–128. https://doi.org/10.11225/jcss.17.110
•  Batey,  M. (2007). A psychometric investigation of everyday creativity [Unpublished Doctoral Thesis]. University College London.
•  Batey,  M., &  Furnham,  A. (2008). The relationship between measures of creativity and schizotypy. Personality and Individual Differences, 45 (8), 816–821. https://doi.org/10.1016/j.paid.2008.08.014
•  Beaty , R. E., &  Johnson , D. R. (2021). Automating creativity assessment with SemDis: An open platform for computing semantic distance. Behavior Research Methods, 53 (2), 757–780. https://doi.org/10.3758/s13428-020-01453-w
•  Beaty , R. E.,  Zeitlen , D. C.,  Baker , B. S., &  Kenett , Y. N. (2021). Forward flow and creative thought: Assessing associative cognition and its role in divergent thinking. Thinking Skills and Creativity, 41, 100859. https://doi.org/10.1016/j.tsc.2021.100859
•  Ding,  G.,  He,  Y.,  Yi,  K., &  Li,  S. (2024). Using the divergent association task to measure divergent thinking in Chinese elementary school students. Thinking Skills and Creativity, 52, 101503. https://doi.org/10.1016/j.tsc.2024.101503
•  Dumas,  D.,  Organisciak,  P., &  Doherty,  M. (2021). Measuring divergent thinking originality with human raters and text-mining models: A psychometric comparison of methods. Psychology of Aesthetics, Creativity, and the Arts, 15 (4), 645–663. https://doi.org/10.1037/aca0000319
•  Grabe,  E.,  Bojanowski,  P.,  Gupta,  P.,  Joulin,  A., &  Mikolov,  T. (2018). Learning word vectors for 157 languages. Proceedings of the 11th International Conference on Language Resources and Evaluation, 3483–3487. https://aclanthology.org/L18-1550
•  Grajzel,  K.,  Acar,  S., &  Singer,  G. (2023). The Big Five and divergent thinking: A meta-analysis. Personality and Individual Differences, 214, Article 112338. https://doi.org/10.1016/j.paid.2023.112338
•  Guilford , J. P. (1967). The nature of human intelligence. McGraw-Hill.
•  Haase,  J.,  Hoff , E. V.,  Hanel , P. H. P., &  Innes-Ker,  Å. (2018). A meta-analysis of the relation between creative self-efficacy and different creativity measurements. Creativity Research Journal, 30 (1), 1–16. https://doi.org/10.1080/10400419.2018.1411436
•  Hubert , K. F.,  Awa , K. N., &  Zabelina , D. L. (2024). The current state of artificial intelligence generative language models is more creative than humans on divergent thinking tasks. Scientific Reports, 14 (1), Article 3440. https://doi.org/10.1038/s41598-024-53303-w
• 猪原 敬介・楠見 孝 (2011). 潜在意味解析に基づく概念間類似度の心理学的妥当性：言語統計解析アプローチの効用と限界　心理学評論, 54 (2), 101–122. https://doi.org/10.24602/sjpr.54.2_101
•  Ishiguro,  C.,  Matsumoto,  K.,  Agata,  T., &  Okada,  T. (2022). Development of the Japanese version of the Short Scale of Creative Self. Japanese Psychological Research, 66 (3), 302–314. https://doi.org/10.1111/jpr.12418
•  Ishiguro,  C.,  Matsumoto,  K.,  Agata,  T., &  Okada,  T. (2024). Development of the Japanese Version of the Inventory of Creative Activities and Achievements [Manuscript submitted for publication]. Department of Psychology, University of the Sacred Heart.
•  Ishiguro,  C.,  Sato,  Y.,  Takahashi,  A.,  Abe,  Y.,  Kato,  E., &  Takagishi,  H. (2022). Relationships among creativity indices: Creative potential, production, achievement, and beliefs about own creative personality. PLoS ONE, 17 (9), Article e0273303. https://doi.org/10.1371/journal.pone.0273303
• 石黒 千晶・鈴木 崇太朗(2022). 拡散的思考課題の採点自動化の試み：Divergent Association Task 日本語版の開発　日本電子情報通信学会技術報告, 122 (166), 18–20.
•  Lakens,  D. (2017). Equivalence tests: A practical primer for t tests, correlations, and meta-analyses. Social Psychological and Personality Science, 8 (4), 355–362. https://doi.org/10.1177/1948550617697177
• 真鍋 陽俊・岡 照晃・海川 祥毅・髙岡 一馬・内田 佳孝・浅原 正幸 (2019). 複数粒度の分割結果に基づく日本語単語分散表現　言語処理学会第 25 回年次大会発表論文集, 1407–1410.
• 松野 省吾・水木 栄・榊 剛史 (2019). 日本語大規模 SNS+Web コーパスによる単語分散表現のモデル構築　第 33 回人工知能学会全国大会論文集, 4Rin113. https://doi.org/10.11517/pjsai.JSAI2019.0_4Rin113
•  Olson , J. A.,  Chmoulevitch , N. D.,  Cropper , S. J., &  Webb , M. E. (2021). Naming unrelated words predicts creativity. Proceedings of the National Academy of Sciences, 118 (25), Article e2022340118. https://doi.org/10.1073/pnas.2022340118
• 小塩 真司・阿部 晋吾 (2012). 日本語版 Ten Item Personality Inventory (TIPI-J) 作成の試み　パーソナリティ研究, 21 (1), 40–52. https://doi.org/10.2132/personality.21.40
•  Patterson , J. D.,  Merseal , H. M.,  Johnson , D. R.,  Agnoli,  S.,  Baas,  M.,  Baker ,  B. S.,  Barbot, B.,  Benedek,  M.,  Borhani,  K.,  Chen,  Q.,  Christensen , J. F.,  Corazza , G. E.,  Forthmann,  B.,  Karwowski,  M.,  Kazemian,  N.,  Kreisberg Nitzav,  A.,  Kenett , Y. N.,  Link,  A.,  Lubart,  T.,  ...  Beaty, R. E. (2023). Multilingual semantic distance: Automatic verbal creativity assessment in many languages. Psychology of Aesthetics, Creativity, and the Arts, 17 (4), 495–507. https://doi.org/10.1037/aca0000618
•  Pennington,  J.,  Socher,  R., &  Manning,  C. (2014). GloVe: Global Vectors for word representation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), 1532–1543. https://doi.org/10.3115/v1/D14-1162
•  Puryear , J. S.,  Kettler,  T., &  Rinn , A. N. (2017). Relationships of personality to differential conceptions of creativity: A systematic review. Psychology of Aesthetics, Creativity, and the Arts, 11 (1), 59–68. https://doi.org/10.1037/aca0000079
•  Puvia,  E.,  Taibi,  D., &  Tressoldi,  P. (2022). The role of masked solutions in the accuracy of an insight problem-solving task. Journal of Anomalous Experience and Cognition, 2 (1), 144–157. https://doi.org/10.31156/jaex.23304
•  Reiter-Palmon,  R.,  Forthmann,  B., &  Barbot,  B. (2019). Scoring divergent thinking tests: A review and systematic framework. Psychology of Aesthetics, Creativity, and the Arts, 13 (2), 144–152. https://doi.org/10.1037/aca0000227
•  Runco , M. A., &  Acar,  S. (2012). Divergent thinking as an indicator of creative potential. Creativity Research Journal, 24 (1), 66–75. https://doi.org/10.1080/10400419.2012.652929
•  Said-Metwaly,  S.,  Taylor , C. L.,  Camarda,  A., &  Barbot,  B. (2022). Divergent thinking and creative achievement: How strong is the link? An updated meta-analysis. Psychology of Aesthetics, Creativity, and the Arts. Advance online publication. https://doi.org/10.1037/aca0000507
• 創造性心理研究会 (編) (1969). S-A 創造性検査〈A 版〉 東京心理
•  Suzuki,  M.,  Matsuda,  K.,  Sekine,  S.,  Okazaki,  N., &  Inui,  K. (2018). A joint neural model for fine-grained named entity classification of wikipedia articles. IEICE Transactions on Information and Systems, E101.D (1), 73–81. https://doi.org/10.1587/transinf.2017SWP0005
• 田口 雄哉・田森 秀明・人見 雄太・西鳥羽 二郎・菊田 洸 (2017). 同義語を考慮した日本語の単語分散表現の学習　情報処理学会研究報告, 2017-NL-233 (17), 1–5.
•  Takeuchi,  H.,  Taki,  Y.,  Sassa,  Y.,  Hashizume,  H.,  Sekiguchi,  A.,  Fukushima,  A., &  Kawashima,  R. (2010). Regional gray matter volume of dopaminergic system associate with creativity: Evidence from voxel-based morphometry. Neuroimage, 51 (2), 578–585. https://doi.org/10.1016/j.neuroimage.2010.02.078
•  Torrance , E. P. (1966). Torrance tests of creative thinking: Norms, technical manual. Research Edition. Verbal and figural tests (Forms A and B). Prentice Hall.
•  Wallach , M. A., &  Kogan,  N. (1965). Modes of thinking in young children. Holt, Rinehart & Winston.
•  Zeng,  L.,  Proctor , R. W., &  Salvendy,  G. (2011). Can traditional divergent thinking tests be trusted in measuring and predicting real-world creativity? Creativity Research Journal, 23 (1), 24–37. https://doi.org/10.1080/10400419.2011.545713