Translated Abstract
In this study, we propose an overall self-instructional training support system and tested the effectiveness of a self-instructional text presentation interface using a speech bubble. While the automated generation of self-instructional texts could make the training more accessible, previous research shows that if the texts are not self-created, the effectiveness of the training decreases. To overcome this, we design an interface that displays a real-time video of the user’s face with superimposed speech bubbles containing self-instructional text. Through online experiments, we demonstrated that the interface enhances users’ internalization of the generated text, potentially improving the effectiveness of computer-assisted self-instructional training.
*1：名古屋大学大学院工学研究科
References
- [1] Rathnayaka, P., Mills, N., Burnett, D., De Silva, D., Alahakoon, D. and Gray, R.: A mental health chatbot with cognitive skills for personalised behavioural activation and remote health monitoring, Sensors, Vol. 22, No. 10, p. 3653 (2022).
- [2] Fitzpatrick , K. K., Darcy, A. and Vierhile, M.: Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial, JMIR mental health, Vol. 4, No. 2, p. e7785 (2017).
- [3] 田中乙菜，越川房子，松浦素子：自己教示訓練を用いたストレスマネジメントプログラムの検討―プログラムの効果と参加者による評価―，ストレス科学研究，Vol. 29, pp. 68–76 (2014).
- [4] Lowe , C. F. and Higson , P. J.: Self-instructional training and cognitive behaviour modification: a behavioural analysis 1, Applications of conditioning theory, Routledge, pp. 162–188 (2017).
- [5] Meichenbaum, D. and Goodman, J.: Training impulsive children to talk to themselves: a means of developing self-control., J. Abnorm. Psychol., Vol. 77, No. 2, p. 115 (1971).
- [6] Meichenbaum, D.: Cognitive modification of test anxious college students., J. Consult. Clin. Psychol., Vol. 39, No. 3, p. 370 (1972).
- [7] Bambara , L. M. and Gomez , O. N.: Using a self-instructional training package to teach complex problem-solving skills to adults with moderate and severe disabilities, Educ. Train. Ment. Retard. Devel. Disabilities, pp. 386–400 (2001).
- [8] 田中乙菜，白石智子，高梨有紀，越川房子：教示文作成法の違いによる自己教示訓練の効果比較（1），第69回日本心理学会大会論文集(2005).
- [9] Cohn, N.: Beyond speech balloons and thought bubbles: The integration of text and image, Semiotica, No. 197, pp. 35–63 (2013).
- [10] Kurahashi, T., Sakuma, R., Zempo, K., Mizutani, K. and Wakatsuki, N.: Retrospective speech balloons on speech-visible ar via head-mounted display, 2018 IEEE ISMAR-Adjunct, pp. 423–424 (2018).
- [11] Hyodo, K., Kubota, T., Sato, S. and Ogawa, K.: Self-Instructional Training Interface Using a Speech Bubble That Facilitates Users to Internalize the Automatically Generated Texts, 2024 IEEE 48th Annual COMPSAC, pp. 2089–2094 (2024).
- [12] Kanda, K., Tabata, T. and Yano, T.: ANALYZING THE MODIFIERS FOR THE EVALUATION OF PSYCHOMETRICS IN Kansei ENGINEERING, Journal of Japan Society of Kansei Engineering, Vol. 2, No. 2, pp. 49–56 (2002).
- [13] Gliem, J. A. and Gliem , R. R.: Calculating, interpreting, and reporting Cronbach’s alpha reliability coefficient for Likert-type scales, Midwest research-to-practice conference in adult, continuing, and community education, Vol. 1, pp. 82–87 (2003).
- [14] Cohen, J.: Statistical power analysis for the behavioral sciences, Routledge (2013).
