Translated Abstract
Captions play an extremely important role in helping Deaf and hard-of-hearing (DHH) people to understand the content of movie contents. However, it has been pointed out that the visual burden of simultaneously viewing movie contents and captions is significant, and that it is difficult to adjust the desired playback position. Therefore, we propose a novel game-type video viewing method, and develop a new system (captioNoveL). In this study, experiments were conducted using general video viewing-type materials with captions and our novel game-type materials for DHH students. Then, we analyzed the desirability of the educational materials and their learning behavior. The results of the questionnaire showed that the participants felt that they were able to proceed at their own pace with the novel game-type materials. On the other hand, some felt difficulty in operating the materials. Individual differences were also observed in the readability of captions and the sense of fatigue. Furthermore, quantitative analysis of learning behavior showed that the novel game-type materials allowed participants to actively select the locations they wanted to refer. In addition, learning behavior in which participants skipped contents they already know was observed.
References
- [1] 総務省：国内における視聴覚障害者のテレビ利用状況等に関する現状調査，https://www.soumu.go.jp/main_content/000156747.pdf（accessed 2024-07-13）（in Japanese）．
- [2] 新井達也，塩野目剛亮，若月大輔：聴覚障害学生向けノベルゲーム型オンデマンド教材に関する基礎的検討，電子情報通信学会技術研究報告，IEICE-121(142)，pp.11–16（2021）．(Arai, T., Wakatsuki, D., and Shionome, T.: Basic Study on Novel-Game Type On-Demand Learning Contents for Deaf and Hard of Hearing Students, TECHNICAL REPORT OF IEICE, 121 (142), pp.11–16 (2021). (in Japanese)).
- [3] 七邊信重：文化創造の条件―2つのゲーム「場」の文化生産論的考察から―，早稲田大学大学院文学研究科紀要，巻51，pp.65–73（2006）．(in Japanese).
- [4] 一般社団法人ダイアローグ・ジャパン・ソサイエティ：第三回コロナ禍における視覚・聴覚障害者の生活実態調査および当事者からの社会への提言，2021年2月2日，https://djs.dialogue.or.jp/news/20210202news/（accessed 2024-01-27） (DialogueJapan Society General Incorporated Association: Summary of the Third Survey on the Living Conditions of the Visually and Hearing Impaired during the COVID-19 Pandemic and Recommendations for Society from the People with Visual and Hearing Impairments, 2021/02/02)（in Japanese, machine translation）．
- [5] 吉田未来，磯田恭子，白澤麻弓，萩原彩子，中島亜紀子，石野麻衣子，関戸美音，三好茂樹，河野純大：オンライン会議における手話通訳・文字通訳実施方法に関する検討，筑波技術大学テクノレポート，28(1)，pp.29–35（2020）．(Yoshida, M., Isoda, K., Shirasawa, M., Hagiwara, A., Nakajima, A., Ishino, M., Sekito, M., Miyoshi, S., Kawano, S.: Effective Remote Sign Language Interpreting and Captioning in Online Meetings, National University Corporation Tsukuba University of Technology Techno Report Vol.28(1), pp.29–35 (2020). (in Japanese)).
- [6] 下中村武，田中星夏，中野光里，岸川加奈子，横田晋務，田中真理：音声情報の取得に困難のある学生への文字による遠隔情報保障に関する実践的検討─聴覚障害のある学生への支援から─，九州大学基幹教育院・基幹教育紀要．8，pp.69–87（2022）. (Shimonakamura, T., Tanaka, S., Nakano, H., Kishikawa, K., Yokota, S., Tanaka, M.: Remote supports on information and communication accessibility by realtime captioning for university students with difficulties in obtaining audio information: Support for students who are deaf or hard of hearing, Bulletin of KIKAN Education, Vol.8, pp.69–87 (2022). (in Japanese)).
- [7] 垂門伸幸，吉川雄也，山本敦也，脇坂紗帆，仲兼久知枝：オンデマンド配信の授業動画への字幕付与による情報保障の実践―聴覚障害のある学生への合理的配慮として―，高等教育フォーラム，Vol.11，53–58（2021）． (Tarekado, N., Yoshikawa, Y., Yamamoto, A., Wakisaka, S., Nakaganeku, C.: Report on Practice of Subtitle-Editing to Access Vocal Information of On-Demand-Class Videos to Accommodate Hearing Impaired Students, Forum of Higher Education Research vol.11, 53-58 (2021) (in Japanese)).
- [8] STRIKEWORKS：ティラノビルダー，https://b.tyrano.jp/（accessed 2024-07-17）．(STRIKEWORKS: TYRANOBUILDER, https://b.tyrano.jp/（accessed 2024-07-17）（in Japanese）.
- [9] STRIKEWORKS：ティラノスクリプト，https://tyrano.jp/（accessed 2024-07-17）. (STRIKEWORKS: TYRANOSCRIPT, https://tyrano.jp/（accessed 2024-07-17）（in Japanese）.
- [10] 小池翔太，藤川大祐，陳卓君，鈴木織江：教員養成学部授業におけるノベルゲーム開発ツールを用いた学生自身によるアプリ教材実装の試み–小学校外国語の事例–，人工知能社会における教育に関する実践的研究，千葉大学大学院人文公共学府研究プロジェクト報告書，346，pp.47–56（2019）．(Koike, S., Fujikawa D., Chen, Z., Suzuki, O.: Attempt to Making Educational Application Created by Students Themselves Using Novell Game Development Tools in a Class of Faculty of Education -In the Case of Foreign Language Lesson, Chiba University. Graduate School of Humanities and Studies on Public Affairs. Research Project Reports 346, pp.47–56 (2019))
- [11] 森祐太：ビジュアルノベル–「自分で物語を作れる」初級読解教材の開発 2018 Southeastern Association of Teachers of Japanese (SEATJ) CONFERENCE PROCEEDINGS，pp.214–226（2018）. (Mori, Y.: Increasing Reading Engagement: Application of a Visual Novel Game for Novice Learners, Southeastern Association of Teachers of Japanese (SEATJ) CONFERENCE PROCEEDINGS，pp.214–226（2018）（in Japanese）.
- [12] 内野智仁：インターネット・リテラシーを育むための学習支援教材の開発と実践～聴覚障害生徒を対象とした集団学習における教材の有効性～，日本教育工学会，第33回全国大会，1a–302–02，pp.297–298（2017）． (Uchino, T.: Development and Practice of Learning Support Materials for Improving Internet Literacy –Effectiveness of Learning Support Materials in Group Learning by Hearing Impaired Students–, The 33rd Annual Conference of the Japan Society for Educational Technology, 1a–302–02，pp.297–298（2017）(in Japanese)．
- [13] 内野智仁：聴覚障害教育用の非同期型eラーニング教材に関する研究―授業のビデオクリップと対話インタフェースを用いた学習支援―，ろう教育科学，64(2)，pp.97–99（2022）
- [14] 阿部学，藤川大祐，狩野明香理：教員養成学部授業における協働学習用アプリ教材制作の試み―家庭科および社会科の事例―，教育におけるゲーミフィケーションに関する実践的研究(3)，千葉大学大学院人文公共学府研究プロジェクト報告書第324集，pp.59–66（2018）．Abe, M., Fujikawa, D. and Kano, A.: Making Educational Applications for Collaborative Learning: In the Cases of Home Economics and Social Studies, Chiba University. Graduate School of Humanities and Studies on Public Affairs, Research Project Reports 324, pp.59–66 (2018). (in Japanese).
- [15] 若月大輔，塩野目剛亮，新井達也：ノベルゲーム型オンデマンド教材を用いた聴覚障害学生の学習行動分析，電子情報通信学会技術研究報告，IEICE-122(295)，pp.17–22（2022）．(Wakatsuki, D., Shionome T., Arai, T.: Analysis of Learning Behavior of Deaf and Hard of Hearing Students in Use of Novel-Game Type On-Demand Learning Contents.: IEICE-122(295)，pp.17–22（2022))
