The journal of Japanese Language Education Methods
Online ISSN : 2423-9909
Print ISSN : 1881-3968
Exploring the Potential of LLM Applications in Protocol Analysis:
Focusing on the Automation of Recall Protocol Analysis
JueiChi WANG
Author information
RESEARCH REPORT / TECHNICAL REPORT RESTRICTED ACCESS

2025 Volume 31 Issue 2 Pages 30-31

Details
Abstract
This study examines the feasibility of automating protocol analysis in Japanese as a Foreign Language (JFL) research through artificial intelligence (AI) applications. Drawing on written recall protocols from ten JFL learners, we evaluated text comprehension using both AI-based assessments and human raters. The findings show comparable reliability between automated and manual evaluations, underscoring significant methodological implications for L2 reading research and the automation of protocol analysis. This innovation addresses the labor-intensive nature of qualitative second language acquisition (SLA) research while preserving analytical rigor in comprehension assessment.
Content from these authors
© 2025 Japanese Language Education Methods
Previous article Next article
feedback
Top