Learning by Quiz Creation in Programming Education: Proposal and Experimental Application of Generative Artificial Intelligence (AI)-based Approach

Abstract

With the rapid advancement of information technology these days, there is an increasing demand to cultivate human resources capable of identifying and solving issues effectively through information technology, further underscoring the importance of information education. In this context, “learning by quiz creation, ” which learners create quizzes on their own, is expected to be highly effective in fostering the application of knowledge and skills. While there have been many studies on methods to support learning by quiz creation, this study proposes a new approach to support learning by quiz creation using generative artificial intelligence (GenAI). We designed quiz creation processes (QCPs) for three typical types of quiz creation (story-, quiz-, and solution-based) aimed at deepening learners' understanding. Furthermore, we developed quiz creation prompts to enable GenAI to guide these QCPs effectively while also supporting learners' proactive quiz creation. To verify the effectiveness of the proposed method, we set two research questions: (1) Can GenAI adequately guide the proposed QCPs? and (2) Can GenAI with prompts enhance learning effectiveness of quiz creation? We conducted an experimental application involving university students, and the results suggest that GenAI can serve as a suitable guide for learners in the initial stages of each QCP, with particular effectiveness observed in solution-based quiz creation. Additionally, GenAI equipped with quiz creation prompts received higher evaluations from learners compared to general GenAI, demonstrating its potential to enhance the learning experience.