D4AC: A Multi-modal Dialogue System Development Tool for Interdisciplinary Collaboration

Abstract

To use dialogue system technology to address various social issues, interdisciplinary collaboration between experts in solving social problems and experts in dialogue systems is necessary. To make this collaboration easier, it is effective to enable experts in solving social problems who have little programming experience to build dialogue systems. This paper introduces a tool, D4AC, which enables the development of multimodal dialogue systems without writing a program. By using D4AC along with a text dialogue system development tool like xAIML SUNABA, it is possible to develop a multimodal dialogue system that can change the course of dialogue depending on the information about the user's age, gender, emotions, and engagement obtained from their facial images. D4AC can be installed, launched, and settings can be changed without technical knowledge. This paper also discusses the results of using D4AC in student projects of the TMI program at Nagoya University.