Acquiring Utterance Candidates for Chat-oriented Dialogue Systems from Wikipedia Based on a State Space Model

Abstract

This paper presents a method for acquiring utterance candidates for chat-oriented dialogue systems in specific domains from Wikipedia articles. A previously proposed method extracts sentences from Wikipedia articles related to the domain, converts them to utterances suitable for chat, and excludes sentences inappropriate as system utterances using a classifier. The classifier uses position information of the sentence in the article, but it is based on a simple logistic regression. On the contrary, our proposed method uses a state space model in a Bayesian approach. Experimental results show the proposed method outperforms the previous method.