Applying Dialogue Breakdown Detection to Dialogue Systems

Abstract

Dialogue breakdown detection is a technique used for identifying inappropriate utterances in dialogue systems. Although it is generally assumed that dialogue breakdown detection avoids generating system responses that then cause difficulties in continuing the given dialogue, this has yet to be verified. In this paper, we apply the dialogue breakdown detection technique to generate responses for a chat-oriented dialogue system and experimentally verify that performance is improved by measuring the extent to which dialogue breakdown is avoided. Our experimental results show that naturalness of dialogue and user satisfaction level are improved but enjoyment of dialogue is deteriorated when using this technique.