A Method to Infer the Utterance-Unit Tag in Dialogue Corpus

Abstract

Recently, large scale dialogue corpus with annotation of semantics and/or discourse is required in higher level natural language processing. The production of such a corpus demands a great amount of human effort because such a corpus involves higher level knowledge. A program that infers utterance-unit tags using other level tags would help reduce tagging work. Thus, we have proposed a method to infer the utterance-unit tag from both the text corpus and its morpheme analysis result. Also we have developed a GUI tool to support discourse level tagging, and have implemented the inferring method as one of the functions of this tool. The experimental result to evaluate this method shows a correct answer of 86% in c1osed tests and 73% in open tests.