Proposal of Metrics Measuring Coherence Based on Sentence Similarity Graph with Document Structure

Abstract

Coherence of the document is having unity of semantic, further It is necessary to write a document that is easy to understand. It is difficult to evaluate coherence of long document, since demand of automatic evaluation of coherence is high. Also, previous method focused on adjacent sentences to evaluate coherence. However, it is necessary to consider document structure, since document consists of multiple segments. Therefore, in this research, we propose metrics measuring coherence based on sentence similarity graph with document structure. We performed comparative experiments with previous method. As a result, some output accuracies comparable to previous method, it is assumed that proposed method is valid to evaluate coherence.