Diagram Understanding for Pictorial Book of Flora Using Integration of Pattern Information and Natural Language Information

Abstract

Cooperative use of diagrams and natural language text is quite effective for sophisticated and flexible information processing. Therefore, it is important to investigate the integration of pattern information and natural language information (especially in multi-media). For this purpose, we propose a new method for diagram understanding by using the integration of those information. We examined our method and the correct recognition was 95%. Furthermore, we combine this diagram information and meta-knowledge which was extracted from explanation of pictorial book, and obtained more precise meta-knowledge.