Information retrieval from huge texts based on data compression and its application to association mining : Data compression for capturing the characteristics in texts

Abstract

In the last decade, many researchers have been attracted by information retrieval or information extraction from rapidly increasing text data, and they have also been motivated by efficient data management for a flood of texts. For this important but difficult problem, we would like to report a solution obtained by new compression technique intended to an intelligent information retrieval from huge data sets, and we also consider a possibility of new paradigm for extracting important associations beyond the ordinal keyword search.