人工知能学会論文誌
Online ISSN : 1346-8030
Print ISSN : 1346-0714
ISSN-L : 1346-0714
萌芽論文
社会課題発見のための文書クラスタリングとクラスタ評価指標
橋本 泰一村上 浩司乾 孝司内海 和夫石川 正道
著者情報
ジャーナル フリー

2009 年 24 巻 4 号 p. 333-338

詳細
抄録

Document clustering is one of the useful approaches for macro analysis of the large scale of documents. However it is difficult for an analyst to efficiently detects clusters which contain important information from the results of document clustering. This paper presents a method to support an analysis of social problems from newspaper articles. We define two new measures for each cluster to discover important clusters from a dendrogram generated by hierarchical clustering algorithm. One, called ``Density'', is a measure of relevance among documents in a cluster, and is calculated from the rate of terms shared within a cluster. The other, called ``Centrality'', is a measure of relevance among clusters, and is calculated from the depth of an ancestor node shared by arbitray two clusters in a dendrogram and the number of documents in the clusters. The measures are an extension of the conventional research in the field of co-word analysis in science and technology literature. We carried out experiments to evaluate our method using the Nikkei newspaper articles which describe the organizational hazards caused by Japanese industries. The experimental results showed that our method efficiently provided useful information to detect important clusters from a dendrogram.

著者関連情報
© 2009 JSAI (The Japanese Society for Artificial Intelligence)
次の記事
feedback
Top