IEICE Transactions on Communications
Online ISSN : 1745-1345
Print ISSN : 0916-8516

この記事には本公開記事があります。本公開記事を参照してください。
引用する場合も本公開記事を引用してください。

Network Event Extraction from Log Data with Nonnegative Tensor Factorization
Tatsuaki KIMURAKeisuke ISHIBASHITatsuya MORIHiroshi SAWADATsuyoshi TOYONOKen NISHIMATSUAkio WATANABEAkihiro SHIMODAKohei SHIOMOTO
著者情報
ジャーナル 認証あり 早期公開

論文ID: 2016EBP3430

この記事には本公開記事があります。
詳細
抄録

Network equipment, such as routers, switches, and RADIUS servers, generate various log messages induced by network events such as hardware failures and protocol flaps. In large production networks, analyzing the log messages is crucial for diagnosing network anomalies; however, it has become challenging due to the following two reasons. First, the log messages are composed of unstructured text messages generated in accordance with vendor-specific rules. Second, network events that induce the log messages span several geographical locations, network layers, protocols, and services. We developed a method to tackle these obstacles consisting of two techniques: statistical template extraction (STE) and log tensor factorization (LTF). The former leverages a statistical clustering technique to automatically extract primary templates from unstructured log messages. The latter builds a statistical model that collects spatial-temporal patterns of log messages. Such spatial-temporal patterns provide useful insights into understanding the impact and patterns of hidden network events. We evaluate our techniques using a massive amount of network log messages collected from a large operating network and confirm that our model fits the data well. We also investigate several case studies that validate the usefulness of our method.

著者関連情報
© 2017 The Institute of Electronics, Information and Communication Engineers
feedback
Top