Toward bigdata disease surveillance based on deep NLP analysis

Abstract

With the recent rise in popularity and size of social media, there is a growing need for systems that can extract useful information from this amount of data. We have been addressing an issue of detecting influenza epidemics using social media. Although previous methods relied mainly on frequencies of the influenza related words, they suffered from the noisy words. To deal with this problem, this study proposes deeper Natural Language Processing (NLP) approach that focuses on the each person. This paper discus the basic feasibility of the proposed approach basded on our experiences.