Character-level Text Generations with Attention for Chest X-ray Diagnosis

Abstract

Medical images are widely used in clinical practice for diagnosis and treatment, and much time is spent on diagnosis. Therefore, research to automatically generate cases from medical images has been actively conducted in recent years. However, it is difficult to judge the case as a classification problem because there are orthographic variants in the case written in the medical certificate. In this paper, we aimed to automatically generate character-level cases in order to cope with orthographic variants on chest X-ray images. In addition, the interpretability of the result was improved by introducing an attention mechanism. As a result, it was confirmed cases with features such as position information were generated, and the effectiveness of character-level approach was shown in text generation of medical images.