Advanced Biomedical Engineering
Online ISSN : 2187-5219
ISSN-L : 2187-5219
Performance Improvement of Automated Melanoma Diagnosis System by Data Augmentation
Kana KatoMitsutaka NemotoYuichi KimuraYoshio KiyoharaHiroshi KogaNaoya YamazakiGustav ChristensenChristian IngvarKari NielsenAtsushi NakamuraTakayuki SotaTakashi Nagaoka
Author information

2020 Volume 9 Pages 62-70


Color information is an important tool for diagnosing melanoma. In this study, we used a hyperspectral imager (HSI), which can measure color information in detail, to develop an automated melanoma diagnosis system. In recent years, the effectiveness of deep learning has become more widely accepted in the field of image recognition. We therefore integrated the deep convolutional neural network with transfer learning into our system. We tried data augmentation to demonstrate how our system improves diagnostic performance. 283 melanoma lesions and 336 non-melanoma lesions were used for the analysis. The data measured by HSI, called the hyperspectral data (HSD), were converted to a single-wavelength image averaged over plus or minus 3 nm. We used GoogLeNet which was pre-trained by ImageNet and then was transferred to analyze the HSD. In the transfer learning, we used not only the original HSD but also artificial augmentation dataset to improve the melanoma classification performance of GoogLeNet. Since GoogLeNet requires three-channel images as input, three wavelengths were selected from those single-wavelength images and assigned to three channels in wavelength order from short to long. The sensitivity and specificity of our system were estimated by 5-fold cross-validation. The results of a combination of 530, 560, and 590 nm (combination A) and 500, 620, and 740 nm (combination B) were compared. We also compared the diagnostic performance with and without the data augmentation. All images were augmented by inverting the image vertically and/or horizontally. Without data augmentation, the respective sensitivity and specificity of our system were 77.4% and 75.6% for combination A and 73.1% and 80.6% for combination B. With data augmentation, these numbers improved to 79.9% and 82.4% for combination A and 76.7% and 82.2% for combination B. From these results, we conclude that the diagnostic performance of our system has been improved by data augmentation. Furthermore, our system succeeds to differentiate melanoma with a sensitivity of almost 80%.

Content from these authors
© 2020 Japanese Society for Medical and Biological Engineering

Copyright: ©2020 The Author(s). This is an open access article distributed under the terms of the Creative Commons BY 4.0 International (Attribution) License (, which permits the unrestricted distribution, reproduction and use of the article provided the original source and authors are credited.
Previous article Next article