深層学習を用いた拡張現実型聴診訓練システムの開発と医学教育試験への導入

抄録

We have proposed the auscultation training system EARS which reproduces the vital sound of various cases on the simulated patient using the augmented reality technology. In this study, EARS using auscultation position detection by deep learning was developed. To detect a chest piece and a simulated patient by using deep learning from an image photographed by a camera integrated stethoscope device. A biological sound corresponding to the auscultation position calculated from the detection results is reproduced. Stable auscultation position detection was confirmed, and it was introduced into actual medical education field, and the high evaluation was obtained by the questionnaire.