In this study, we aimed to develop a pitch visualization training system for singing for the deaf and hard-of-hearing (DHH) people and examined visual information that makes it easier to sing. From preliminary experiments, the characteristics of DHH people when singing are the tendency to lower the pitch at the end of singing,the di!culty of maintaining the same pitch, and the di!culty of grasping the timing of singing. I created a video that displays the pitch and score at the same time. For the evaluation, the beginning part of the nursery rhyme "Kaeru no uta" was created by piano sound using music editing software. Comparing the pitches before and after training, some participants tended to have a smaller pitch di"erence from the sound source than before training. The questionnaire after the experiment also suggested that displaying the lyrics according to the pitch, displaying the score in the background, and displaying the note name are e"ective for singing training for the DHH. On the other hand, some participants said that it was di!cult to practice because they could not grasp their own pitch,suggesting the need for real-time feedback on the pitch.
View full abstract