Proceedings of the ISCIE International Symposium on Stochastic Systems Theory and its Applications
Online ISSN : 2188-4749
Print ISSN : 2188-4730
The 50th ISCIE International Symposium on Stochastic Systems Theory and Its Applications (Nov. 2018, KYOTO)
Construction of Pronunciation Instructions on Tongue and Lips Movements based on Formants of Speech Signal
Kyoko YoshiwaraIzumi Hanazaki
Author information
JOURNAL FREE ACCESS

2019 Volume 2019 Pages 229-234

Details
Abstract

Currently, we are developing English pronunciation training system for Japanese adults. In this system, pronunciation is indicated by displaying formants, lip shapes, and tongue shapes that are effective for identifying vowels. In this work, focusing on the visualization of tongue shape and lip shape, analysis of MR image and speech signal was performed. Generally, there is a correspondence between the first formant and the opening length of the mouth. Therefore, we obtained correlation coefficients of the first formant detected from speech signal and opening of lips and jaws detected from MR image. As a result, it was found that some cases showed strong correlation or not depending on subjects. From past research, it is known that the Japanese vowel /u/ which is the lingual tongue vowel may change to the front tongue due to the protrusion of the lip. From this, it is considered that the subject who don't show strong correlation manipulates the phoneme by projecting the lips instead of opening the mouth vertically. In order to support this hypothesis, it is necessary to analyze more MR images and speech signals in the future.

Content from these authors
© 2019 ISCIE Symposium on Stochastic Systems Theory and Its Applications
Previous article Next article
feedback
Top