Tel-Gerich:共同注視およびカメラスイッチングに着目した遠隔ピアノレッスン支援システム

抄録

In recent years, with the development of ICT(Information and Communication Technology) such as communication technology and AR(Augmented Reality)/VR(Virtual Reality) technology, remote or correspondence education has become common in fields such as satellite classrooms, conference systems and language learning at school. On the other hand, regarding musical instrument learning and sports, learning in face-to-face environments is still common. The reasons for this are that in music special performance methods and instruction are required, while in sports physical behavior differs for each type of sport. Accordingly, it is difficult to teach these subjects effectively in remote environments where visibility and bodily contact are restricted. Therefore, the purpose of this research is to construct a remote piano lesson system that enables effective piano teaching even between two physically separate locations. The proposed system consists of multiple cameras to communicate the details of performance to the other party. In addition, it has an automated camera switching function that provides optimum video from multiple camera images, as well as a function for manually selecting video. Furthermore, in order to share instructions and observations, it has a function for sharing notations on the score. The results of the user study conducted using the proposed system proved that the automated camera switching function is useful in certain situations.