Development of Learning Supporting System using Al and AR

Abstract

Technologies of automatic recognition by AI and augmented display by AR may help to compensate for the lack of understanding due to a lack of language or knowledge. For example, by automatically recognizing road signs and information boards in foreign countries and displaying them in their native language or motion graphics, it can be easy to understand them even without knowledge of the language, symbols, or historical backgrounds and it may help to acquire knowledge. It is not easy sometimes to understand the exact meaning of a road sign. If signs are more intuitive, accidents for children and non-drivers can be reduced too and foreigners can drive more safely. This study aims to support road signs and learning about traffic, and assist and enhance the experience of historical learning and educational trips. 'Automatic AR motion graphics of road signs (moving road signs)' and 'Automatic AR motion graphics and infographics of information boards in history textbooks and sightseeing spots' are developed. These are extended to realize city design for tourism and internationalization. In order to display contents according to the recognized road signs, a system was developed that judged the signs using DL, and its accuracy was verified. The system enables intuitive understanding by extending the expressions on road signs and information boards through AR technology, it is contributing to the improvement of the learner's experience and sustainable society by reducing the use of natural resources. Automatic recognition by AI technology makes AR easy to implement and highly flexible.