Method for Generating Captions for Clothing Images to Support Visually Impaired People

Abstract

Visually impaired people are able to read the shape and texture of objects and recognize them by the sense of touch of the hand. However, visual information such as color and pattern cannot be acquired. Therefore, it is difficult for visually impaired people to coordinate clothes without the assistance of a sighted person. In this study, we aimed to develop a system to support visually impaired people to choose clothing. In this paper, we describe a method for converting visual information acquired from clothing into verbal textual representation using deep neural networks.