Image-Audio Transformation System Providing Merchandise Information to Visually Impaired Person

Abstract

We propose a system to provide the blind with the merchandise information of store shelves and to guide them to the merchandise. There are some problems of store-shelf-label recognition: (1) a variety of label types, (2) complex background, (3) color similarity between label and background, (4) label overlapping, (5) associating the name of the commodity with the price. We propose a store-shelf-label recognition method. The method uses label elements and label models. The system provides the merchandise information by synthesized voice. Experimental results for 35 images indicate satisfactory performance to the problems.