Three Dimensional Rotation-Free Camera-based Character Recognition

Abstract

In this paper, we propose a new method for three dimensional rotation-free recognition of characters in scene. In the proposed method, we employ the Modified Quadratic Discriminant Function (MQDF) classifier trained with samples generated by three dimensional rotation process in a computer. We assume that when recognizing individual characters, considering three dimensional rotation can approximately handle the recognition of characters with perspective distortion. The results of the evaluation experiments using printed alphanumeric characters as an evaluation data set, consisting of approximately 600 samples per class for 62 character classes, show that the recognition rate is 99.34% for rotated characters while it is 99.59% for non rotated characters. We have empirically confirmed that the rotated characters given as the training data set do not negatively affect significantly to recognition of non rotated characters. Moreover, 813 characters extracted from 58 camera-captured scenes were correctly recognized and the feasibility of real world application of our method has been confirmed.