This paper presents a high-accuracy real-time polygon extraction and classification algorithm. The algorithm is capable of extracting both convex and concave polygons from complex images. The algorithm can classify triangles into five distinct classes and can classify quadrilaterals into six distinct classes. The algorithm was tested with a variety of natural and synthetic 256×256 grayscale images and an average frame rate of more than 69 frames / second was obtained using a 450 MHz. Pentium II Processor. Experimental results are presented which demonstrate the high-accuracy of the algorithm.